When Foundation-Approved Apps Founder

What does it mean when an app wins a major foundation’s developer challenge, and then isn’t updated for two and a half years?

Today, as I was doing a little background research on task management apps for caregivers, I came across a 2012 post listing Pain Care as a handy app for caregivers.

Pain is certainly something that comes up a lot when it comes to geriatrics and supporting caregivers, so I decided to learn a little more about this app.

“The Pain Care app won the “Project HealthDesign” challenge by the Robert Wood Johnson Foundation and California HealthCare Foundation,” reads the descriptive text in the Google Play Store.

Well, well, well! RWJF and CHCF are big respectable players in my world, so I was impressed.

But then as I looked at the user reviews, I noticed something odd. Namely, that the most recent one seems to be from April 2012, which is like 2-3 generations ago when it comes to apps.

And furthermore, the app itself was last updated in February 2011. This is like a lifetime ago when it comes to apps.

I decided to download the app and give it a whirl. It’s ok. Seems to be an app for journaling and documenting pain episodes, along with associated triggers. Really looks like something developed by doctors: one of the options for describing the type of pain is “lancinating,” and in a list of “side-effects” (side effects of what? the pain medication one may have just taken?) there is the option to check “sexual dysfunction.” Or you could check “Difficulty with breathing.” (In case you just overdosed on your opiates, perhaps.)

The app does connect to a browser-based account where I was able to view a summary of the pain episode I’d documented. It looked like something that one should print and give to a doctor, and in truth, it would probably be helpful.

Setting snarky comments about the vocabulary aside: this app actually looks like a good start for a pain journal. But it needs improvement and refining, in order to improve usability and quality. Also, although I don’t know much about app development and maintenance, I assume that apps should be periodically upgraded to maintain good performance as the operating systems of iPhones and Android phones evolve.

What does it mean, that this app was blessed by RWJF but then has been left to founder? A quick look at the developer’s news feed reveals that the app maker, Ringful Health, has racked up an impressive array of research contracts and prestigious partnerships: NIHCMSConsumer Reports.

Will these alliances lead to more lasting (read: supported and improved in an ongoing fashion) products and apps that can benefit patients and caregivers? What is the measure of a successful app, from the perspective of public health authorities, and of foundations?

Clearly, this is partly about issues related to business case and funding. To maintain an app, you need money. (If you get money from active users, then you definitely need to work on keeping them happy.)

Who will pay to maintain the apps that foundations, government agencies, and public-interest agencies help start?

And what does happen to most of these apps and tech projects that win foundation awards? Would be interesting to learn more about the natural history of such apps…

Leslie Kernisan, MD, MPH, has been practicing geriatrics since 2006, and is board-certified in Internal Medicine and in Geriatric Medicine. She is a regular THCB contributor, and blogs at GeriTech.

Livongo’s Post Ad Banner 728*90

Leave a Reply

11 Comment threads
0 Thread replies
Most reacted comment
Hottest comment thread
10 Comment authors
HabibiRebeccaCoeliusMichael YuanLeslie Kernisan, MD MPHMike Painter Recent comment authors
newest oldest most voted

Only a smiling visitant here to share the love (:, btw great style.

Leslie Kernisan, MD MPH

Michael Yuan, thank you so much for sharing your perspective as a developer.

Rebecca, I’m glad you were able to clarify some of ONCs thinking in sponsoring these challenges.

I have to say, if misconceptions about the purpose of these challenges are common, then perhaps some changes in marketing and messaging might be eventually be helpful…


I thought I would chime in since the Division I work in at ONC sponsors many Challenges, including many that have been run through Health 2.0. A common misconception is that the primary intended outcome of Challenges is for the winning application to turn directly into a successful business. This perspective is usually held by people who have never actually worked in a startup or brought software to market. Anybody who has knows that a few weeks in you are just barely beginning to understand the problem and what you should build. At least for a startup, they have the… Read more »

Michael Yuan

We are the app developer. We are also disappointed with the outcome of the app. But I think we also learned valuable lessons here. One of the challenges small business facing is the need to rapid prototype and test the market, and then move on to another idea when the previous idea fails to gain traction. That is especially true with grant funded projects — they need to “make money” after the grant ends in order to justify continued development effort. Pain Care was developed in the early days of mHealth, and it was indeed very physician focused — the… Read more »

Leslie Kernisan, MD MPH

Thanks all for these comments! @ Mike Painter, thank you so much for taking the time to share the RWJF perspective. I had indeed figured that this was early on in everyone’s experience with apps and challenges; sorry if I didn’t make that clear in the post. In general, I’ve often noticed that my colleagues in academia create high-quality tools for clinicians or patients or caregivers and then they are never widely disseminated, or improved upon. Whereas many from the business and tech community have lots of experience figuring out how to get products out there and used/bought by people.… Read more »

Mike Painter
Mike Painter

RWJF here. Interesting post and conversation as always on THCB. The original post and comments all make some great points. For us at RWJF, though, there is important context regarding this particular Project HealthDesign challenge and app in question–perhaps most importantly: that challenge was a very early one for us–and arguably for the field in general. We were learning and continue to learn in fact about the role of challenges in general for us–and about challenges that promote app development in particular. We ran this challenge back in the summer 2010. It was among the first for us; the winner… Read more »

40yearold doc
40yearold doc

“What does it mean?”

That the OP has too much time on her hands?


All these observations are right – when apps are thought of as “toys” and not useful tools for managing a problem or health generally, that’s what will happen. I’m hoping that different “apps” (I use this term loosely) will prove more effective – cost-wise and convenience-wise for patients – so that “less” of other stuff is needed. Medications, hospital and custodial care, face to face clinician visits, etc. That will take more well thought out stuff than what’s currently seen as “hot” today. The pain management app is an example of some I’ve seen tested and used for other single-purpose… Read more »


@ Peter Elias What does it mean? Well, to me this is about sustainable development. Too many people are doing work like this and moving on to the next product and the next contest rather than building products that are carefully thought out and designed to evolve and succeed. This is a fundamental philosophical choice. Why are people doing this? Certainly not because they’re stupid. They’re doing this because this is what the system incentivizes them to do so. I’d like to see a study that scientifically tracks the life cycle of products in the app economy. And oh –… Read more »


This is a free app? From what see it appears to be. There are two points here. One is that free apps need to have some revenue in order for it to be updated and promoted and kept alive in the eyes of the users and new users. It is becoming apparent that paying for an app has a huge benefit for the user re: support and updates. In app sales may help but it is hard to do with health related apps. The second point is that the app maker may have used this app to get press, get… Read more »

Peter Elias

What does it mean?

Perhaps it means that the app was built and is owned/maintained by people whose goal was to create and sell something. They did so, accumulating some accolades in the process, and have moved on.