Influential RAND researcher Soren Mattke had this to say in support of Al Lewis and Vik Khanna’s latest post on the Wellness story “Would the Real Professor Katherine Baicker Please Stand Up?”
“Gentlemen. Great post. Like you, I am disappointed that researchers of the caliber of Kate Baicker and David Cutler do not respond to the mounting debate about their paper. They should defend or disown their work rather than hope that the debate goes away.
In my mind, their paper is a product typical of high-end academic research. Two brilliant professors spot a gap in the evidence on a hot policy topic and decide to go after it. But the actual work gets done by a graduate student in his cubicle without windows or guidance, and then hastily published.
Then the problem arises that the paper becomes hugely influential and people start having a closer look. For our paper on the PepsiCo program, we reviewed in detail the seven publications that Baicker and colleagues called “high quality evidence”. We found that five of those analyzed programs that operated over 20 years ago and most of them had severe methodologic flaws. (John P. Caloyeras, Hangsheng Liu, Ellen Exum, Megan Broderick and Soeren Mattke. Managing Manifest Diseases, But Not Health Risks, Saved PepsiCo Money Over Seven Years. Health Affairs, 33, no.1 (2014):124-131)
Unfortunately, many defenders of the industry continue to take the Baicker paper at face value, while closely scrutinizing or ignoring more nuanced and scientifically sound findings.
So I herewith support your motion!
Harvard Professor Katherine Baicker is arguably most acclaimed health policy researcher at arguably the most acclaimed (and not even arguably, the best-endowed) school of public health in the country. Her seminal account of the effect of Medicaid coverage on utilization and health status is a classic. As luck would have it, in 2008 Oregon used a lottery to ration available Medicaid slots. A lottery controls for motivation and as such eliminates participant-non-participant bias, since everyone who enters the lottery wants to participate. That meant only one major variable was in play, which was enrollment in Medicaid or not.
Chance favors the well-prepared, and Professor Baicker jumped on this research windfall. She found that providing Medicaid–and thereby facilitating access to basic preventive medical care–for the previously uninsured did not improve physical health status, but did increase diagnoses and utilization. Because of the soundness of the methodology, the conclusion were unassailable – more access to medical care does not improve outcomes or optimize utilization, which is a proxy for spending. (We ourselves reached a similar conclusion based on a similar analysis on North Carolina Medicaid’s medical home model.)
Yet Professor Baicker herself used exactly the opposite methodology to reach the exact opposite conclusion for workplace wellness. And that’s where the identity crisis begins.
She and two colleagues published a meta-analysis in 2010 of participant-vs-non-participant workplace wellness programs. Somehow—despite her affinity for Oregon’s lottery control—she found this opposite methodology to be acceptable. She concluded that workplace wellness generated a very specific two significant-digit 3.27-to-1 ROI from health care claims reduction alone, with another 2.37-to-1 from absenteeism reduction. The title of the article–now celebrating its fifth anniversary as the only work by a well-credentialed author in a prestigious journal ever published in support of wellness ROI—was equally unambiguous: Workplace Wellness Can Generate Savings.