If you have ever tried to choose a physician or hospital based on publicly available performance measures, you may have felt overwhelmed and confused by what you found online. The Centers for Medicare and Medicaid Services, the Agency for Healthcare Research and Quality, the Joint Commission, the Leapfrog Group, and the National Committee for Quality Assurance, as well as most states and for-profit companies such as Healthgrades and U.S. News and World Report, all offer various measures, ratings, rankings and report cards. Hospitals are even generating their own measures and posting their performance on their websites, typically without validation of their methodology or data.
The value and validity of these measures varies greatly, though their accuracy is rarely publically reported. Even when methodologies are transparent, clinicians, insurers, government agencies and others frequently disagree on whether a measure accurately indicates the quality of care. Some companies’ methods are proprietary and, unlike many other publicly available measures, have not been reviewed by the National Quality Forum, a public-private organization that endorses quality measures.
Depending where you look, you often get a different story about the quality of care at a given institution. For example, none of the 17 hospitals listed in U.S. News and World Report’s “Best Hospitals Honor Roll” were identified by the Joint Commission as top performers in its 2010 list of institutions that received a composite score of at least 95 percent on key process measures. In a recent policy paper, Robert Berenson, a fellow at the Urban Institute, Harlan Krumholz, of the Robert Wood Johnson Foundation, and I called for dramatic change in measurement. (Thanks to The Health Care Blog for highlighting this analysis recently.)
We made several recommendations, including focusing more on measuring outcomes such as mortality and infections rather than processes (e.g. whether patients received the recommended treatment) or structures of care (e.g. whether ICUs are staffed around the clock with critical care specialists). We urged that measures be at the organization level rather than clinician level, to reflect the fact that safety and quality are as much products of care delivery systems as of individual clinicians. We propose investments in the “basic science” of measurement so that we better understand how to design good measures. You can read these and other recommendations in the analysis.
Continue reading “A SEC for Health Care?”
Filed Under: Hospitals, OP-ED, THCB
Tagged: Measurement, Outcomes, Peter Pronovost, Quality, SEC
Jun 4, 2013
The unfortunate reality is that there is no body of expertise with responsibility for addressing the science of performance measurement. The National Quality Forum (NQF) comes closest, and while it addresses some scientific issues when deciding whether to endorse a proposed measure, NQF is not mandated to explore broader issues to advance the science of measure development, nor does it have the financial support or structure to do so.
An infrastructure is needed to gain national consensus on: what to measure, how to define the measures, how to collect the data and survey for events, what is the accuracy of EHRs as a source of performance, the cost-effectiveness of various measures, how to reduce the costs of data collection, how to define thresholds for measures regarding their accuracy, and how to prioritize the measures collected (informed by the relative value of the information collected and the costs of data collection).
Despite this broad research agenda, there is little research funding to advance the basic science of performance measurement. Given the anticipated broad use of measures throughout the health system, funding can be a public/private partnership modeled after the Patient-Centered Outcomes Research Institute or a federally-funded initiative, perhaps centered at AHRQ. Given budgetary constraints, finding the funding to support the science of measurement will be a challenge. Yet, the costs of misapplication of measures and incorrect judgments about performance are substantial.
Continue reading “6. Invest in the basic science of measurement development and applications.”
Filed Under: Uncategorized
Tagged: AHRQ, Featured Posts, Harlan Krumholz, National Quality Forum, Outcomes, performance measurement, Peter Pronovost, Quality, Robert Berenson, RWJF
May 27, 2013
Performance measurement has too often been plagued by inordinate focus on technical aspects of clinical care—ordering a particular test or prescribing from a class of medication—such that the patient’s perspective of the care received may be totally ignored. Moreover, many patients, even with successful treatment, too often feel disrespected. Patients care not only about the outcomes of care but also and their personal experience with care.
There is marked heterogeneity in the patient experience, and the quality of attention to patients’ needs and values can influence their course, whether or not short-term clinical outcomes are affected. Some patients have rapid recovery of function and strength, and minimal or no symptoms. Other patients may be markedly impaired, living with decreased function, substantial pain, and other symptoms, and with markedly diminished quality of life. It would be remiss to assume that these two groups of patients have similar outcomes just because they have avoided adverse clinical outcomes such as death or readmission.
In recommending a focus on measuring outcomes rather than care processes, we consider surveys or other approaches to obtaining the perspectives of patients on the care they receive to be an essential component of such outcomes. When designed and administered appropriately, patient experience surveys provide robust measures of quality, and can capture patient evaluation of care-focused communication with nurses and physicians . And while patient-reported measures appear to be correlated with better outcomes, we believe they are worth collecting and working to improve in their own right, whether or not better experiences are associated with improved clinical outcomes .
Continue reading “4. Measure patient experience with care and patient-reported outcomes as ends in themselves.”
Filed Under: Uncategorized
Tagged: Featured Posts, Harlan Krumholz, Measurement, Outcomes, patient engagement, Patients, Peter Pronovost, Quality, Robert Berenson, RWJF
May 26, 2013
It has been a couple of weeks since the landmark Oregon Experiment paper came out, and the buzz around it has subsided. So what now? First, with passage of time, I think it is worth reflecting on what worked in Oregon. Second, we should take a step back, and recognize that what Oregon really exposed is that health insurance is a small part of a much bigger story about health in general. This bigger story is one we can’t continue to ignore.
So let’s talk quickly about what worked in Oregon. Health insurance, when properly framed as insurance (i.e. protection against high, unpredictable costs) works because it protects people from financial catastrophe. The notion that Americans go bankrupt because they get cancer is awful and inexcusable, and it should not happen. We are a better, more generous country than that. We should ensure that everyone has access to insurance that protects against financial catastrophe. Whether we want the government (i.e. Medicaid, Medicare) or private companies to administer that insurance is a debate worth having. Insurance works for cars and homes, and the Oregon experiment makes it clear that insurance works in healthcare. No surprise.
The far more interesting lesson from Oregon is that we should not oversell the value of health insurance to improving people’s health. While health insurance improves access to healthcare services (modestly), its impact on health is surprisingly and disappointingly small. There are two reasons why this is the case. The first is that not having insurance doesn’t actually mean not having any access to healthcare. We care for the uninsured and provide people life-saving treatments when they need it, irrespective of their ability to pay. Sure – we then stick them with crazy bills and bankrupt them – but we generally do enough to help them stay alive. Yes, there’s plenty of evidence that the uninsured forego needed healthcare services and the consequences of being uninsured are not just financial. They have health consequences as well. But, claims like 50,000 Americans die each year because of a lack of health insurance? The data from Oregon should make us a little more skeptical about claims like that.
So what really matters? Right now, we are pouring $2.8 trillion into healthcare services while failing to deliver the basics. To borrow a well-known phrase, our healthcare system is perfectly designed to produce the outcomes we get – and here’s what we get: mediocre care and lousy outcomes at high prices. Great.
Continue reading “The Oregon Experiment Revisited”
Filed Under: OP-ED, THCB
Tagged: Ashish Jha, Costs, Insurance, Oregon Medicaid Experiment, Outcomes, Quality
May 23, 2013
Much has already been written about the Oregon Medicaid study that just came out in the New England Journal of Medicine. Unfortunately, the vast majority is reflex, rather than reflection. The study seems to serve as a Rorschach test of sorts, confirming people’s biases about whether Medicaid is “good” or “bad”. The proponents of Medicaid point to all the ways in which Medicaid seems to help those who were enrolled – and the critics point to all the ways in which it didn’t. But, if we take a step back to read the study carefully and think about what it teaches us, there is a lot to learn.
Here is a brief, and inadequate, summary (you should really read the study): In 2008, Oregon used a lottery system to give a set of uninsured people access to Medicaid. This essentially gave Kate Baicker and her colleagues a natural experiment to study the effects of being on Medicaid. Those who won the lottery and gained access were compared to a control group who participated in the lottery but weren’t selected. Opportunities to conduct such an experiment are rare and represent the gold standard for studying the effect of anything (e.g. Medicaid) on anything (like health outcomes). Two years after enrollment, Baicker and colleagues examined what happened to people who got Medicaid versus those who remained uninsured. There are six main findings from the study. Compared to people who did not receive Medicaid coverage:
- People with Medicaid used more healthcare services – more doctor visits, more medications and even a few more ER visits and hospitalizations, though these last two were not statistically significant.
- People with Medicaid were more likely to get lots of tests – some of them probably good (cholesterol screening, Pap smears, mammograms) and some of them, probably bad (PSA tests).
- People with Medicaid, therefore, not surprisingly, spent more money on healthcare overall.
Continue reading “Misunderstanding Oregon”
Filed Under: OP-ED, THCB
Tagged: Ashish Jha, health care access, Medicaid, NEJM study, Oregon Medicaid Experiment, Outcomes, Quality
May 2, 2013
The most important study in American health policy in decades, the Oregon Health Insurance Experiment, published two-year results Wednesday in the New England Journal of Medicine. If you’re reading up on the topic, get ready for bombastic claims and scorching heat as opposed to illuminating light. The quick read leads to an easy Drudge headline – “MEDICAID DOESN’T MAKE PEOPLE HEALTHIER: OBAMACARE WILL FAIL!” – but a fuller reading of the evidence provides a more optimistic, and honest, take.
In 2008, Oregon had 90,000 individuals who wanted to enroll in its Medicaid program, but the funding to enroll only a fraction. So it decided to use the opportunity to create an unparalleled experiment: the first Randomized Controlled Trial (RCT) – the gold standard research methodology that is able to isolate the causal effect of an intervention – in Medicaid history. It endeavored to show nothing less than the actual, causal effect that Medicaid has on its population, a first in the field.
This study, in other words, is a big, big deal.
Two years of data are in, and the results are mixed. First up, the disappointing: Medicaid coverage.
Continue reading “Evidence That Health Does Not Equal Healthcare? Early Results From the Oregon Experiment Are In”
Filed Under: OP-ED
Tagged: Affordable Care Act, Costs, Mike Miesen, NEJM study, Obamacare, Oregon Medicaid Experiment, Outcomes, prevention
May 2, 2013
We’re all aware of the past criticisms of “disease management.” According to the critics, these for-profit vendors were in collusion with commercial insurers, relying robo-calls to blanket unsuspecting patients with dubious advice. Their claims of “outcomes” were based on flawed research that was never intended to be science; it was really intended to market their wares.
But suppose this correspondent alerted you to:
1. A company that had developed a patient registry to identify at-risk patients who had not received an evidence-based care recommendation? Software created mailings to those patients that not only informed them of the recommendation but offered them a toll-free number to call if there were questions. Patients who remained non-compliant were then called by coordinators, who made three attempts to contact the patient and assist in any scheduling needs. If necessary, a nurse was available to telephonically engage patients and develop alternative care options.
If you think that sounds like typical vendor-driven telephonic disease management, you’d be right. You’d also be describing an approach to care that was studied by Group Health Cooperative using their electronic record, medical assistants and nurses. When it was applied to colon cancer screening, a randomized study revealed each additional level of support progressively resulted in statistically significant screening rates.
Continue reading “Why Disease Management Won’t Be Going Away Any Time Soon”
Filed Under: The Business of Health Care
Tagged: CMS, Commonwealth Fund, Disease Management, Group Health, Insurers, Jaan Sidorov, Outcomes, Patients, PCMH, prevention, vendor-driven disease management, Vendors
Apr 2, 2013
“We spend far more on health care than other peer countries yet have worse outcomes. Why is U.S. health care so expensive?” I’m sure you’ve encountered similar statements, maybe even expressed it yourself. It occurs often, including by knowledgeable people and health-related institutions. However, it’s a fallacy because it confuses health care with population health.
Health care is a proper subset of population health. For example, longevity is determined by more than just health care. Using a specific recent estimate (Appendix Exhibit A6 – gated), an average 20-year old U.S. white male who did not graduate high school will live 10.5 fewer years than a similar man with a college degree. That’s over ten years of life related to educational attainment. Sure, there are many reasons for the difference, and health care or the lack of it is only one of them.
Continue reading “Health Care Shibboleth”
Filed Under: OP-ED, THCB
Tagged: Art Kellermann, Costs, Frank de Libero, Health Affairs, Health care spending, health-care-is-health-fallacy, Institute of Medicine, Outcomes, Population Health, Tom Daschle
Mar 24, 2013
Writing in the March 20 issue of JAMA, Drs. Douglas Noble and Lawrence Casalino say that supporters of Accountable Care Organizations (ACOs) are all muddled over “population health.”
This correspondent says the article is what is muddled and that the readers of JAMA deserve better.
According to the authors, after the Affordable Care Act launched the Medicare Accountable Care Organizations (ACOs), their stated purpose has morphed from Health-System Ver. 2.0 controlling the chronic care costs of their assigned patients to Health System Ver. 3.0 collaboratively addressing “population health” for an entire geography.
Between the here of “improving chronic care” and the there of “population health,” Drs Noble and Casalino believe ACOs are going to have to confront the additional burdens of preventive care, social services, public health, housing, education, poverty and nutrition. That makes the authors wonder if the term “population health” in the context of ACOs is unclear. If so, that lack of clarity could ultimately lead naive politicians, policymakers, academics and patients to be disappointed when ACOs start reporting outcomes that are limited to chronic conditions.
Continue reading “Accountable Care Organizations Can Change Everything, But Only If We Get the Definition Right”
Filed Under: Hospitals, OP-ED, THCB, The Business of Health Care
Tagged: ACOs, Affordable Care Act, Care Continuum Alliance, Douglas Noble, Jaan Sidorov, JAMA, Lawrence Casalino, Outcomes, Patient-centered care, Population Health, Quality
Mar 20, 2013
The expansion of health insurance coverage may be the most visible aspect of health reform, but other elements will ultimately have a significant impact on how we all experience health care. One pivotal change is how health care organizations are paid. New payment approaches will reward providers based on whether services actually improve patients’ health and keep costs down versus simply incentivizing them to provide more care.
One of the more consequential changes will be a greater focus on helping patients to be more involved in their care. There is ample evidence that the behaviors people engage in and the health care choices they make have a very clear effect on both health and costs, positively and negatively. The most innovative health care delivery systems recognize this and see their patients as assets who can help them achieve the goals of better health at lower costs. From this point of view, “investing” in patients and helping them to be more effective partners in care makes good sense.
Our study, reported in the February issue of Health Affairs, highlights this role that patients play in determining health-related outcomes. We found that patients who were more knowledgeable, skilled and confident about managing their day-to-day health and health care (also known as “patient activation,” measured by the Patient Activation Measure) had health care costs that were 8 percent lower in the base year and 21 percent lower in the next year compared to patients who lacked this type of confidence and skill. These savings held true even after adjusting for patient differences, such as demographic factors and the severity of illnesses.
Even among patients with the same chronic illness, those who were more “activated” had lower overall health care costs than patients who were less so. Among asthma patients, the least activated patients had costs that were 21 percent higher than the most activated patients. With high blood pressure, the cost differential was 14 percent.
Continue reading “Engaged Patients Translate to Better Outcomes and Costs”
Filed Under: THCB, The Business of Health Care
Tagged: Affordable Care Act, Costs, Health Affairs, Incentives, Insignia Health, Jessica Greene, Judith Hibbard, Outcomes, Patient Activation Measure, patient engagement, Pay for Performance
Feb 10, 2013