More Can Also Be Less: We need a more complete public discussion about comparative effectiveness research

Media coverage of the government’s new investment in comparative effectiveness research leans heavily toward the effects of such research on new drugs and technologies: Will such evaluations lead to restricted access to the latest innovations?  Will insurance no longer cover a drug that might give my aunt another year to live? Will such research hinder the development of a drug that could cure my nephew of type I diabetes?

The focus on how results from comparative effectiveness research might affect new approaches  obscures for the public and for policymakers the vital role of such research in evaluating current approaches to diagnosis and treatment that may not only be ineffective but in fact harmful to us.

I am now slogging through chemotherapy for stomach cancer almost certainly caused by receiving high doses of radiation for Hodgkin lymphoma, which was the standard treatment until long-term side effects (heart problems, additional cancers) emerged in the late 1980s.  So I am especially attuned to the need for registries and trials to track the short- and long-term effectiveness of treatments.

So choosing a surgeon in September to remove my tumor shone a bright light for me on the importance of research to evaluate current practices. Two of the three surgeons I consulted wanted to follow “standard treatment procedures” and leave a six-centimeter cancer-free margin around my tumor. This meant taking my whole stomach out, because of the anatomy of my stomach and its arterial supply.

The third surgeon began instead by stating that her aim would be to preserve as much of my stomach as possible because of the difference in quality of life between having even part of one’s stomach versus none.  If possible, she wanted to spare me life without a stomach.

But what about the six-centimeter margin?  “There isn’t really much evidence to support that standard,” she said.  “That issue came up at a national guidelines meeting earlier in the week and we discussed it.  No one seemed to know where it came from.  We have a gastric cancer registry at this hospital going back to the mid 1990s and we haven’t seen support for it there, either.  A smaller margin is not associated with an increased risk of recurrence.”

I agonized about different types of uncertainty, which I realize is the essence of medicine, but which most of the time I don’t have to confront quite so personally.  I decided to work with the surgeon who wanted to be guided by the evidence (and lack thereof) rather than the “accepted standards” for surgical treatment.

Here’s why: my current stomach cancer was, very likely, caused by what at the time was standard radiation treatment for Hodgkin lymphoma but which evidence now shows was overly aggressive and harmful.  If at all possible, I did not want to experience daily the effects of another unnecessarily aggressive medical procedure, one that for years has been the accepted standard but for which little evidence yet exists.

Most of us are unaware that the evidence base for much of the current practice of medicine is so spotty. Some of the drugs and technologies we use to keep us upright and free of pain do indeed help us, but some of them may make no difference and some may do us serious harm.  We believe that our physicians wouldn’t recommend them if they weren’t effective. We remain optimistic that advances in medicine will be even better in saving our lives.  And so we resonate with the media’s focus on the impact of comparative effectiveness research on new approaches: It doesn’t undermine our trust in current practice, only in our ability to get more and better treatments in the future.

My experience reminds me of how poorly the public has been informed about comparative effectiveness research. We need to realize that:

  • -such research determines not only how well new treatments work, but more importantly, which among standard treatments works best and should remain the dominant approach, and what causes harm and should change.
  • producing such evidence is only the first step in changing a given clinical practice; informing clinicians and supporting widespread adoption of a new approach is no small challenge.
  • the evidence for different treatments can and should be a topic that patients and doctors discuss together, difficult though that discussion may be for all parties.
  • we – patients and families — are the major stakeholders in the comparative effectiveness research enterprise.  Such research is not done by white-coated lab scientists.  Rather it is done with, to, and for us: we must actively participate in clinical trials and other types of research if we and our kids and grandkids are going to benefit from the best available care.

Sure, the effect of comparative effectiveness research on new developments in medicine is important.  But those concerns constitute only one small part of a much larger, more important public discussion about what it is going to take to develop, identify, provide – and to understand – the evidence to support decisions we make with our doctors to improve the length and quality of our lives.

Jessie Gruman, PhD, is the founder and president of the Washington, DC -based Center for Advancing Health. She is the author of Aftershock: What to Do When You or Someone you Love is Diagnosed with a Devastating Diagnosis. She blogs regularly on the Prepared Patient Forum.

9 replies »

  1. Doctors are quick to dismiss therapies that are not sanctioned by their peers. Often these specialities have clear and concise parimeters of operations. Simply speaking,these peer standards often reject other proven therpies that are benefical to patients.
    Tort reform will not stop malpractice.However, what other reasonable course would a Harmed patient have and should the patient bear the burden alone? Interestingly enough, Preventable medical errors do happen,but I have Not seen anyone in the Medical Profession take responsibility for harming a patient. Many follow up surgeries relating to Medical Error are always tacked on at the patients expense. Doctors need to own up to the mistake and stop charging patients for their mistakes. Back to lawsuites and why patients sue,is clearly related to the patients state of mind! Doctors and Hospitals need to make it right and take some responsibility. Negating that responsibility draws further anger and resentment.
    Patients will have to live with those mistakes the rest of their lives and doctors and Hospitals should consider the patients rights before investor Rights.

  2. “We need a more complete public discussion about comparative effectiveness research”
    We all need evidence that EHR deployments with CPOE are not a collossal waste of time and money and cause a destruction of safety resilience systems already in place. Comparative effectiveness of the devices being used for comparative effectiveness has never been done. Thus, a Ponzi scheme in research.

  3. The standard of care is developed by the work of guidelines panels who are charged with evaluating the data that support various interventions. In this case, a guidelines panel apparently looked at current practice and decided that it was not adequately supported by data and recommended a change in the standard of care as codified in guidelines. Data collected over a period of years in registries is another good source of evidence. Isn’t this the way it is supposed to work?

  4. You are illustrating the problem with “standard of care”, a concept that will prevail at the malpratice trial against your surgeon. Your heir will allege he violated the standard of care by leaving inadequate margins. A parade of noted experts will testify as to the long accepted standard; wherever it came from will be irrelevant.
    The fact that you chose to go for the smaller, riskier margins will be irrelevant: It is the surgeon’s duty to practice to the prevailing standartd of care, regardless of what you wanted.
    No amount of research will change the crucible of the court room where the determination of the sandard of care occurs. It is not through research. It is through litigation in front of a jury of peers who have no special knowledge about research or medicine or surgery or stomach cancer.
    Hope everything works out for you.

  5. Yes, evidence is important: “the evidence to support decisions we make with our doctors to improve the length and quality of our lives.”
    Where is the outcome benefits and cost reductions evidence that justifies the spending of $ billions of tax dollars on HIT, EHR, and CPOE devices? Where have the pilots on this experiment been done and where have they been published? Easy to answer: No place and no place.

  6. Comparative Effectiveness Researchentions to determine which work best for which patients and which pose the greatest benefits and harms.Comparative effectiveness research has captured the attention of the stakeholders in health care.

  7. Excellent idea, but for starters, subject outcomes and costs of care run by CPOE devices to the comparative effectiveness algorithm, before using such experimental devices on other devices and therapies.