OP-ED

Are Young Doctors Failing Their Boards? Or Are We Failing Them?

A short piece in The Health Care Blog  reveals (albeit unintentionally) why so many outside of healthcare think the medical establishment still doesn’t get it.

The post, written by a general internist and residency program director, asked why an increasing number of internal medicine doctors are failing their internal medicine board exams.  The pass rate has reportedly declined over the last several years from 90% to 84%.  (Disclosure: I passed this required test about a decade ago.)

His differential included two possibilities:

(1)    The test is getting harder – The testing agency said this wasn’t the case.

(2)    Millennials lack the study habits of their elders, and have become great “looker-upers.” – The author suggested this was a key factor, and several commentators enthusiastically agreed.

The basic thesis here that in the Days of Giants, doctors worked harder, learned more, and were better.  Nowadays, doctors are relatively complacent, less invested, less informed, and are generally worse – which is what’s reflected on the board exams.

Let me suggest a third possibility – perhaps today’s doctors are providing better care to patients than their predecessors were a generation ago.  Maybe today’s doctors have figured out that in our information age, your ability to regurgitate information is less important than your ability to access data and intelligently process it.  Maybe what makes you a truly effective doctor isn’t your ability to assert dominance by the sheer number of facts you’ve amassed, but rather how well you are able to lead a care team, and ensure each patient receives the best care possible.

In other words, what if the problem isn’t the doctors, who are appropriately adapting, but rather the tests (and the medical establishment), which may not be?

I’ve previously expressed concern that healthcare workers in general are subject to a series of expensive exams that are viewed as assessments of, and then proxies for quality, yet which are rarely correlated with any meaningful quality measure.  They remain an important source of money and status for the societies (guilds) that develop and administer them.  To the extent that we attach value to certification measures uncorrelated with quality, we are enablers, part of the problem.

I’ve not always seen eye to eye with technologist and investor Vinod Khosla, yet he’s absolutely right when he points to the rapidly accumulating amounts of medical information available in the world, and the absurdity of expecting any individual person to truly master it.

The doctor of the future should have the humility to understand her own limitations, and know how to use technology productively to find what she needs.  She should be comfortable enough with technology so that it’s used in service of patient care, and not in place of it.  She must also recognize when to distrust technology, and perhaps most importantly, know when to set it aside.

If board scores suggest young physicians aren’t learning the currently required material, it may not be test-takers who are failing.

David Shaywitz is co-founder of the Center for Assessment Technology and Continuous Health (CATCH) in Boston.  He is a strategist at a biopharmaceutical company in South San Francisco. This post originally appeared in his regular Forbes column.

Livongo’s Post Ad Banner 728*90

26
Leave a Reply

21 Comment threads
5 Thread replies
0 Followers
 
Most reacted comment
Hottest comment thread
21 Comment authors
Susan BriggstombobNickBjohn Recent comment authors
newest oldest most voted
Susan Briggs
Guest
Susan Briggs

I cannot agree more Tom. I too found out today that I failed and our study practices were very similar. That test was complete bullshit and it’s just a way for the guilds to make money. Bullshit.

tom
Guest
tom

I just received my exam results, i failed. I not only completed a great residency at a university but have NEVER failed a test in my life. I studied my ass of for 7 months, went thru MKSAP twice and read all the books not to mention other sources. Not only was the test complete bullshit, its literally a mental game. I learned that if you have other stuff going on in life do not take this test, reschedule it, because now im considering leaving medicine and never coming back. My patients btw love me and i have been nominated… Read more »

bob
Guest
bob

l

Nick
Guest
Nick

This article interested me, but I’m not really sure if it really addressed the issue that I personally see plaguing our medical education in today’s world. In this world that technology is rapidly advancing and more and more information is at the fingertips of the physician, every physician is being forced to look information up. The largest issue I see in medical education is in the teaching. Many teaching physicians feel the pressure of time and efficiency to see their patients (20 minutes in an out patient setting is indeed generous). Physicians are expected to run on time, garner the… Read more »

Bjohn
Guest

I think it is up to young physicians how they learn their required material, if they don’t they can fail.

Paul Kempen, MD, PhD
Guest
Paul Kempen, MD, PhD

Many other possibilities exist. More important is to recognize that PROFITS are up with retesting and the “curve” is adjusted by a board of 12 individuals “in it for the glory and money”-i.e. NO freedom from corruption or conflicts of interests. The ABMS is more a “guild mechanism” to restrict numbers of “eligible physicians” based on an arbitrary test. The original “qualified ot serve as a consultant in” has now been degraded to a MOC certificate indicating compliance with a non-validated, non-government private corporate program only. The ABMS has NO impact in the world EXCEPT the USA where we have… Read more »

Doctor Mawrdough
Guest
Doctor Mawrdough

We are not failing young physicians. The system of using HIT care record devices is sapping their cognitive power to learn clinical medicine and clinical judgment. HIT care record devices and their CPOE and CDS modules represent a new disease that requires painstaking time devoted to understanding its idiosyncrasies and whimsical flaws and error creating capacities. For those of you commenting on and writing these blogs, you ought to disclose whether you are an interested watcher or an active user of these toxic instruments of care. If you have ever used them, you will quickly understand why the trainees have… Read more »

Shirie Leng, MD
Guest

Yes!

bamadoc
Guest
bamadoc

Can someone share any data that correlates being “board certified” with clinical competence/decision-making and better patient outcomes?

Sandra_Raup
Guest

What do most patients want and need from their physicians? Generalists vs. specialists? Is it something you can test? What I assume when I see someone who has passed such a credentialing exam is that they are a problem solver. Perhaps there’s a difference between being able to memorize and being able to problem solve. For example, you’re more likely to do well on legal profession tests (LSAT and bar exam) if you can read and comprehend complex material quickly; memorization less of an issue. What I want in any advisor (medical, legal, financial, or anyone else) is someone who… Read more »

Frank
Guest
Frank

I agree wholeheartedly about your uncertainty with “Board” testing. I passed my college boards, MCATS, internal med and specialty boards with high grades on the first attempt. I’m convinced that the ability to pass the boards doesn’t mean you are a good doc. It means that you can memorize like a demon, retain the memorized info for a short period of time, use the memorized data to take the test and then forget it. I’d love to see data that looks at the value of these tests as a predictor of quality. I don’t think there is any – and… Read more »

Mycophenolate
Guest
Mycophenolate

4th hypothesis:

Residents and interns are squeezed by the hospital system and work demands that they aren’t having the time to learn what they are supposed to.

Residency reform. That’s what this blog should be all about.

Nick
Guest
Nick

I’d say it goes beyond residency reform and has to be medical education reform to its core, specifically for clinical rotations.

Whatsen Williams
Guest
Whatsen Williams

Judgment is an essential ingredient in effective care. Judgment requires creative energy and cognitive power and is not available on these eperimental HIT devices. Fact is that the HIT devices are impediments to the needs of the would be effective clinician, and dumb down the user, which is why I am excited about the failure rate in the Boards. QED

William Hersh, MD
Guest

You may be right, but do you have any evidence to support your claims? Most practicing physicians I know, even older ones, are grateful for the information these devices provide at their fingertips.

William Hersh, MD
Guest

I agree with this posting. Let me restate some things I replied in response to Dr. Shumann’s post: This development of falling board scores is a concern, but before we ascribe blame to health IT, Gen Y/millenial laziness, or anything else, can we see some data supporting the assignment of blame? Let’s not let this finding be a Rorschach test for everything each of us does not like about medicine, healthcare, or society. Similar to Dr. Shaywitz, I have a more fundamental question: Is an exam like the ABIM the best indicator of how a physician best applies his or… Read more »

Leora Horwitz
Guest
Leora Horwitz

Having just (phew!) passed my first recert exam, I read this post and the related one with interest. I think both viewpoints are important. I agree with Dr. Shaywitz that for complicated hospital inpatients, where you have a lot of time to spend per patient, it is more important that physicians have the skills to look up the latest treatments, differential diagnoses, etc than necessarily to try to memorize a whole ton of facts that change on a regular basis. On the other hand, though, I do most of my clinical work in the outpatient primary care setting. At 20… Read more »

William Hersh, MD
Guest

Perhaps, Dr. Horwitz, but do you really want to trust your memory in those cases where you think you have something memorized? I would be interested to know what things you think you have memorized but actually do not.