Categories

Tag: Pouyan Golshani

Physicians Already Vet AI Tools. Regulation Should Let Them.

By POUYAN GOLSHANI

The Food and Drug Administration is now deciding how to regulate generative AI-enabled medical devices, tools that accept open-ended inputs, produce variable outputs and are often built on third-party foundation models. Its discussion paper asks the right questions. The best evidence for answering them comes from the specialty that has lived with regulated AI the longest. Of 1,430 AI-enabled device authorizations on the FDA’s public list from 1995 through 2025, 1,094 (76.5 percent) were reviewed by the radiology panel, and radiology, cardiovascular and neurology together accounted for 90.6 percent, according to a peer-reviewed analysis I co-authored. Annual authorizations rose from about 1.8 a year to 264 a year. Not one was recorded under a psychiatry panel.

Radiology’s experience points to one lesson above the others: requirements beyond what safety demands limit access, growth and innovation. The technology moves fast. A tool that is only somewhat useful today may improve access and care tomorrow, but only if it is allowed into the real world to prove itself. Too often we lead with product safety at the expense of innovation. Safety matters, but for tools that a clinician reviews before acting, and that do not run autonomously or change what the clinician can see in the underlying study, the responsibility should rest with the practices that use them, not with a premarket review modeled on drugs.

Why radiology went first

Radiology had the conditions that made AI buildable: images that were already digital, a common file standard and systems that route each study to the physician who interprets it. The authorization data describe this pattern; they do not establish its cause, and they measure authorizations, not adoption or patient benefit. The FDA also notes that its list is not comprehensive.

The data also show who brings these products to market. Of 740 companies, 502 (67.8 percent) had a single authorized device, while 13 companies accounted for 17.3 percent of devices. Many are single-product innovators building one software tool or one AI-enabled imaging device. Requirements that a multinational corporation absorbs easily often cannot be absorbed by them, and good ideas do not come only from incumbents.

Physicians are the real-world test

This is the point I most want regulators to hear. Reviewing an AI tool like a drug misreads who uses it. Drugs are consumed by patients, who may never report back. AI tools used in clinical practice are consumed by physicians, who notice quickly when a tool does not help and stop using it. I have watched FDA-cleared products abandoned within weeks because they were not useful in practice. Developers and their founders have their reputations at stake, and clinicians already monitor new products during rollout, authorized or not. Poor performers are noticed and dropped.

Congress has already accepted this logic once. The 21st Century Cures Act removed from FDA device oversight clinical decision-support software whose basis a clinician can independently review. The same reasoning should extend to computer-aided detection that a physician reviews and can override. A radiologist who sees a flag and disagrees with it should be free to override it, and should not be held to the high sensitivity, and sometimes low specificity, of a detection model. The standard of care should remain what other radiologists, or the clinicians who first see a scan, such as emergency physicians, would do, not what an overly sensitive algorithm flagged. The comparison is starker still because most studies in urgent care and emergency departments are first read by nonradiologists, and many outpatient scans wait days for a routine read.

Continue reading…