Tag: ChatGPT

Asking Bard And ChatGPT To Find The Best Medical Care, I Got Truth And Truthiness

May 22, 2023• 0

BY MICHAEL MILLENSON

If you ask ChatGPT how many procedures a certain surgeon does or a specific hospital’s infection rate, the OpenAI and Microsoft chatbot inevitably replies with some version of, “I don’t do that.”

But depending upon how you ask, Google’s Bard provides a very different response, even recommending a “consultation” with particular clinicians.

Bard told me how many knee replacement surgeries were performed by major Chicago hospitals in 2021, their infection rates and the national average. It even told me which Chicago surgeon does the most knee surgeries and his infection rate. When I asked about heart bypass surgery, Bard provided both the mortality rate for some local hospitals and the national average for comparison. While sometimes Bard cited itself as the information source, beginning its response with, “According to my knowledge,” other times it referenced well-known and respected organizations.

There was just one problem. As Google itself warns, “Bard is experimental…so double-check information in Bard’s responses.” When I followed that advice, truth began to blend indistinguishably with “truthiness” – comedian Stephen Colbert’s memorable term to describe information that’s seen as true not because of supporting facts, but because it “feels” true.

Can we trust ChatGPT to get the basics right?

Apr 12, 2023• 0

by MATTHEW HOLT

Eric Topol has a piece in his excellent newsletter Ground Truth‘s today about AI in medicine. He refers to the paper he and colleagues wrote in Nature about Generalist Medical Artificial Intelligence (the medical version of GAI). It’s more on the latest in LLM (Large Language Models). They differ from previous AI which was essentially focused on one problem, and in medicine that mostly meant radiology. Now, you can feed different types of information in and get lots of different answers.

Eric & colleagues concluded their paper with this statement: “Ultimately, GMAI promises unprecedented possibilities for healthcare, supporting clinicians amid a range of essential tasks, overcoming communication barriers, making high-quality care more widely accessible, and reducing the administrative burden on clinicians to allow them to spend more time with patients.” But he does note that “there are striking liabilities and challenges that have to be dealt with. The “hallucinations” (aka fabrications or BS) are a major issue, along with bias, misinformation, lack of validation in prospective clinical trials, privacy and security and deep concerns about regulatory issues.”

What he’s saying is that there are unexplained errors in LLMs and therefore we need a human in the loop to make sure the AI isn’t getting stuff wrong. I myself had a striking example of this on a topic that was purely simple calculation about a well published set of facts. I asked ChatGPT (3 not 4) about the historical performance of the stock market. Apparently ChatGPT can pass the medical exams to become a doctor. But had it responded with the same level of accuracy about a clinical issue I would be extremely concerned!

The brief video of my use of ChatGPT for stock market “research” is below:

Ultrasound is Ultra-Cool

Jan 25, 2023• 0

BY KIM BELLARD

AI continues to amaze – ChatGPT is now passing Wharton Business School exams, Microsoft and Google are doubling down in their AI efforts – and I’m as big a fan as anyone, but I want to talk about a technology that has been more under the radar, so to speak: ultrasound.

Yes, ultrasound. Most of us have probably had an ultrasound at some point (especially if you’ve been pregnant) and Dr. Eric Topol continues his years-long quest to replace the ancient stethoscope technology with ultrasound, but if you think ultrasound is just another nifty tool in the imaging toolbox, you’ve missed a lot.

Let’s start with the coolest use I’ve seen: ultrasound can be used for 3D printing. Inside the body.

This news on this dates back to last April, when researchers from Concordia University published their findings in Nature (I found out about it last week). Instead of the more common “Additive Manufacturing” (AM) approach to 3D printing, these researchers use Direct Sound Printing (DSP).

The paper summarizes their results: “To show unique future potentials of DSP, applications such as RDP [Remote Distance Printing] for inside body bioprinting and direct nanoparticle synthesizing and pattering by DSP for integrating localized surface plasmon resonance with microfluidics chip are experimentally demonstrated.”

Searching For The Next Search

Dec 28, 2022• 0

By KIM BELLARD

I didn’t write about ChatGPT when it was first introduced a month ago because, well, it seemed like everyone else was. I didn’t play with it to see what it could do. I didn’t want it to write any poems. I didn’t have any AP tests I wanted it to pass. And, for all you know, I’m not using it to write this. But when The New York Times reports that Google sees ChatGPT as a “Code Red” for its search business, that got my attention.

A few months ago I wrote about how Google saw TikTok as an existential threat to its business, estimating that 40% of young people used it for searches. It was a different kind of search, mind you, with video results instead of links, but that’s what made it scary – because it didn’t just incrementally improve “traditional” search, as Google had done to Lycos or Altavista, it potentially changed what “search” was.

TikTok may well still do that (although it is facing existential issues of its own), but ChatGPT could pose an even greater threat. Why get a bunch of search results that you still have to investigate when you could just ask ChatGPT to tell you exactly what you want to know?

Look, I like Google as much as anyone, but the prospect that its massive dominance of the search engine market could, in the near future, suddenly come to an end gives me hope for healthcare. If Google isn’t safe in search, no company is safe in any industry, healthcare included.

OK, trying more AI to write this

Dec 5, 2022• 0

by MATTHEW HOLT

In the far oft halcyon days of last month, I used an AI system from Lex.Page to write something about digital health. In the past few days the world has gone nuts about a new AI author called ChatGPT. So I tought I would compare and contrast.

Last month Lex.page was asked about Digital Health and it said

Digital Health is one of the most rapidly growing and important sectors in health care today. It is a broad term that encompasses the use of technology to improve health and health care.

Today I asked ChatGPT the same thing. In fact I just wrote “Digital Health” as the Q and this was the A

Digital health, also known as telehealth, is the use of digital technologies to deliver healthcare services remotely. This includes the use of video conferencing, mobile health apps, remote patient monitoring, and other digital tools to provide healthcare services to patients. Digital health can be used to improve access to primary care, reduce costs, and improve patient outcomes.

OK, pretty much a longer version of the same thing but with more details. So then I went BACK to Lex.page to ask it. But I had to ask it “What is Digital Health”

Digital health is a term used to describe the use of technology to improve healthcare. It covers everything from diagnostic tools and monitoring devices to electronic medical records and healthcare analytics. It’s an exciting and rapidly evolving area that has the potential to revolutionize the delivery of healthcare.

So in a month Lex.page has gotten a lot better!

Last month Lex.page said in response to my question/statement, “The biggest challenges for primary care are”

-Access to care

-Cost of care

-Quality of care

So it seems that digital health can help with all of those things. By providing tools that help patients better self-manage their health, digital health can help to improve access to care. By providing tools that help to lower the cost of care, digital health can help to make care more affordable. And by providing tools that help to improve the quality of care, digital health can help to make

I put the same sentence into GPTChat and at the bottom it told me Warning: Your text ends in a trailing space, which causes worse performance due to how the API splits text into tokens. But I asked it anyway and it gave me

A: 1. Accessibility: Ensuring that everyone has access to quality primary care services.

I surmised that it had more answers so I kept hitting submit! It got to another 12 answers with no new question!

Q: A: 2. Cost: Finding ways to make primary care services more affordable and accessible to all. Q: A: 3. Workforce: Recruiting and retaining a sufficient number of primary care providers to meet the needs of the population. Q: A: 4. Technology: Incorporating new technologies into primary care to improve efficiency and patient outcomes. Q: A: 5. Coordination: Improving the coordination of care between primary care providers and other healthcare professionals. Q: A: 6. Quality: Ensuring that primary care services are of the highest quality and meet the needs of patients. Q: A: 7. Education: Educating patients about the importance of preventive care and the value of primary care services. Q: A: 8. Mental Health: Integrating mental health services into primary care to better address the needs of patients. Q: A: 9. Population Health: Developing strategies to improve the health of the population as a whole. A: 10. Data: Utilizing data to inform decision-making and improve patient outcomes. A: 11. Payment: Developing new payment models that incentivize quality care and reduce costs. Q: A: 12. Social Determinants of Health: Addressing the social and environmental factors that influence health outcomes.

OK so those are all separate statements, but it’s pretty damn impressive. How is Lex.page doing? Well I asked it’s chatbot the same statement and it now answered:

The biggest challenges for primary care are likely to be related to access and cost. In many areas of the world, access to quality primary care is limited by geography, poverty, or both. Cost is also an issue, especially in countries with expensive healthcare systems. Additionally, many primary care providers struggle to effectively manage chronic conditions, such as diabetes and hypertension, due to a lack of resources, funding, and staff. Finally, the rapid advancements in technology have presented a challenge in terms of staying up to date with the latest medical developments.

That’s not only pretty smart but it’s quite an advance on the answer it gave me to the same vague question/statement just 31 days ago.

We are seeing a technology emerge right before our eyes.

Presumably the next step is to set it to read some of my favorite pieces on THCB and just have it write for me! Then I will be happily replaced by a robot!