Categories

Tag: AI

Can Generative AI Improve Health Care Relationships?

By MIKE MAGEE

“What exactly does it mean to augment clinical judgement…?”

That’s the question that Stanford Law professor, Michelle Mello, asked in the second paragraph of a May, 2023 article in JAMA exploring the medical legal boundaries of large language model (LLM) generative AI.

This cogent question triggered unease among the nation’s academic and clinical medical leaders who live in constant fear of being financially (and more important, psychically) assaulted for harming patients who have entrusted themselves to their care.

That prescient article came out just one month before news leaked about a revolutionary new generative AI offering from Google called Genesis. And that lit a fire.

Mark Minevich, a “highly regarded and trusted Digital Cognitive Strategist,” writing in a December issue of  Forbes, was knee deep in the issue writing, “Hailed as a potential game-changer across industries, Gemini combines data types like never before to unlock new possibilities in machine learning… Its multimodal nature builds on, yet goes far beyond, predecessors like GPT-3.5 and GPT-4 in its ability to understand our complex world dynamically.”

Health professionals have been negotiating this space (information exchange with their patients) for roughly a half century now. Health consumerism emerged as a force in the late seventies. Within a decade, the patient-physician relationship was rapidly evolving, not just in the United States, but across most democratic societies.

That previous “doctor says – patient does” relationship moved rapidly toward a mutual partnership fueled by health information empowerment. The best patient was now an educated patient. Paternalism must give way to partnership. Teams over individuals, and mutual decision making. Emancipation led to empowerment, which meant information engagement.

In the early days of information exchange, patients literally would appear with clippings from magazines and newspapers (and occasionally the National Inquirer) and present them to their doctors with the open ended question, “What do you think of this?”

But by 2006, when I presented a mega trend analysis to the AMA President’s Forum, the transformative power of the Internet, a globally distributed information system with extraordinary reach and penetration armed now with the capacity to encourage and facilitate personalized research, was fully evident.

Coincident with these new emerging technologies, long hospital length of stays (and with them in-house specialty consults with chart summary reports) were now infrequently-used methods of medical staff continuous education. Instead, “reputable clinical practice guidelines represented evidence-based practice” and these were incorporated into a vast array of “physician-assist” products making smart phones indispensable to the day-to-day provision of care.

At the same time, a several decade struggle to define policy around patient privacy and fund the development of medical records ensued, eventually spawning bureaucratic HIPPA regulations in its wake.

The emergence of generative AI, and new products like Genesis, whose endpoints are remarkably unclear and disputed even among the specialized coding engineers who are unleashing the force, have created a reality where (at best) health professionals are struggling just to keep up with their most motivated (and often mostly complexly ill) patients. Needless to say, the Covid based health crisis and human isolation it provoked, have only made matters worse.

Continue reading…

AI Inside

by KIM BELLARD

Well: 2024. I’m excited about the Paris Olympics, but otherwise I’d be just as happy to sleep through all the nonsense that the November elections will bring. In any event, I might as well start out talking about one of the hottest topics of 2023 that will get even more so in 2024: AI.

In particular, I want to look at what is being billed as the “AI PC.” 

Most of us have come to know about ChatGPT. Google has Bard (plus DeepMind’s Gemini), Microsoft is building AI into Bing and its other products, Meta released an open source AI, and Apple is building its AI framework. There is a plethora of others. You probably have used “AI assistants” like Alexa or Siri.

What most of the large language model (LLM) versions of AI have in common is that they are cloud-based. What AI PCs offer to do is to take AI down to your own hardware, not dissimilar to how PCs took mainframe computing down to your desktop.  

As The Wall Street Journal tech gurus write in their 2024 predictions in their 2024 predictions:

In 2024, every major manufacturer is aiming to give you access to AI on your devices, quickly and easily, even when they’re not connected to the internet, which current technology requires. Welcome to the age of the AI PC. (And, yes, the AI Mac.)

Continue reading…

2024 Prediction: Society Will Arrive at an Inflection Point in AI Advancement

By MIKE MAGEE

For my parents, March, 1965 was a banner month. First, that was the month that NASA launched the Gemini program, unleashing “transformative capabilities and cutting-edge technologies that paved the way for not only Apollo, but the achievements of the space shuttle, building the International Space Station and setting the stage for human exploration of Mars.” It also was the last month that either of them took a puff of their favored cigarette brand – L&M’s.

They are long gone, but the words “Gemini” and the L’s and the M’s have taken on new meaning and relevance now six decades later.

The name Gemini reemerged with great fanfare on December 6, 2023, when Google chair, Sundar Pichai, introduced “Gemini: our largest and most capable AI model.” Embedded in the announcement were the L’s and the M’s as we see here: “From natural image, audio and video understanding to mathematical reasoning, Gemini’s performance exceeds current state-of-the-art results on 30 of the 32 widely-used academic benchmarks used in large language model (LLM) research and development.

Google’s announcement also offered a head to head comparison with GPT-4 (Generative Pretrained Transformer-4.) It is the product of a non-profit initiative, and was released on March 14, 2023. Microsoft’s helpful AI search engine, Bing, helpfully informs that, “OpenAI is a research organization that aims to create artificial general intelligence (AGI) that can benefit all of humanity…They have created models such as Generative Pretrained Transformers (GPT) which can understand and generate text or code, and DALL-E, which can generate and edit images given a text description.”

While “Bing” goes all the way back to a Steve Ballmer announcement on May 28, 2009, it was 14 years into the future, on February 7, 2023, that the company announced a major overhaul that, 1 month later, would allow Microsoft to broadcast that Bing (by leveraging an agreement with OpenAI) now had more than 100 million users.

Which brings us back to the other LLM (large language model) – GPT-4, which the Gemini announcement explores in a head-to-head comparison with its’ new offering. Google embraces text, image, video, and audio comparisons, and declares Gemini superior to GPT-4.

Mark Minevich, a “highly regarded and trusted Digital Cognitive Strategist,” writing this month in Forbes, seems to agree with this, writing, “Google rocked the technology world with the unveiling of Gemini – an artificial intelligence system representing their most significant leap in AI capabilities. Hailed as a potential game-changer across industries, Gemini combines data types like never before to unlock new possibilities in machine learning… Its multimodal nature builds on yet goes far beyond predecessors like GPT-3.5 and GPT-4 in its ability to understand our complex world dynamically.”

Expect to hear the word “multimodality” repeatedly in 2024 and with emphasis.

Continue reading…

AI Could Have “Unimaginable Consequences” For Democratic Societies, Says Expert.

By MIKE MAGEE

His biography states, “He speaks to philosophical questions about the fears and possibilities of new technology and how we can be empowered to shape our future. His work to bridge cultures spans artificial intelligence, cognition, language, music, creativity, ethics, society, and policy.”

He embraces the title “cross-disciplinary,” and yet his PhD thesis at UC Berkeley in 1980 “was one of the first to spur the paradigm shift toward machine learning based natural language processing technologies.” Credited with inventing and building “the world’s first global-scale online language translator that spawned Google Translate, Yahoo Translate, and Microsoft Bing Translator,” he is clearly a “connector” in a world currently consumed by “dividers.” In 2019, Google named De Kai as “one of eight inaugural members of its AI Ethics Council.”

The all encompassing challenge of our day, as he sees it, is relating to each other. As he says, “The biggest fear is fear itself – the way AI amplifies human fear exponentially…turning us upon ourselves through AI powered social media driving misinformation, divisiveness, polarization, hatred and paranoia.” The value system he embraces “stems from a liberal arts perspective emphasizing creativity in both technical and humanistic dimensions.”

Dr. De Kai is feeling especially urgent these days, which is a bit out of character.

Continue reading…

Where is AI in Medicine Going? Ask The Onion.

By MIKE MAGEE

One of the top ten headlines of all time created by the satirical geniuses at The Onion was published 25 years ago this December. It read, “God Answers Prayers Of Paralyzed Little Boy. ‘No,’ Says God.”

The first paragraph of that column introduced us to Timmy Yu, an optimistic 7-year old, who despite the failures of the health system had held on to his “precious dream.” As the article explained, “From the bottom of his heart, he has hoped against hope that God would someday hear his prayer to walk again. Though many thought Timmy’s heavenly plea would never be answered, his dream finally came true Monday, when the Lord personally responded to the wheelchair-bound boy’s prayer with a resounding no.”

But with a faith that rivals the chieftains of today’s American health care system who continue to insist this is “the best health care in the world,” this Timmy remained undeterred. As The Onion recorded the imagined conversation, “‘I knew that if I just prayed hard enough, God would hear me,’ said the joyful Timmy,., as he sat in the wheelchair to which he will be confined for the rest of his life. ‘And now my prayer has been answered. I haven’t been this happy since before the accident, when I could walk and play with the other children like a normal boy.’”

According to the article, the child did mildly protest the decision, but God held the line, suggesting other alternatives. “God strongly suggested that Timmy consider praying to one of the other intercessionary agents of Divine power, like Jesus, Mary or maybe even a top saint,” Timmy’s personal physician, Dr. William Luttrell, said. ‘The Lord stressed to Timmy that it was a long shot, but He said he might have better luck with one of them.’”

It didn’t take a wild leap of faith to be thrust back into the present this week. Transported by a headline to Rochester, Minnesota, the banner read, “Mayo Clinic to spend $5 billion on tech-heavy redesign of its Minnesota campus.” The “reinvention” is intended to “to present a 21st-century vision of clinical care” robust enough to fill 2.4 million square feet of space.

The Mayo Clinic’s faith in this vision is apparently as strong as little “Timmy’s”, and their “God” goes by the initials AI.

Continue reading…

Pin Me, Please

By KIM BELLARD

You had to know I’d write about the new Humane AI Pin, right?

After all, I’d been pleading for the next big thing to take the place of the smartphone, as recently as last month and as long ago as six years, so when a start-up like Humane suggests it is going to do just that, it has my attention.  Even more intriguing, it is billed as an AI device, redefining “how we interact with AI.”  It’s like catnip for me.

For anyone who has missed the hype – and there has been a lot of hype, for several months now – Humane is a Silicon Valley start-up founded by two former Apple employees, Imran Chaudhri and Bethany Bongiorno (who are married).  They left Apple in 2016, had the idea for the AI Pin by 2018, and are ready to launch the actual device early next year.  It is intended to be worn as a pin on the lapel, starts at $699, and requires a monthly $24 subscription (which includes wireless connectivity).  Orders start November 16.

Partners include OpenAI, Microsoft, T-Mobile, Tidal, and Qualcomm.

Mr. Chaudhri told The New York Times that artificial intelligence  “can create an experience that allows the computer to essentially take a back seat.” He also told TechCrunch that the AI Pin represented “a new way of thinking, a new sense of opportunity,” and that it would “productize AI” (hmm, what are all those other people in AI doing?).  

Humane’s press release elaborates:

Ai Pin redefines how we interact with AI. Speak to it naturally, use the intuitive touchpad, hold up objects, use gestures, or interact via the pioneering Laser Ink Display projected onto your palm. The unique, screenless user interface is designed to blend into the background, while bringing the power of AI to you in multi-modal and seamless ways.

Basically, you wear a pin that is connected with an AI, which – upon request – will listen and respond to your requests. It can respond verbally, or it can project a laser display into the palm of your hand, which you can control with a variety of gestures that I am probably too old to learn but which younger people will no doubt pick up quickly.  It can take photos or videos, which the laser display apparently does not, at this point, do a great job projecting. 

Here’s Humane’s introductory video:

Some cool features worth noting:

  • It can summarize your messages/emails;
  • It can make phone calls or send messages;
  • It can search the web for you to answer questions/find information;
  • It can act as a translator;
  • It has trust features that include not always listening and a “Trust Light” that indicates when it is.
Continue reading…

Interview with Infermedica CEO, Piotr Orzechowski

At the HLTH conference I talked with CEO of Infermedica, Piotr Orzechowski, and also had a quick word with VP of Marketing Marcus Gordon. Infermedica has been around over a decade, and has been a slow burner in the symptom checker and patient digital front door market. But now it has a lot of clients and deals and its API is hiding behind several big names including Optum & Microsoft. Piotr graciously let me butcher his name, and still told me about how their model works and how LLMs will change it.–Matthew Holt

There Needs to Be an “AI” in “Med Ed”

By KIM BELLARD

It took some time for the news to percolate to me, but last month the University of Texas San Antonio announced that it was creating the “nation’s first dual program in medicine and AI.” That sure sounds innovative and timely, and there’s no question that medical education, like everything else in our society, is going to have to figure out how to incorporate AI. But, I’m sorry to say, I fear UTSA is going about it in the wrong way.

UTSA has created a five year program that will result in graduates obtaining an M.D. from UT Health San Antonio and a Master of Science in Artificial Intelligence (M.S.A.I.) from UTSA. Students will take a “gap year” between the third and fourth year of medical school to get the M.S.A.I. They will take two semesters in AI coursework, completing a total of 30 credit hours: nine credit hours in core courses including an internship, 15 credit hours in their degree concentration (Data Analytics, Computer Science, or Intelligent & Autonomous Systems) and six credit hours devoted to a capstone project.

“This unique partnership promises to offer groundbreaking innovation that will lead to new therapies and treatments to improve health and quality of life,” said UT System Chancellor James B. Milliken.

“Our goal is to prepare our students for the next generation of health care advances by providing comprehensive training in applied artificial intelligence,” said Ronald Rodriguez, M.D., Ph.D., director of the M.D./M.S. in AI program and professor of medical education at the University of Texas Health Science Center at San Antonio. “Through a combined curriculum of medicine and AI, our graduates will be armed with innovative training as they become future leaders in research, education, academia, industry and health care administration. They will be shaping the future of health care for all.”

Dhireesha Kudithipudi, a professor in electrical and computer engineering who was tasked with helping develop the university’s AI curriculum, told Preston Fore of Fortune:

In lots of scenarios, you might see AI capabilities are being very exaggerated—that it might replace physicians and so forth. But I think our line of inquiry was guided in a different way, in a sense how we can promote this AI physician interaction-AI patient interaction, bringing humans to the center of the loop, and how AI can enhance care or emphasize more patient centric attention.

OK, fabulous.  But, you know, computers have been integral to healthcare for decades, especially the past 15 years (due to EMRs), and we don’t expect doctors to get Masters in Computer Science. We’re just happy when they can figure out how to navigate the interfaces. 

To be honest, I was expecting more from UT.

Continue reading…

Nabla CoPilot– the new ambient EMR note taker that snagged Permanente

I got up super early on a Sunday (in Vegas no less!) to meet Delphine Groll, COO and Alexandre Lebrun, CEO of Nabla. I have heard directly from doctors a lot about their CoPilot product being adopted as a less expensive version than Nuance or Abridge, and wanted to see what the fuss was about. They gave me a demo of their ambient AI medical note taker and it is very impressive–you’ll see a little bit of my demo and the resulting note in the interview. They were a little shy on Sunday to tell me about their relationship with the Permanente group but between Jay Parkinson and Fierce Healthcare, the beans are well and truly spilled now, and they are apparently soon to be available in every Permanente region. I suspect because of that the integration with Epic that Alexandre mentioned will be full speed ahead!–Matthew Holt

Altman, Ive, and AI

BY KIM BELLARD

Earlier this year I urged that we Throw Away That Phone, arguing that the era of the smartphone should be over and that we should get on to the next big thing.  Now, I don’t have any reason to think that either Sam Altman, CEO of OpenAI, and Jony Ive, formerly and famously of Apple and now head of design firm LoveFrom, read my article but apparently they have the same idea.  

Last week The Information and then Financial Times reported that OpenAi and LoveFrom are “in advanced talks” to form a venture in order to build the “iPhone of artificial intelligence.”  Softbank may fund the venture with as much as $1b.  There have been brainstorming sessions, and discussions are said to be “serious,” but a final deal may still be months away. The new venture would draw on talent from all three firms.

Details are scare, as are comments from any of the three firms, but FT cites sources who suggest Mr. Altman sees “an opportunity to create a way of interacting with computers that is less reliant on screens.” which is a sentiment I heartily agree with.  The Verge similarly had three sources who agreed that the goal is a “more natural and intuitive user experience.”

Continue reading…
assetto corsa mods