By MIKE MAGEE
Last month, Dario Amodei, CEO of Anthropic, did it again – scaring the bejesus out of societal leaders worldwide with warnings that their grip on security and governance of human populations is dangerously close to AI extinction.
Amodei’s opening paragraph in his article titled “The Adolescence of Technology” wastes no time getting the reader’s attention. He writes, “There is a scene in the movie version of Carl Sagan’s book Contact where the main character, an astronomer who has detected the first radio signal from an alien civilization, is being considered for the role of humanity’s representative to meet the aliens. The international panel interviewing her asks, ‘If you could ask [the aliens] just one question, what would it be?’ Her reply is: ‘I’d ask them, How did you do it? How did you evolve, how did you survive this technological adolescence without destroying yourself?’”
Now, I should be clear. I was already nervous. As a Medical Historian, preparing for a major lecture on the birth of Immunology this Spring, I’ve been researching the field. What am I looking for? The same thing I always find missing when exploring the frontiers of scientific progress – historical context. In most cases, facts and figures abound, but their impact on the complex web of human relations over the years is often missing.
Amodei is attempting to provide that context in real time. Real times include headlines like this one from the New York Times: “ICE Already Know Who Protesters Are “ from AI powered facial recognition technology . But Amodei’s concerns are more fundamental. The challenge for him is the speed of change with generative AI which he clearly states is alarming. As he says, “Because AI is now writing much of the code at Anthropic, it is already substantially accelerating the rate of our progress in building the next generation of AI systems. This feedback loop is gathering steam month by month, and may be only 1–2 years away from a point where the current generation of AI autonomously builds the next.”
Clearly with Musk’s recent DOGE foray in mind, Amodei lays out a pretty plausible modern day vulnerability. He says, “It is somewhat awkward to say this as the CEO of an AI company, but I think the next tier of risk is actually AI companies themselves. AI companies control large datacenters, train frontier models, have the greatest expertise on how to use those models, and in some cases have daily contact with and the possibility of influence over tens or hundreds of millions of users.”
Getting a bit more specific without outright naming Musk-controlled Grok and X, Amodei leaves little doubt who he’s referring to when he says, “Some AI companies have shown a disturbing negligence towards the sexualization of children in today’s models, which makes me doubt that they’ll show either the inclination or the ability to address autonomy risks in future models.”
At one point during the ICE offenses last month, a legal observer in Portland, Maine, filming an ICE agent, was approached by the agent who had just filmed her car and was now filming her face. Asking why he was doing that, the ICE agent replied, “Cuz we have a nice little database and now you’re considered a domestic terrorist. So have fun with that.”
The activities of the past month, and the unprovoked murders of two innocent US citizens make Amodei’s final warning prescient. He says, “Current autocracies are limited in how repressive they can be by the need to have humans carry out their orders, and humans often have limits in how inhumane they are willing to be. But AI-enabled autocracies would not have such limits.”
Mike Magee MD is a Medical Historian and regular contributor to THCB. He is the author of CODE BLUE: Inside America’s Medical Industrial Complex. (Grove/2020)
