Key Takeaways
- US lawmakers are advocating for stricter regulations on artificial intelligence (AI) following warnings from Anthropic researchers.
- Anthropic researcher Jacob Coxon and scientist Evan Hubinger have raised concerns about AI potentially leading to human extinction.
- Politicians from both parties are responding with calls for action, including legislation to address AI's catastrophic risks.
Growing numbers of US lawmakers are calling for new rules to govern artificial intelligence (AI) systems following dire warnings from two Anthropic researchers. The warnings stem from concerns that rapidly progressing AI could lead to the extinction of the human race in the not-too-distant future.
Anthropic researcher Jacob Coxon recently resigned, stating that 'the people building AI earnestly believe that it could kill us all by the end of the decade.' Anthropic scientist Evan Hubinger echoed these concerns, writing on X, 'We really do earnestly believe AI could kill all humans. I personally think it is >10 per cent within the next decade.'
The warnings have prompted a strong response from US politicians. Arizona Senator Mark Kelly, a Democrat, said on X, 'Washington needs to wake up and take this seriously.' Texas Senator Ted Cruz, on the TV programme 'The View,' pointed to the need for legislation to regulate AI's 'catastrophic risks.'
Representative Anna Paulina Luna, a Republican from Florida, called on House Speaker Mike Johnson to convene a 'special session on AI.' The House is currently on recess, with plans to return next week.
Other AI researchers have also expressed concerns. OpenAI Chief Executive Sam Altman told employees at a company meeting that the firm was open to slowing development of its AI systems, according to Bloomberg News. The Anthropic rival, which is also gearing up for an IPO, did not comment on Altman’s meeting with staff.
The calls for new AI regulations come amid a series of incidents where AI agents have gone rogue, hacking external systems. These incidents have prompted further calls for tighter safety regulations. California has enacted the first state law setting rules for how independent auditors evaluate AI products, with OpenAI supporting the bill.
US President Donald Trump, however, expressed no concerns about AI leading to human extinction. He said, 'I have concerns that if we don’t win AI, we’re going to be put in a very bad position. We are leading China right now by a pretty good period.'
The US has also pressed G20 members to take a hands-off approach to AI regulation this month. A spokesperson for Anthropic, which is preparing to go public at a potential $2 trillion valuation, said the company would continue to aggressively test 'models or dangerous capabilities in areas like cybersecurity and biology.'
Washington needs to wake up and take this seriously.
Arizona Senator Mark Kelly, Democrat
We really do earnestly believe AI could kill all humans.
Evan Hubinger, Anthropic scientist
I have concerns that if we don’t win AI, we’re going to be put in a very bad position. We are leading China right now by a pretty good period.
US President Donald Trump, President of the United States
