Key Takeaways
- OpenAI, Anthropic and Google are collaborating to create an AI standards body.
- The initiative follows calls for self-regulation to ensure AI safety.
- Concerns over AI risks have escalated, with some workers warning of potential dangers.
Leading artificial intelligence companies, including OpenAI, Anthropic and Google, are joining forces to establish a standards body, according to a statement from OpenAI. This move comes amid growing concerns about the potential dangers of AI and the need for a safer version of the technology.
The idea for the standards body originated from a proposal by Google DeepMind’s Demis Hassabis, who suggested a self-regulatory body similar to the Financial Industry Regulatory Authority. Hassabis called for the creation of an organisation in the United States that would test the most powerful AI systems before public release.
However, not all in the AI industry are in agreement. Aiden Gomez, co-founder and CEO of Canadian AI company Cohere, accused dominant American AI labs of forming a 'cartel' under the guise of safety. He stated, 'AI needs guardrails. That is not the dispute and never has been. The dispute is over who writes them, who gets to participate and whose interests the rules are protecting.'
Concerns about AI safety have intensified in recent weeks. Two workers from major AI developers have resigned due to safety concerns. Jacob Coxon, who previously worked at OpenAI and Anthropic, warned that AI companies were 'gambling with our lives.'
Bilal Chughtai, a former Google DeepMind researcher, echoed Coxon's concerns, stating, 'I earnestly believe that AI has the potential to kill us all, and that we might be running out of time to avoid this outcome.'
In a related development, Anthropic CEO Dario Amodei called for a slowdown in the pace of AI development. This sentiment was echoed by OpenAI CEO Sam Altman and Demis Hassabis.
Despite the growing concerns, not all are in agreement. US President Donald Trump dismissed warnings about AI risks as 'hoaxes.' Nvidia CEO Jensen Huang also pushed back, stating, 'The confluence of these words and then the prediction is alarming and troubling and it shouldn’t be done. It’s irresponsible.'
The initiative to create an AI standards body is seen as a step towards ensuring the safety and ethical use of AI technology. However, the debate over who should write the rules and who should participate remains contentious.
AI needs guardrails. That is not the dispute and never has been. The dispute is over who writes them, who gets to participate and whose interests the rules are protecting.
Aiden Gomez, Co-founder and CEO of Cohere
I earnestly believe that AI has the potential to kill us all, and that we might be running out of time to avoid this outcome.
Bilal Chughtai, Former Google DeepMind researcher
