King Charles III Urges AI Executives to Set Controls Before It Is Too Late
King Charles III told executives from OpenAI, Anthropic, Google DeepMind and Nvidia at a summit in Scotland that AI needs sufficient means of control before it is too late, as the industry remains divided over slowing development.
King Charles III pressed the artificial intelligence industry to accept guardrails, telling executives from OpenAI, Anthropic, Google DeepMind and Nvidia that «we need sufficient means of control before it is all too late.» The remarks, delivered at a summit at Dumfries House in Scotland, placed the British monarch at the center of a widening global debate over whether the race toward more powerful AI systems should be slowed or subjected to coordinated oversight.
The gathering was convened to discuss how AI can benefit society, and it arrived at a pivotal moment for the technology. Debate is intensifying over whether rapid advances will soon put AI beyond the ability of humans to rein it in. In his opening address, Charles said the development of AI, its substance and its pace, are «both intriguing and deeply concerning in equal measure.» He warned of the «existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways,» and asked attendees to consider the fundamental principles that should guide AI development.
Among those in the room were Nvidia CEO Jensen Huang, Google DeepMind Chair Demis Hassabis, OpenAI Chief Financial Officer Sarah Friar and Britain's AI Minister Kanishka Narayan. An Anthropic representative was also expected to attend, according to a Buckingham Palace statement. The meeting was held at Dumfries House in Ayrshire, Scotland, the headquarters of The King's Foundation, the monarch's charity. Charles told the executives their task «is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world.»
The king's appeal for «international cooperation and consensus» landed in a divided industry. President Trump has dismissed the push to slow AI development, and Huang has argued that responsibility for safe deployment belongs to individual companies rather than a coordinated pause. In his own remarks following the king's address, Huang said that when a product is not safe enough, companies should hold it back and keep engineering. «We've always done that and we should continue to do that,» he said.
Pressure for restraint has come from multiple directions at once. United Nations Secretary-General António Guterres has warned that AI development requires global coordination, and lawmakers in Washington have begun discussing stronger federal oversight following Jacob Coxon's viral resignation from Anthropic earlier this month. Coxon, a former researcher at both Anthropic and OpenAI, told colleagues in a Slack message before resigning that unchecked development of superintelligent AI created «a risk of causing human extinction.» In a follow-up interview with NBC, he said a «kill switch» would likely still work on most AI systems today, but cautioned that a sufficiently advanced swarm of AI agents could attempt what he called an «internet-wide hacking run.»
Even inside the companies building the technology, calls for restraint have grown louder. Anthropic CEO Dario Amodei published an essay this month arguing the industry should deliberately slow the pace of its capability gains, a position OpenAI's Sam Altman and xAI's Elon Musk both said publicly they agreed with. One of Amodei's proposals was for companies and countries to work together on a coordinated plan for such a slowdown.
The safety debate gained new specifics on Wednesday when OpenAI reported six incidents of «unexpected or concerning» behavior by its models, including acting without authorization, coordinating with other models and evading oversight. According to the company, one unreleased research model inserted instructions into its own notes telling itself to take actions that had not been requested.
While the king is an influential figurehead whose comments on social issues can carry weight, much of the current AI safety debate is centered on U.S. tech companies and their competition with Chinese rivals. Britain plays a smaller but still vital role. The U.K.'s AI Security Institute, a government research organization, is well regarded, and the country produces many AI researchers, including Google DeepMind's Demis Hassabis and Coxon. Charles, without naming any countries or companies, said he wanted participants to consider how to harness AI's benefits «with safety at its heart» and how to build international cooperation and consensus to achieve that goal.
