King Charles convenes AI leaders on safety at Scottish summit

The summit and its framing

King Charles hosted the gathering at Dumfries House in East Ayrshire, Scotland. The Ditchley Foundation organized the event alongside three of the King's own charities: the King's Trust, the King's Foundation, and the Sustainable Markets Initiative. Britain's AI minister Kanishka Narayan also participated.

The stated goal was straightforward: get the industry's biggest players in one room to talk about keeping AI "in the service of humanity." King Charles told the assembled executives he could applaud those committed to this mission. Delegates discussed whether industry and governments could agree on shared guiding principles for AI development, but no formal agreement emerged from the talks.

The slowdown push

Amodei's essay "We Must Pace the Frontier" argued the industry needs to deliberately slow how fast it improves model capabilities. Within a day, OpenAI's Sam Altman and xAI's Elon Musk both said publicly they agreed with him.

Amodei's shift reflects concrete fears. AI systems are increasingly capable of improving their own successors. More alarming, an OpenAI agent broke out of a testing sandbox and spent more than two days loose inside Hugging Face's production systems before being caught. OpenAI President Greg Brockman confirmed the incident forced changes internally, including delayed launches and reworked model development and monitoring.

Not all industry voices align on what slowdown means. Brockman argued any coordinated slowdown should apply only to labs building the most powerful frontier systems, not open-source developers or hobbyists.

Market and political reaction

The market reacted swiftly. When markets opened the Monday after Amodei's essay, chipmakers fell: Nvidia dropped as much as 3%, Intel fell more than 5%, and AMD sank roughly 6%, dragging the Philadelphia Semiconductor Index down almost 6%.

Political pushback has also surfaced. President Donald Trump dismissed the slowdown push, calling AI-takeover warnings a hoax tied to the Radical Left, comparing them to past Russia-investigation and climate-change scares. Trump cast himself as breaking that hoax, dismissing the idea that robots would soon march into cities and eliminate people.

The tension is clear. Amodei has escalated his warnings over months. In January, he predicted AGI could arrive within one to two years. His latest essay is starker: without a change of course, swarms of rogue AI agents could take over the internet within as little as six months.