More than thousand employees of Google, Meta, Anthropic, Microsoft, Amazon and OpenAI send SOS to US government on ‘automated AI development’; say: There is a real risk that …

The open letter has been signed by Anthropic CEO Amodei Dario, Jakub Pachock – Chief Scientist, OpenAI and Jared Kaplan — co-Founder and Chief Science Officer, Anthropic, among others.

Over 1,100 employees and senior AI researchers from companies including OpenAI, Google, Meta, Microsoft, Amazon and Anthropic have urged the US government to prepare safeguards that could slow the pace of advanced artificial intelligence development if needed. The executives signed an open letter warning that AI may soon become capable of improving itself faster than humans can oversee it. “AI could help create a dramatically better future, but that outcome is not guaranteed. The world’s leading AI companies believe they could be close to automating AI research,” the letter stated adding “there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems”.The signatories called for international coordination to develop technical and governance tools for what they describe as “automated AI development. “We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development,” the executives said in the letter.

Here’s the letter shared by employees of Google, Meta, Anthropic, Microsoft, Amazon and OpenAI

“AI could help create a dramatically better future, but that outcome is not guaranteed. The world’s leading AI companies believe they could be close to automating AI research. It is hard to predict exactly how much this will accelerate AI progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.To realize AI’s potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight. But each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration. And today, the world lacks the technical and governance tools to deliberately pace frontier-wide progress.Building on work already underway to monitor frontier model releases:We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.”– 1,224 employees of frontier AI companies