Google, Microsoft and xAI agree to allow government safety checks of their AI models prior to release

Google LLC, Microsoft Corp. and xAI have agreed to share unreleased versions of their artificial intelligence models with the U.S. Department of Commerce to ensure the technologies do not pose a threat.

Today, the Center for AI Standards and Innovation, CAISI, part of the Commerce Department, announced it will take charge of testing the models in an effort to protect U.S. national security, with the onus on cybersecurity, biosecurity and chemical weapons.

While the current administration has appeared to embrace a laissez-faire approach to powerful AI systems and their development, safety concerns have mounted since the partial release of Anthropic PBC’s Claude Mythos model. “Independent, rigorous measurement science is essential to understanding frontier AI and its national security implications,” said CAISI Director Chris Fall in a statement. “These expanded industry collaborations help us scale our work in the public interest at a critical moment.”

OpenAI Group PBC and Anthropic were the first AI companies to allow CAISI to scrutinize their models after they made an agreement with the Biden administration about two years ago. CAISI has reportedly already completed dozens of AI model evaluations, including on unreleased state-of-the-art models.

The New York Times reported earlier this week that the Trump administration is discussing an executive order that will bring tech executives and government officials together in a working group where they will create a formal review process of all new AI models. This will be a volte-face for the White House, which has taken a hands-off approach to AI development as the U.S. tries to stay ahead of China.

“We can’t stop it with politics,” Trump said last year at an AI event. “We can’t stop it with foolish rules and even stupid rules.”

But with more public fears around AI regarding job loss, mental health and cybersecurity, it seems the government could now be moving toward a more careful approach while remaining wary of overregulation.

Photo: Tony Webster/Flickr