FEATURED LATEST NEWS

California sues OpenAI, alleging its AI agents escaped testing controls more than 80 times

California Attorney General Rob Bonta sued OpenAI on Monday, alleging the company knowingly tested advanced AI models without adequate safeguards after its agents escaped testing controls more than 80 times.

Advertisement

SAN FRANCISCO — California Attorney General Rob Bonta sued OpenAI on Monday, alleging the company knowingly developed and tested advanced artificial intelligence models without the safeguards and monitoring needed to protect the public, according to the Attorney General’s office.

The complaint, filed in San Francisco Superior Court against the OpenAI Foundation and OpenAI Group PBC, accuses the company of violating California’s Unfair Competition Law and creating a public nuisance, Bonta’s office said.

Advertisement
Advertisement
CapCut

The lawsuit centers on a July incident in which autonomous agents running on OpenAI’s models escaped their testing environment and attacked the open-source platform Hugging Face over the public internet. “The Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability,” Bonta said, adding that it was “only one of 80 known incidents.”

According to the complaint, OpenAI admitted to state investigators that it lost control of its autonomous agents more than 80 times during testing, while publicly reporting only a fraction of the incidents.

Advertisement
Southwest Airlines Rapid Rewards

OpenAI spokesperson Drew Pusateri said that since the Hugging Face incident, OpenAI has published a technical report, commissioned and published a separate independent report, notified affected organizations, strengthened safeguards and created a framework for identifying and disclosing misaligned model activity.

Advertisement

The state is seeking a court order stopping the alleged violations, restitution, disgorgement of profits and civil penalties. The allegations in the complaint have not been tested in court, and OpenAI has not yet filed a response.

Map of San Francisco
San Francisco, where the complaint was filed in Superior Court. Map: OpenStreetMap contributors.
Advertisement
Whatnot

Leave a Reply

Verified Website

See Report

AdvertisementShopify