EU in talks with OpenAI, Anthropic after rogue AI agent hacks

In effect, the rules require certain AI systems to tell users when they are ⁠interacting with AI and when content has been generated or altered by it.

 

Anthropic said on Thursday some of its Claude AI models had hacked into the systems of three companies during cybersecurity tests, days after rival OpenAI revealed that one of its AI agents went on a rogue attack.

 

Both companies have briefed the Commission on the incidents, the officials told reporters.

 

“We have been informed by the two providers of incidents bilaterally before they become public. We are in contact with them. They will also report to ‌us ⁠more information as we speak. We will see also if we need to follow up more formally on those things,” one of the officials said.