Tracked topic
A little over a week after OpenAI said that its rogue AI agent accidentally hacked Hugging Face, Anthropic is disclosing three “incidents” where a Claude model, during cybersecurity evaluations, was inadvertently able to access the internet due to a misconfiguration and “gained unauthorized access … …
… In an update to a blog post detailing its ongoing investigation into the incident, OpenAI said the wayward AI agent attacked several “publicly-available services” in its efforts to reach Hugging Face. “This includes four accounts on four services,” the company said, adding that the agent had found … …
… On July 16th, Hugging Face disclosed a security incident that it says was driven by “an autonomous AI agent system.” Hugging Face’s AI agents detected and stopped the breach, which OpenAI has now admitted occurred during an evaluation of its models’ cybersecurity capabilities. …
Former OpenAI board member Helen Toner has written for Fortune that OpenAI’s models exploiting Hugging Face is an “incident that has been expected for a long time.” We know this happened because of voluntary disclosure, Toner notes. “None of the current policies that aim to manage risks from fronti… …
… Reuters’ sources claim OpenAI employees didn’t know its agent was responsible until after Hugging Face had notified the FBI and posted publicly about a security incident. …
… In an update on social media, OpenAI said it is conducting a review and will publish a technical report of its findings “in the coming weeks.” Whether the warnings raised by the Hugging Face incident produce any lasting change, or join the long list of warnings the tech industry absorbs without mea… …
… The news of the proposed bill follows OpenAI’s admission that its AI systems mistakenly hacked Hugging Face during an internal evaluation. …
… Anthropic, prompted to review its own records by the Hugging Face incident, disclosed that Claude models had hacked systems belonging to three other companies. …
… However, the organization noted that the incident marked “the first time we have seen risks around autonomy and deception manifest this clearly, without specific prompting, in the real-world.” Unlike OpenAI’s rogue agent that attacked Hugging Face, AISI said this was “not a case of a model escaping… …
… It is hard to predict exactly how much this will accelerate Al progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.” The news follows a high-profile cybersecurity incident that rocked the AI industry la… …