Developing nuclear safeguards for AI through public-private partnership
… We have already deployed this classifier on Claude traffic as part of our broader system for identifying misuse of our models. …
Search
2 sources covering this — show 1 more
Announcing Anthropic's Responsible Scaling Policy
… ASL-3 measures include stricter standards that will require intense research and engineering effort to comply with in time, such as unusually strong security requirements and a commitment not to deploy ASL-3 models if they show any meaningful catastrophic misuse risk under adversarial testing by wo… …
LLM-discovered 0 days
… With this launch, we’ve created new cyber-specific probes to better track and understand the potential misuse of Claude in the cybersecurity domain. …
Expanding Project Glasswing
… Accelerating patching and the rest of security As we’ve previously discussed , the bottleneck in cybersecurity is now verifying, disclosing, and patching the large numbers of vulnerabilities that Mythos-class models can surface. …
Redeploying Claude Fable 5
… These prodigious cybersecurity capabilities make it uniquely attractive to malicious actors who wish to misuse it in cyberattacks. …
Mapping AI-enabled cyber threats: Insights from the LLM ATT&CK Navigator
… It also serves as a guide to how threat actors are likely to misuse increasingly capable models in the near future, giving defenders a chance to get ahead of them. What we learned from this and other analyses directly shapes how we build Claude to prevent such misuse. …
More details on Fable 5’s cyber safeguards and our jailbreak framework
… We are building it based on our own experience in preventing misuse, and assisted by feedback from our industry partners and the government. We hope to receive further feedback to help us continually refine both the framework and our cybersecurity safeguards. …
LLMs and biorisk
… This monitoring provides insight into patterns of misuse and helps us determine if and when to take enforcement action. National action We are heartened to see investment in biosecurity as a key component of the new US AI Action Plan . …
Claude Fable 5 and Claude Mythos 5
… Without safeguards, Fable 5’s capabilities in areas like cybersecurity could be misused to cause serious damage. …