…the same queries that are beneficial in the hands of cybersecurity professionals and biology researchers could be dangerous if available to malicious actors. We therefore need strong safeguards to prevent misuse, and…
…allows security professionals using our models for legitimate cybersecurity purposes (such as vulnerability research, penetration testing, and red-teaming) to do so without certain safeguards designed to prevent cyber misuse. Now, we…
…secure the benefits of advanced AI models and mitigate their risks. That public benefit mission has led us, for example, to invest in AI safeguards to reduce the risk of misuse, to…
Announcements Statement on the US government directive to suspend access to Fable 5 and Mythos 5 Jun 12, 2026 The US government, citing national security authorities, has issued an export control directive…
…and the Ministry of State Security for surveillance and repression. My secondary concern is the risk that powerful AI models may be misused to carry out cyberattacks or biological attacks, and may…
…Their partnership , and the technical lessons we learned, provides a model for how AI-enabled security researchers and maintainers can work together to meet this moment. From model evaluations to a security…
…We would specifically like to enable researchers and teams to experiment with applying models in areas like Security Operations Center (SOC) automation, Security Information and Event Management (SIEM) analysis, secure network engineering…
Announcements Frontier threats red teaming for AI safety Jul 26, 2023 “Red teaming,” or adversarial testing, is a recognized technique to measure and increase the safety and security of systems. While previous…
…A more robust protection against misuse would be to control what the model knows. We’ve explored this before: in earlier work, we filtered information about chemical, biological, radiological, and nuclear weapons…
…misused, the threat landscape is constantly evolving, and we must pay attention to these early signs of new model capabilities. This is a moment to move quickly—to empower cyberdefenders to secure…