…for developers Youth safety requirements are moving down the tech stack to operating systems and app stores—raising new questions for open source developers. News & insights How researchers are using GitHub Innovation…
…That may be fine for menial tasks, but if we want to use AI agents for more crucial tasks -- particularly shopping and handing over purchase decisions to AI -- we need ironclad safety…
…Working through a task, an agent will often encounter things its plan didn’t cover. It might be able to resolve many of these gaps itself (e.g., research the information it…
…Our safety researchers concluded that Sonnet 4.6 has “a broadly warm, honest, prosocial, and at times funny character, very strong safety behaviors, and no signs of major concerns around high-stakes…
…Led by Harvard medical student Arya Rao, a research team published in JAMA Network Open this week the results of a study that examined 21 leading off-the-shelf AI models in…
…Anthropic was founded in 2021 with a strong focus on AI safety research. 02 / 8 Safety What is the name of the safety and values framework Anthropic developed to guide Claude's…
Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.
…To quantify the security risks faced by LLMs under these threats, the research community has developed heuristic-based and optimization-based red-teaming methods. Optimization-based methods generally produce stronger attacks than…
…Why pointing a generic coding agent at a repo doesn't work When we first started AI-assisted vulnerability research last year, our instinct was the obvious one: point a generic coding…
…running agents like OpenClaw that are constantly training, evaluating and deploying new behaviors. On top of this shared body layer, a new foundation model called GEAR-SONIC, now available to researchers, delivers…
