…The need to evaluate this capability led Andon Labs to develop and publish Vending-Bench , a test of AI capabilities in which LLMs run a simulated vending machine business. A logical next…
…Introducing Claude Tag Claude Tag is a new way for teams to work with Claude. Anthropic opens Seoul office and announces new partnerships across the Korean AI ecosystem
…A new measure and early evidence Mar 5, 2026 Read in PDF Key findings We introduce a new measure of AI displacement risk, observed exposure , that combines theoretical LLM capability and real…
…A form for researchers to provide feedback on our data and suggest new research directions is here . Acknowledgements We appreciate the productive comments and discussion on early findings and drafts of the…
…to update or improve it. New strategies for prompting can be tried on the fly, but the competitions force an honest snapshot of the model’s capabilities and challenge us (as Anthropic…
…In a new Anthropic Fellows study, we pursue both of these questions. Our new study focuses on a problem known as “weak-to-strong supervision”, a problem that mirrors the one of…
…still no fully robust deep-learning models in production. We’re developing better jailbreak defenses so that we can safely deploy increasingly capable models in the future. Under our Responsible Scaling Policy…
…However, this productivity difference only appears for these early pipeline measures. We find no evidence that coding agent users are submitting more new papers to journals or resubmitting papers more quickly. This…
…In a sense one can view alignment capabilities vs alignment science as a “blue team” vs “red team” distinction, where alignment capabilities research attempts to develop new algorithms, while alignment science tries…
…worker stakes in AI-driven growth before disruption arrives Generating new evidence on public investments. What is the fund? AI capabilities continue to improve. But we don’t yet know how quickly…