Evaluating Claude’s bioinformatics research capabilities with BioMysteryBench
… To answer this, the research community has built several benchmarks. …
Search
Eval awareness in Claude Opus 4.6’s BrowseComp performance
… This finding raises questions about whether static benchmarks remain reliable when run in web-enabled environments. …
Introducing Claude Opus 4.5
… For production code review at scale, that reliability matters. Based on testing with Junie, our coding agent, Claude Opus 4.5 outperforms Sonnet 4.5 across all benchmarks . …
Introducing Claude Opus 4.7
… This is the reliability jump that makes Notion Agent feel like a true teammate. …
Quantifying infrastructure noise in agentic coding evals
… Static benchmarks score a model's output directly—the runtime environment doesn’t factor into the result. …
Claude for Financial Services
…This creates a fundamentally more reliable way to analyze financial data—information is verified across sources to reduce errors, every claim links directly to its original source for transparency, and complex analysis…
Introducing Sonnet 4.6
… Evaluating Claude Sonnet 4.6 Beyond computer use, Claude Sonnet 4.6 has improved on benchmarks across the board. …
Anthropic forms $200 million partnership with the Gates Foundation
… This includes creating public goods—like model benchmarks, datasets, and knowledge graphs—to ensure AI tools for math tutoring, college advising, and curriculum design are effective. …
Trustworthy agents in practice
… Benchmarks. …
Natural Language Autoencoders
… We’ve already applied NLAs to understand what Claude is thinking and to improve Claude’s safety and reliability. …