Eval awareness in Claude Opus 4.6’s BrowseComp performance
…It considered the possibility that the question was for a homework or exam problem, “an unanswerable question designed to test whether or not an AI can admit it cannot find the answer…
Search
Introducing Sonnet 4.6
…and Claude Code plugins, integrations with the Microsoft 365 suite, new connectors, and an MCP app for financial services and insurance organizations. Building a new enterprise AI services company with Blackstone, Hellman…
Anthropic Economic Index report: Learning curves
…We sample 1 million conversations from both Claude.ai, our consumer-facing web product, and our first-party API, the developer-facing interface for integrating Claude into products and workflows. 2 Coding…
Project Vend: Can Claude run a small shop? (And why does that matter?)
…Why did you have an LLM run a small business? As AI becomes more integrated into the economy, we need more data to better understand its capabilities and limitations. Initiatives like the…
The Long-Term Benefit Trust
…and Claude Code plugins, integrations with the Microsoft 365 suite, new connectors, and an MCP app for financial services and insurance organizations. Building a new enterprise AI services company with Blackstone, Hellman…
Introducing Claude Opus 4.5
…and Claude Code plugins, integrations with the Microsoft 365 suite, new connectors, and an MCP app for financial services and insurance organizations. Building a new enterprise AI services company with Blackstone, Hellman…
Anthropic Economic Index report: Economic primitives
…In future work, we could leverage our 1P API data to understand which of these tasks are being integrated into production workflows. AI’s impact on the task content of jobs Beyond…
Claude Opus 4.6
…and Claude Code plugins, integrations with the Microsoft 365 suite, new connectors, and an MCP app for financial services and insurance organizations. Building a new enterprise AI services company with Blackstone, Hellman…
Demystifying evals for AI agents
Engineering at Anthropic Demystifying evals for AI agents Introduction Good evaluations help teams ship AI agents more confidently. Without them, it’s easy to get stuck in reactive loops—catching issues only…
Introducing advanced tool use on the Claude Developer Platform
…Claude Developer Platform The future of AI agents is one where models work seamlessly across hundreds or thousands of tools. An IDE assistant that integrates git operations, file manipulation, package managers, testing…