Measuring LLMs' impact on N-day exploits
…Across 18 recent Firefox security patches, Claude Mythos Preview, our most capable model, built 8 working code-execution exploits autonomously. And on 21 Windows kernel patches—where the source code is not…
Tracked topic
Claude is an AI assistant developed by Anthropic that uses large language models to generate text and support conversational tasks.
In our previous Economic Index reports, we separated out “automation,” where AI directly performs tasks, from “augmentation,” where AI collaborates with a user to perform a task. Here, we found that Claude Code showed dramatically higher automation rates—79% of conversations involved some form of automation, compared to 49% on Claude.ai. We also split automation and augmentation into several subtypes (as discussed in our previous work). “Feedback Loop” patterns, where Claude completes tasks autonomously but with help of human validation (for example, where the user sends any errors back to Cla
Anthropic Economic Index: AI's impact on software developmentOverall, we found that developers commonly use Claude for building user interfaces and interactive elements for websites and mobile applications. Although no single language dominated, the primarily web-focused development languages of JavaScript and TypeScript together accounted for 31% of all queries, and HTML2 and CSS (other languages for user-facing code) together added another 28%. Back-end development languages (used for behind-the-scenes logic, databases, and infrastructure, as well as API and AI development) were also represented: notably, Python was at 14% of queries. However, Python
Anthropic Economic Index: AI's impact on software developmentWe also analyzed which groups of developers might be using Claude. We used our analysis system to identify the type of project (e.g. a personal project vs. a project done for a startup) that best described users’ coding-related interactions. Because we don’t know the real-world context in which Claude’s responses were being used, these analyses rely on uncertain inferences from incomplete data. We therefore treat these findings as more preliminary than the ones described above. Startups appear to be the primary early adopters of Claude Code, and enterprise adoption lags behind. Startup work ac
Anthropic Economic Index: AI's impact on software developmentWe measure this on a 1-5 scale, from "none" to "extreme.” Tasks that are easy to describe or specify involve little autonomy: the lowest-autonomy outputs are math or calculations, translations, and Q&As. High-autonomy tasks are those that require selection among many possible choices, e.g., creating apps and websites, games, or presentations. Such work, which requires sustained judgment, has historically been difficult to automate. By comparing the level of autonomy in Claude chat and Cowork to Claude Code, we show that this is starting to change. Across almost all types of outputs (26 of 31 o
Anthropic Economic Index report: Cadences…Across 18 recent Firefox security patches, Claude Mythos Preview, our most capable model, built 8 working code-execution exploits autonomously. And on 21 Windows kernel patches—where the source code is not…
…In each episode, we initiated three instances of the same model on virtual machines in Claude Code. Each model was tasked with migrating a Python backend on a fourth VM to another…
…Footnotes Related content How Canada uses Claude: Findings from the Anthropic Economic Index Claude’s values across models and languages Claude plays robotics In project Fetch, we examined how humans can use…
…by roughly 67% on Claude.ai , 55% on Cowork, 17% on Claude Code, and 7% on the Claude Platform. Related content Mariano-Florentino (Tino) Cuéllar to join Anthropic as Chief Global Affairs…
…Turning Claude’s thoughts into text AI models like Claude talk in words but think in numbers. In this study we train Claude to translate its thoughts into human-readable text. Donating…
…Related content More details on Fable 5’s cyber safeguards and our jailbreak framework Introducing Claude Sonnet 5 Sonnet 5 delivers frontier performance across coding, agents, and professional work at scale. Redeploying…
…Open-source codebases, like smart contracts, may be the first to face this wave of automated, tireless scrutiny. But it is unlikely that proprietary software will remain unstudied for long, as agents…
…A key component of our method is that it is automated. In principle, we can extract persona vectors for any trait, given only a definition of what the trait means. In our…
…Related content Government of Alberta uses Claude to find and fix cybersecurity vulnerabilities across government systems Since 2025, the Government of Alberta has been using Claude Code with both Opus and Sonnet…
…Turning Claude’s thoughts into text AI models like Claude talk in words but think in numbers. In this study we train Claude to translate its thoughts into human-readable text. Donating…