Tracked topic
…Use generally available frontier models to strengthen defenses now . Current frontier models, like Claude Opus 4.6 (and those of other companies), remain extremely competent at finding vulnerabilities , even if they are…
…FHIR development and a sample prior authorization review skill. FHIR is the modern standard for exchanging data between healthcare systems, and this skill helps to improve interoperability by enabling developers to connect…
…In addition, these models are known to develop rich and generalizable internal representations of abstract concepts underlying their actions. It may then be natural for them to develop internal machinery that emulates…
…To ensure that Claude hadn’t hallucinated bugs (i.e., invented problems that don’t exist, a problem that increasingly is placing an undue burden on open source developers), we validated every…
…software development ("Help debug, develop, and optimize software across multiple programming domains") and personal life management ("Assist with personal life management and everyday tasks"). Figure 2.2 shows the primitive profile for…
Engineering at Anthropic Quantifying infrastructure noise in agentic coding evals Agentic coding benchmarks like SWE-bench and Terminal-Bench are commonly used to compare the software engineering capabilities of frontier models—with…
…What Karpathy’s lecture about web development tells us about doing biology with AI agents This mismatch between agent needs and human-built tools is not unique to biology. The same friction…
Announcements The Long-Term Benefit Trust Sep 19, 2023 Today we are sharing more details about our new governance structure called the Long-Term Benefit Trust (LTBT) , which we have been developing…
…The need to evaluate this capability led Andon Labs to develop and publish Vending-Bench , a test of AI capabilities in which LLMs run a simulated vending machine business. A logical next…
…We present evidence that high-tenure users have developed habits and strategies that allow them to better harness Claude’s capabilities. Indeed, we document that more experienced users not only attempt higher…