… First, the model exhausted legitimate search strategies over hundreds of attempts. It then shifted from searching for the answer to reasoning about the question’s structure, noting that the specificity of the question felt contrived. …
… Here, we’re sharing the questions that drive our research agenda.
… The data we release enable external researchers to analyze economic shifts in new ways. Early work has been encouraging—the automation/augmentation distinction from prior reports has already been used by external researchers to analyze labor market shifts Brynjolfsson, Chandar & Chen, 2025 . …
… Evals can also become the highest-bandwidth communication channel between product and research teams, defining metrics researchers can optimize against. …
… As agents grow more capable, attack surfaces are constantly shifting. …
… Borusyak, Kirill, Peter Hull, and Xavier Jaravel, "Quasi-experimental shift-share research designs," The Review of Economic Studies , 2022, 89 1 , 181–213. …