The key questions about internal AI development the public needs more evidence about, and a concrete proposal for how ...
Our proposal is to analyze a developer’s internal incidents and whether training may suppress evidence of worse misalignment.
Our proposal is to analyze whether a developer’s internal agents could get away with serious harm without being caught.
Assessing this would involve analyzing capabilities of unreleased models, understanding the growth of key AI R&D inputs ...
Financial and operational independence: Also per our COI policy, we will ensure that METR is not financially dependent on the AI companies we work with, promote a culture of impartiality, and recuse ...
Recent AI misalignment incidents have shown AI systems capably pursuing goals their human supervisors would not approve of, like hacking other companies. Fortunately, current AIs still seem relatively ...
An interactive chart of documented incidents in which AI agents deliberately acted against their users' intentions, scored along two axes: overreach and deception. Of these, 25 involve elements of ...
Note Notes are unpolished research updates directly from METR researchers, and have gone through less review than our research posts. They do not necessarily reflect the views of METR as a whole. Q: ...
In February–April 2026, we ran a survey of 349 technical workers (including 87 software engineers, 71 researchers, 129 academics and PhD students, and 48 founders and managers) about their usage of AI ...
We also discuss some alternative ways one could construct an RSP. Limits: which specific observations about dangerous capabilities would indicate that it is (or strongly might be) unsafe to continue ...
METR conducted a preliminary evaluation of Claude 3.7 Sonnet. While we failed to find significant evidence for a dangerous level of autonomous capabilities, the model displayed impressive AI R&D ...
We propose measuring AI performance in terms of the length of tasks AI agents can complete. We show that this metric has been consistently exponentially increasing over the past 6 years, with a ...