Anthropic Researcher Resigns Over AI Extinction Risk, Urges Lab Pacing Deals

Jacob Coxon, a researcher at AI company Anthropic, has resigned citing fears that advanced AI development could pose an existential threat to humanity. Coxon expressed particular concern about self-improving AI systems, which he believes could spiral beyond human control. In departing, he called on leading AI laboratories to establish pacing agreements to slow down the race toward potentially dangerous capabilities. His resignation adds to a growing chorus of voices within the AI industry warning about the risks of unchecked development.