Self-improving superintelligence
AssessTechniques
A hypothetical AI system that can improve its own capabilities and rapidly surpass human-level performance.
Why it's here
Placed in Assess: 2 article(s) of evidence from 3 source(s), led by research-stage coverage, with 2 in the last 30 days. Confidence 45%.
Evidence (2)
- 8Hacker News·9/21/2026researchAnthropic Engineer Resigns Over AI Safety Concerns
A former Anthropic and OpenAI pretraining researcher said he resigned because he believes both companies are racing toward self-improving superintelligence without a responsible plan for safety. The post drew wide attention and sparked renewed debate about AI alignment, industry pressure, and whether leading labs can control highly capable systems.
- 8Ars Technica AI·9/9/2026researchFormer Anthropic researcher warns self-improving AI could be deadly
AI researcher Jacob Coxon left Anthropic and publicly warned that frontier AI companies are taking serious risks by pursuing systems that could lead to self-improving superintelligence. Anthropic Alignment Science lead Evan Hubinger echoed the concern, saying the company believes AI could kill all humans and that the risk may exceed 10% within the next decade.