The Paper
On June 10, 2026, a team of fourteen researchers — primarily from Google DeepMind — submitted a 57-page paper to arXiv titled "From AGI to ASI" (arXiv:2606.12683). It crossed 54,000 views within days and sparked wide discussion on X, where one response simply read: "57 pages? God damn."
The paper's scope is deliberately ambitious. While most AI safety research focuses on risks of human-level AI, this paper asks what happens after AGI — and whether the field is thinking clearly about the transition from human-level capability to capability that exceeds the largest human organisations.
The answer is: probably not clearly enough.
Setting the Stage: The Continuum of Intelligence
The paper establishes a conceptual framework before diving into pathways. Machine intelligence, it argues, sits on a continuum:
Current AI → Human-level AGI → ASI → Universal AI (UAI)
The endpoints of this continuum are the most theoretically tractable:
- Current AI: well-characterised by benchmarks, though imperfect
- Universal AI (UAI): theoretically well understood through algorithmic information theory and the work of Marcus Hutter (one of the co-authors and creator of AIXI, the theoretical framework for optimal universal agents)
The middle — the transition from AGI to ASI — is the least studied and, the authors argue, the most important to understand now.
ASI defined: A system that is more intelligent and cognitively capable than large organisations of humans. Not smarter than one human, not smarter than a team — smarter than entire organisations with divisions of labour, specialised expertise, and collective memory. This is a significantly higher bar than most informal uses of "superintelligence."
The Four Pathways
1. Scaling AGI
The most intuitive pathway: take whatever architecture produces AGI and continue scaling compute, data, and model size. If the scaling laws that brought us from GPT-2 to frontier models in 2026 continue to hold — or generalise — then ASI may be a quantitative extension of what we already know how to do.
The paper treats this pathway carefully. It does not assume scaling will continue indefinitely. The bottlenecks it identifies include:
- Data walls — human-generated data is finite; synthetic data introduces its own biases
- Compute economics — training costs scale faster than returns at some point
- Emergent capability discontinuities — new capabilities may require qualitative changes, not just more scale
But the core observation is that scaling has surprised researchers consistently for a decade, and dismissing it as a pathway to ASI requires stronger evidence than currently exists.
2. AI Paradigm Shifts
A new architecture, training paradigm, or learning mechanism that unlocks capabilities not achievable through scaling the current approach. Think of the transition from RNNs to Transformers — that shift did not just make models better, it changed what was possible.
The paper does not specify what such a shift might look like (by definition, it's hard to predict a paradigm shift). But it identifies key properties a new paradigm would need:
- Improved sample efficiency (humans learn far faster than current models from far less data)
- Better compositional generalisation (understanding new combinations of known concepts)
- More robust out-of-distribution performance
The concern here is that paradigm shifts may be harder to steer toward safety properties — a new architecture that enables ASI might arrive without the alignment work having been done for it.
3. Recursive Improvement
The pathway most associated with classical "intelligence explosion" arguments, first formalised by I.J. Good and later popularised by Eliezer Yudkowsky. The idea: an AI system helps design a better version of itself, which helps design an even better version, creating a self-reinforcing cycle.
The paper takes this seriously but more carefully than popular accounts. The key questions it raises:
- What exactly is being improved? (Architecture, training procedure, hardware design, data curation?)
- Are there diminishing returns to self-improvement?
- Does the improvement loop require human approval at each step, or is it fully automated?
The authors distinguish between AI-assisted improvement (humans remain in the loop) and AI-autonomous improvement (the system modifies itself without human review). The latter raises the sharpest safety concerns.
Current AI systems already contribute to their own development — frontier models are used to evaluate and generate training data for next-generation models. The question is whether that contribution becomes a dominant driver of capability growth.
4. Multi-Agent Collectives
Perhaps the most underappreciated pathway. Rather than a single ASI system, this pathway describes ASI emerging from the collective of many AGI-level agents working in coordination — specialised, communicating, dividing cognitive labour.
This maps naturally onto trends already visible in 2026: multi-agent orchestration, agent teams with specialised roles, and the emerging practice of loop engineering where agents check each other's outputs. The paper asks whether the aggregate capability of a well-coordinated multi-agent system could exceed what any individual system achieves — and whether that aggregate might qualify as ASI.
The safety implications are distinct from single-system ASI: alignment must be maintained not just in individual agents but in the coordination protocol between them. A single misaligned agent in a tightly integrated collective could propagate errors (or worse) through the system.
Frictions and Bottlenecks
The paper's most practically useful contribution may be its catalogue of what could slow or prevent ASI development along each pathway. It frames these as open research questions rather than showstoppers — things we do not currently know how to resolve:
Physical limits: Compute and energy constraints. The economics of training frontier models in 2026 already require billion-dollar infrastructure investments. At ASI scale, the resource requirements may be physically or economically infeasible.
Alignment bottlenecks: Each pathway requires solving different alignment problems. Scaling requires better scalable oversight. Recursive improvement requires safe self-modification. Multi-agent collectives require collective alignment. The paper is explicit: these are not solved problems.
Interpretability walls: As systems become more capable, understanding why they make specific decisions becomes harder. ASI-level capability may be intrinsically harder to interpret — a significant problem for safety verification. See related work on AI interpretability monitoring.
Institutional and regulatory friction: Governments, safety organisations, and international bodies may impose constraints that slow or redirect development. The paper treats this as a feature as much as a bug — such friction buys time for safety work.
The Central Insight: Not a Single Step Change
The paper's most significant contribution to public discourse may be its challenge to the "step change" narrative — the idea that AGI will arrive as a sudden transition point after which everything is different.
"More apt might be the prospect of a series of transformative societal changes caused by AI-enabled progress and breakthroughs across many areas of science and technology."
This reframing has practical implications. If the transition to ASI is gradual and distributed across domains — AI achieving decisive advantage in biology first, then materials science, then software engineering — then society has more opportunity to adapt than the "single event" narrative implies. But it also means the danger points are harder to identify and the benefits less obviously concentrated in a single moment that demands collective attention.
The paper also notes — with careful hedging — that it cannot rule out accelerating progress. The frictions may be negotiable. The bottlenecks may dissolve faster than expected. Universal AI may be closer than most timelines assume.
Why This Paper Matters Now
The timing is not accidental. The paper was submitted June 10, 2026 — one day after Anthropic launched Fable 5, and two days before the US government banned it on national security grounds. The AI safety establishment is grappling with frontier AI capability in real time, and "From AGI to ASI" is the field's attempt to look one level ahead.
The authorship is significant. Shane Legg co-founded DeepMind in 2010 and coined the term "machine superintelligence" in his 2008 doctoral thesis. Marcus Hutter created AIXI, the theoretical framework for universal intelligent agents. These are not outsiders speculating — they are people who have been working toward these systems for their entire careers.
The implicit message of the paper is that the AI safety community needs to extend its planning horizon. Most alignment work is designed for systems roughly at current capability levels. If any of the four pathways to ASI is viable — and the paper argues all four deserve serious research attention — then alignment methods designed for near-future AGI may be insufficient for what comes after.