Not every notable AI story this week is about a frontier lab shipping a trillion-parameter model. Greg Diamos, who describes himself as building AI supercomputers, needed something much smaller and much faster: a CPU-only model that could process data at roughly 10,000 tokens per second with no GPU involved. His solution, built with the help of Claude Code, is amx-reasoning-v1-instruct — and he says the exercise surfaced three findings worth revisiting about "outrageously small neural nets."
TL;DR
| Question | Answer |
|---|---|
| What did Diamos build? | amx-reasoning-v1-instruct, a small CPU-only model for data processing |
| Target speed | Roughly 10,000 tokens/sec on CPU |
| How was it built? | Diamos gave Claude Code "a pile of tokens" to build it from scratch |
| Where's it published? | Hugging Face — gdiamos/amx-reasoning-v1-instruct |
| What does "AMX" mean? | Intel's Advanced Matrix Extensions — CPU instructions that accelerate matrix math |
| What's the headline claim? | Three interesting discoveries about small neural nets, detailed in the paper |
Why "outrageously small" is the right framing
Diamos's framing — that the field should "revisit outrageously small neural nets" — cuts against the dominant 2026 narrative of ever-larger frontier models. But it's a genuinely useful counter-question: not every task needs a model with hundreds of billions of parameters and a GPU cluster behind it. A data-processing pipeline that needs to classify, extract, or transform text at high throughput often has a much narrower capability requirement than a general-purpose chat assistant — and a small model tuned specifically for that narrower task, running on CPU hardware that's already provisioned and idle, can be the more practical engineering choice.
This is the same logic behind explainx.ai's coverage of other small, purpose-built models this year — MiniCPM5-1B's tiny-model breakthrough, the ESP32 28.9M-parameter LLM running per-layer, and PrismML's Bonsai 27B 1-bit ternary model for phones — a consistent 2026 thread of teams asking "how small can this actually be for what I need," rather than defaulting to the largest available model.
What AMX actually is, and why it matters here
AMX — Advanced Matrix Extensions — is an Intel CPU instruction set specifically designed to accelerate matrix multiplication, the core mathematical operation underlying neural network inference. Naming the model after it is a signal about the engineering approach: rather than treating CPU inference as a fallback for when a GPU isn't available, amx-reasoning-v1 is reportedly built to actively exploit CPU-level matrix acceleration hardware most inference stacks don't specifically target. That's a meaningfully different design philosophy than running a GPU-optimized model on CPU as a compatibility afterthought — it's building for the hardware you actually have, rather than the hardware you wish you had.
Built by handing Claude Code "a pile of tokens"
The build process itself is worth noting: Diamos describes giving Claude Code a large amount of compute budget and letting it build the model, rather than hand-designing the architecture himself from scratch. That's consistent with the growing pattern explainx.ai has tracked of using coding agents not just to write application code, but to conduct genuine model-architecture experimentation — OpenAI's own "research intern" milestone documented a similar shift internally, where coding agents increasingly handle substantive research tasks rather than boilerplate.
What's confirmed and what to check yourself
Diamos's post states the model made "three interesting discoveries" without detailing them in the tweet itself — the specifics are in the published paper on Hugging Face. Given that the paper is the primary source and the tweet is a teaser, anyone interested in the actual technical findings — architecture choices, training data, the specific efficiency discoveries — should read the paper directly rather than relying on secondhand summary of a three-word tease.
Related on explainx.ai
- FrogNano: Microsoft 4B SWE agent, 61.5% SWE-bench, no distillation (Sep 9, 2026) — another minimal-hardware agent bet, trained with RL on synthetic tasks only
- MiniCPM5-1B: tiny AI model breakthrough
- ESP32 AI: a 28.9M-parameter LLM running per-layer
- PrismML Bonsai 27B: 1-bit ternary model for phones
- Coral Edge AI platform: complete guide
- OpenAI's research acceleration: 3.1 agent-workdays per human
- What is fine-tuning an LLM? LoRA, QLoRA, SFT, RLHF explained
Sources
- Greg Diamos on X, September 7, 2026
- gdiamos/amx-reasoning-v1-instruct on Hugging Face
This post reflects Greg Diamos's September 7, 2026 announcement and the linked Hugging Face model page. The paper's three specific findings were not independently summarized here — read the primary source PDF for full technical detail before citing specific claims.