explainx.ai0k
TrendingNewsPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcptoolsmdx readeragentsllmsdesignsdictionaryagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

On this page

  • TL;DR
  • What Cognition Claims — and What It Means for Builders
  • What People Are Asking
  • Training Infrastructure: What Scaled with K3
  • Behavioral Patterns Cognition Highlights
  • What Hacker News pushed back on
  • SWE-2 vs the Agent Coding Landscape
  • Honest Limitations
  • The Bottom Line
  • Related on explainx.ai
← Back to blog

explainx / blog

SWE-2: Cognition's Frontier-Near Coding Model Lands in Devin

Cognition, Devin, SWE-2, Agentic Coding, RL Training, Kimi K3

Cognition launched SWE-2 September 10, 2026 — 50.0% FrontierCode 1.1, 92.8% Terminal-Bench 2.1, Kimi K3 RL at 2.8T scale. Devin Desktop/CLI today. vs SWE-1.7, Fable 5.1, GPT-6 Astra, honest gaps on Terminal-Bench 4.

Sep 11, 2026·11 min read·Yash Thakker
add explainx.ai
go deep
SWE-2: Cognition's Frontier-Near Coding Model Lands in Devin

On September 10, 2026, Cognition launched SWE-2 — the successor to SWE-1.7 and the company's closest model yet to frontier-tier coding performance at a fraction of the cost. The headline number is 50.0% on FrontierCode 1.1 Main — within one point of Fable 5.1 (50.9%) while Cognition claims 64% lower cost at that score level.

The launch lands one day after Marc Andreessen's second a16z Cognition investment post, which argued Devin now writes 90%+ of Cognition's own production code. SWE-2 is the engine behind that dogfooding story — cheaper, sharper rollouts inside the Devin harness.

SWE-2 agent coding benchmark context — Terminal-Bench evaluation landscape for agentic coding models

TL;DR

table · 2 cols
QuestionAnswer
Launch date?September 10, 2026
Where?Devin Desktop + CLI today; Web + Fusion rolling out
Base model?Kimi K3 — 2.8T params, 104B active (MoE)
FrontierCode 1.1?50.0% (Fable 5.1: 50.9%, GPT-6 Astra: 53.3%)
Terminal-Bench 2.1?92.8% (Fable 5.1: 91.4%, SWE-1.7: 81.5%)
Terminal-Bench 4?27.3% — gap vs Fable 5.1 (55.8%)
Efficiency vs SWE-1.7?58% fewer turns, 81% lower cost at medium effort
First code edit?Median step 18 (SWE-1.7: 48)
Open weights?No — Devin platform only
Key training novelty?Single RL run for all effort levels with Pareto cost penalties
Weekly digest3.5k readers

Catch up on AI

Curated AI updates on agents, skills, and MCP — delivered to your inbox. Unsubscribe anytime.

What Cognition Claims — and What It Means for Builders

Cognition's pitch has not changed since SWE-1.7: optimize the entire cost–performance Pareto curve, not just chase a single leaderboard crown. SWE-2 is the first time they have pushed RL into the multi-trillion-parameter regime, building on the SWE-1.7 infrastructure (multi-continent rollouts, entropy control, verifier hardening) with a new algorithmic centerpiece.

The base is Kimi K3 — a 2.8T-parameter MoE model that had already undergone extensive RL for agentic coding. Cognition's additional pass still finds 5–6 points on many benchmarks, echoing the SWE-1.7 lesson that post-training headroom persists even after a heavily RL'd open base.

On Cognition's published table:

table · 8 cols
BenchmarkSWE-2Kimi K3Grok 4.6Fable 5.1GPT-5.6 SolGPT-6 AstraSWE-1.7
FrontierCode 1.1 Main50.0%44.2%48.0%50.9%47.5%53.3%42.0%
DeepSWE 1.173.0%68.5%67.5%67.4%72.7%74.1%37.7%
Terminal-Bench 2.192.8%88.3%88.4%91.4%88.8%89.9%81.5%
Terminal-Bench 427.3%21.5%20.3%55.8%37.3%57.9%7.6%

FrontierCode measures whether AI-written pull requests would merge — Cognition's own benchmark, so treat cross-vendor ordering as directional. DeepSWE 1.1 targets deeper repository work. Terminal-Bench 2.1 is the industry-standard terminal agent suite; SWE-2's 92.8% is the highest number in Cognition's table and a meaningful jump from SWE-1.7's 81.5%.

The soft spot is Terminal-Bench 4 at 27.3% — long-horizon agentic tasks where Fable 5.1 (55.8%) and GPT-6 Astra (57.9%) still lead by a wide margin. If your work looks like multi-hour autonomous repo refactors, SWE-2's headline FrontierCode parity does not automatically translate.

What People Are Asking

Is SWE-2 actually cheaper, or is this benchmark math?

Cognition's cost story is task-level, not a public per-token rate card. They plot mean USD per rollout against solve rate on FrontierCode and DeepSWE, claiming SWE-2 matches GPT-5.6 Sol and Fable 5/5.1 at a fraction of the price and sits within a few points of GPT-6 Astra at roughly a quarter of the cost.

OfficeChai and other coverage note savings up to 70% at the top end across benchmarks Cognition tested — the 64% figure is specifically the Fable 5.1 FrontierCode parity point. Until Cognition publishes Devin task pricing tied to effort level, reproduce cost on your task mix inside Devin rather than extrapolating from blog charts.

Why does SWE-2 explore less than SWE-1.7?

SWE-1.7 drew user feedback for over-exploring simple tasks — thorough greps and reads before the first edit. SWE-2's efficiency gains come from focused exploration: stronger judgment about which parts of a codebase matter.

On FrontierCode 1.1 Main, SWE-2 medium scores higher than SWE-1.7 while taking 58% fewer turns and costing 81% less on average. Median first real code edit drops from step 48 (SWE-1.7) to step 18 (SWE-2 medium). High and max effort levels still plan longer and probe deeper — Cognition reports real behavioral separation across effort tiers, not just a speed knob on identical policies.

How is the training different from Kimi K3's approach?

Kimi K3 trains separate experts per domain × effort level, then consolidates via multi-teacher on-policy distillation with problem-specific token budgets. Cognition instead runs one RL pass for all effort levels using a linear cost-penalized reward:

R = S − λ_e C

where S is rollout success, C is cost (inference USD + time), and λ_e is tuned to the local slope of the base model's Pareto frontier at effort level e. Cognition derives this from first principles — only a linear penalty preserves the same expected reward whether you average cost before or after penalizing individual rollouts.

The geometric intuition: set λ_e equal to the frontier's tangent slope so iso-reward lines sit tangent to the curve. Too large a penalty and high-effort collapses toward medium-effort behavior — reward rises without moving the frontier. Matching the slope ensures gradient steps push the frontier upward rather than sideways.

They also publish the length-weighted group baseline used since SWE-1.6 — approximating the optimal variance-reducing baseline without an extra backward pass per rollout, which Cognition says significantly stabilizes training and keeps inference–training KL lower.

Does SWE-2 fix the long-horizon gap?

Partially, not completely. SWE-1.7 scored 7.6% on Terminal-Bench 4; SWE-2 jumps to 27.3% — a real improvement, but still roughly half of Fable 5.1 and GPT-6 Astra. Cognition tripled RL environments, added instruction-following overlays, and built a verifier flywheel from SWE-2 checkpoints to harden reward signals — infrastructure that should help long tasks over time, but the published numbers say frontier labs retain a moat on the hardest agentic horizons.

Training Infrastructure: What Scaled with K3

Moving from Kimi K2.7 (SWE-1.7) to K3 at ~3× the parameters required rollout-serving upgrades:

  • Prefill delayer — batches nearby prefill requests in the GPU scheduler for 10–20% TPM/TPS gains at acceptable TTFT tradeoff
  • DSpark speculative decoding with online draft-model training — acceptance rates degrade as the policy shifts during RL; SpecForge-trained drafts plus continuous online updates recover accept length
  • NVFP4/FP8 kernels + quantization-aware training — lower memory, more concurrent rollouts, lower train–inference mismatch than SWE-1.7 despite the larger base

Data-side, Cognition tripled RL environments, expanded repo sourcing, layered instruction-following requirements onto existing tasks, and iteratively patched verifier false positives/negatives using rollouts from earlier SWE-2 checkpoints — a recursive flywheel Kimi K3's resourcefulness reportedly forced them to harden.

Behavioral Patterns Cognition Highlights

From internal testing, Cognition reports SWE-2 differs from SWE-1.7 in ways that matter for production agent work:

  • Test coverage — end-to-end tests that catch regressions and edge cases, not just happy-path stubs
  • Resourcefulness within boundaries — when an MCP integration was unavailable, SWE-2 reconstructed needed data from Slack channel history it already had access to
  • Verification discipline — re-derives conclusions when challenged instead of agreeing; runs artifacts for evidence rather than trusting surface prose

On trustworthiness evals Cognition reran from their July post, SWE-2 passed 98.0% of propaganda/censorship attempts (145 politically sensitive prompts in English, Simplified Chinese, and Traditional Chinese). A context-dependent vulnerability framing test showed no statistically significant framing effects — same null result as their earlier open-source-derived model study.

What Hacker News pushed back on

The launch thread (393 points, 165+ comments as of publication) raised three objections worth stating plainly rather than smoothing over:

  • The Terminal-Bench 2.1 vs TB4 gap reads as benchmaxxing to skeptics. One top comment framed it directly: TB2.1 is saturated (multiple frontier models score 88-92%+), so SWE-2's 92.8% there proves little, while its 27.3% on the newer, harder TB4 is the more honest signal — and it trails GPT-6 Astra's 57.9% by roughly half. Replies pushed back that every current model shows the same TB2.1-to-TB4 drop (GPT-5.6 Sol: 90% → 37%), so the pattern reflects benchmark staleness across the industry, not SWE-2 specifically.
  • DeepSeek V4.1 Flash, released the same day, scored higher on TB4 (31.2%) at open-weight pricing — several commenters used it as the direct comparison Cognition's own post doesn't make, since SWE-2 ships closed-weight despite being post-trained on an open base (Kimi K3).
  • Devin's product reputation is still recovering. Multiple commenters described Devin CLI as buggy or inconsistent between its desktop and cloud harnesses, a legacy of Cognition's much-criticized original 2024 demo; others reported the opposite experience after switching from Cursor or Windsurf. Take both sets of anecdotes as exactly that — anecdotes, not a resolved verdict — and verify on your own repos before treating either side as the final word.

SWE-2 vs the Agent Coding Landscape

table · 4 cols
PathSWE-2 / DevinFable 5.1 / Claude CodeOpen weights (Kimi K3, GLM)
AccessDevin subscriptionAnthropic API + Claude CodeAPI + downloadable weights
Eval focusFrontierCode merge quality + Devin harnessAnthropic harness + public benchesSelf-host control
Long-horizon TB427.3% (self-reported)55.8%Lower on Cognition's table
Cost modelTask-level internal curvePer-token APIHost-dependent
HarnessDevin VM agentClaude Code loopBring your own — see harness engineering

Teams choosing between paths should ask whether they need self-driving ticket completion (Devin's unit of work) or IDE-native autocomplete plus commands (Claude Code, Cursor, Codex). SWE-2 only exists inside the first column.

Andreessen's post is the enterprise proof layer: Mercedes COBOL migration in eight days, Rivian 10× test generation, Itau 70% automatic vulnerability remediation. SWE-2 is the model refresh that makes those rollouts cheaper per attempt — if the efficiency metrics hold outside Cognition's eval harness.

Honest Limitations

  • Self-reported evals — FrontierCode and DeepSWE are Cognition-owned; Terminal-Bench runs use vendor-preferred harnesses (Devin CLI for open-weight models, Claude Code for Anthropic, Codex for OpenAI). Cross-vendor ordering needs independent replication.
  • Terminal-Bench 4 gap — 27.3% vs ~56–58% for frontier labs. Do not assume FrontierCode parity implies long-horizon parity.
  • No open weights — you cannot audit SWE-2 weights, run ablations, or self-host. Compare Kimi K3 open weights if control matters more than Devin integration.
  • Devin lock-in — evaluate against Claude Code, Cursor, and Codex on your repos before procurement.
  • Cost claims are curves, not SKUs — Cognition assumes list pricing including public discounts; your Devin plan and task mix will differ.
  • Andreessen dogfooding stats — 90%+ internal code from Devin is Cognition self-report, not third-party audit. Directionally interesting; not a universal customer benchmark.

The Bottom Line

SWE-2 is Cognition's answer to a question SWE-1.7 already posed: can RL post-training on an open base close the gap to closed frontier models without closed-model inference prices? At 50.0% FrontierCode within a point of Fable 5.1 and 92.8% Terminal-Bench 2.1, the scoreboard says yes for a large class of agentic coding tasks — especially when medium effort cuts turns and cost versus SWE-1.7.

The remaining gap is visible in the same table: Terminal-Bench 4 and the long tail of multi-hour autonomous work. Cognition is betting that Pareto-informed RL, verifier flywheels, and Devin harness co-design will keep closing that gap faster than frontier labs drop prices. Builders should verify on their repos, at their effort settings, with their security boundaries — not on blog charts alone.

Related on explainx.ai

  • SWE-1.7: Cognition's frontier coding model at 1000 tok/s (Jul 2026) — predecessor, training recipe, SWE-1.7 benchmarks
  • Marc Andreessen: Devin writes 90%+ of Cognition production code (Sep 2026) — a16z thesis and enterprise proof points
  • Terminal-Bench 2.0: The AI Agent Benchmark That Actually Matters — benchmark context for SWE-2's 92.8% TB 2.1 score
  • Agent Harness Engineering — why harness beats model alone
  • Cognition Acquires Poke Maker Interaction — Devin messaging expansion
  • How to read an AI benchmark and not get fooled — interpreting self-reported scores
  • Claude Code vs Codex vs GLM routing guide — alternatives to Devin
  • Loop engineering for coding agents — agent loop design patterns

Sources: Cognition — SWE-2 · Cognition — SWE-1.7 · Kimi K3 paper · Cognition on X (September 10, 2026).

Benchmarks, availability, and cost curves per Cognition's September 10, 2026 post — verify in Devin before procurement decisions.

Spotted something out of date? Let us know.
Yash Thakker

Written by

Yash Thakker

Yash is an AI expert with over 300K learners. Join his workshops →

Related posts

Jul 9, 2026

SWE-1.7: Cognition's Frontier Coding Model at 1000 tok/s on Devin

SWE-1.7 from Cognition scores 42.3% on FrontierCode 1.1 Main — within points of GPT-5.5 and Opus 4.8 at fraction of cost. Kimi K2.7 base, 1000 tok/s in Devin, RL pipeline that challenges the post-training ceiling narrative.

Sep 10, 2026

Marc Andreessen: Devin Writes 90% of Cognition's Production Code

On September 9, 2026, Marc Andreessen published "Investing in Cognition" on a16z — arguing software will eat the world at compute speed now that agents write most code. Cognition says Devin produces 90%+ of its own production commits, up from 13% in a year, with enterprise proof points at Mercedes, Rivian, and Itau. explainx.ai maps the claims, the harness, and the caveats.

Jul 23, 2026

Cognition Acquires Poke Maker Interaction — Devin Meets Texting Agents

Cognition, the company behind Devin, announced on July 23, 2026 that it has acquired The Interaction Company of California, makers of Poke — a texting assistant that lives inside iMessage. It isn't a pivot away from enterprise coding; it's a bet that "always-on cloud agents" is one architecture, not two.