OmniRoute: The Free AI Gateway With 231 Providers, Token Compression, and Claude Code Fallback
OmniRoute v3.8.42 is a local-first AI gateway — 231 providers, 50+ free tiers, RTK + Caveman compression saving 15–95% tokens, 17 routing strategies, and one OpenAI-compatible endpoint for Claude Code, Cursor, Codex, and 16+ agents.
Rate limits, subscription quotas, and $70/month model bills are the background noise of coding with frontier AI in July 2026 — especially after Fable 5's relaunch brought classifiers and a July 7 credits cliff.
OmniRoute (v3.8.42, ~9.8k GitHub stars) is a local-first answer: one OpenAI-compatible gateway on http://localhost:20128/v1, 231 providers, 50+ free tiers, 17 routing strategies, and RTK + Caveman compression that claims 15–95% token savings — without sending prompts through a vendor's cloud router.
TL;DR
What it is
MIT local AI gateway + dashboard — fork lineage from 9router / CLIProxyAPI
When quota runs out or a provider fails, the combo slides to the next model in milliseconds — circuit breakers, per-key cooldowns, and model lockouts keep one bad key from killing the chain.
Flagship Feature: Combos and auto
A combo is an ordered chain of models. OmniRoute's auto modes build virtual combos from connected providers scored live:
Model ID
Optimizes for
auto
Balanced default (LKGP — last good provider stickiness)
auto/coding
Quality-first for code
auto/fast
Lowest latency
auto/cheap
Cheapest per token
auto/offline
Most quota headroom
auto/smart
Quality + 10% exploration
Example combo (from OmniRoute docs):
cc/claude-opus-4-7 — drain subscription first
cx/gpt-5.5 — second subscription
glm/glm-5.1 — cheap backup
kr/claude-sonnet-4.5 — free tier, always on
For Fable-heavy workflows, combos let you reserve frontier models for hard tasks and route volume work to Sonnet-class or free pools.
Token Compression — RTK + Caveman
Every request can pass through nine composable engines (session dedup, CCR archival, RTK, Headroom tabular compaction, Caveman, LLMLingua-2 ONNX, etc.).
Why it matters now: Opus fallbacks and long Claude Code agent loops multiply token burn. OmniRoute cites 78–95% savings when RTK and Caveman both act on tool-heavy payloads.
Mode
Typical savings
Use case
Lite
~15%
Always-on safe default
Standard (Caveman)
~30%
Daily coding
RTK
60–90%
Shell / test / git output
Stacked (RTK → Caveman)
78–95%
Mixed prompts + tool logs
Code blocks, URLs, and structured JSON stay byte-perfect — compression targets prose and repetitive tool output, not your source files.
Free Tier Aggregation
OmniRoute's dashboard shows ~1.6B documented free tokens/month (pool-deduped, not inflated by stacking rate limits). Highlights from the free-forever list:
Qoder AI — Kimi-K2, DeepSeek-R1, unlimited free tier
OmniRoute ships omniroute setup wizards for Claude Code, Codex, Cursor, Cline, Continue, Roo, Kilo, OpenCode, and more — plus omniroute launch-codex zero-config launchers.
MCP integration — expose the gateway to agents:
bash
claude mcp add-server omniroute --type http --url http://localhost:20128/api/mcp/stream
87 MCP tools cover routing, providers, combos, compression, memory, evals — agents can reconfigure the gateway autonomously. See What Is MCP for protocol context.