Fastest AI Model Crown Changes Hands: Mercury 3 Hits 1068 tok/s
Inception Labs released Mercury 3, its fourth-generation diffusion LLM, on 2026-10-19. Two numbers grab attention: 1,068 tokens per second of output on NVIDIA GPUs, and 8 wins out of 12 capability benchmarks against the strongest available rivals. This review unpacks the "if." Discipline note: every figure comes from Inception's own comparison table (labeled Inception-reported throughout), and third-party Artificial Analysis had not listed the model at publication; there is also a track record - the previous Mercury made similarly aggressive speed claims and later measured at roughly 60 percent of advertised speed in AA testing (per aibacon). Diffusion LLMs in plain terms: autoregressive models type one token at a time; diffusion models work like a Polaroid, refining a whole block of masked text over denoising rounds and committing many positions per pass - each round costs more than one autoregressive step but locks in many tokens, so throughput depends on positions committed per round. Specs: 1M context (up from 260K on 2.5), 131,072 output cap, undisclosed parameter count (only "40x larger than Mercury 1"), closed-source API with no weights and no technical report. The 12 benchmarks (medium tier, Inception-run): 8 wins - SWE-Bench Atlas 51.08 vs Luna 33.33/Haiku 32.26 (+17.8, largest gap), IFBench 76.84 (+15.0), MultiChallenge +7.9, tau3-bench Banking +7.2, DeepSearchQA +6.1, BrowseComp+ +4.7, GPQA Diamond 89.23 vs 86.36, GDPval 1237.2 Elo; 4 losses listed in full - AA-Omniscience -0.5, AA-LCR v1.1 -0.6, MRCR v2 -2.9, DeepSWE v1 -5.3; the opposite signals on the two coding benchmarks (crushing Atlas while losing DeepSWE) mean coding strength is uneven across task distributions. Wins cluster in the agent execution path - coding, tool calling, browsing, instruction following - where low latency is worth the most money; losses cluster in long-context consistency and knowledge breadth, where speed buys nothing. Outside the table: 50 percent completion on 50 live Mind2Web browser tasks (vendor harness, claimed significantly above GPT-6.1-Sol at equal tokens and steps). Pricing: standard $0.20 input / $0.70 output, launch half price $0.10/$0.35, cached input at a tenth of input rate; the cost comparison attached to the official benchmark table is computed at the promotional rate - re-budget at standard rates; the $0.70 output rate is above rival GPT-6 Luna's $0.50. Access: Inception API / OpenRouter / Baseten / Vercel / Mercury Chat, OpenAI-compatible (base URL swap), 100 million free tokens per new key. Product lines: Mercury Voice (TTFT under 170ms, $0.40/$1.50), Mercury Decide (calibrated probabilities with human escalation, claimed over Jev); Mercury 2/2.5 closed to new customers (existing until 11-15). All testimonials are secondhand from the press release. Verdict: worth trying on free credits for hard latency constraints (real-time voice, glasses-class assistants, high-frequency short-output agent loops); budget-sensitive long-output or real-money production should at least wait for AA to list the model - a company whose previous product measured at six-tenths of advertised speed has earned one extra round of independent verification.