In 2026, OpenAI's in-house AI chip is within sight of the goal line. According to multiple media reports, the inference-focused chip is codenamed Jalapeño, co-designed with Broadcom and fabricated by TSMC, with the aim of running ChatGPT, reasoning models, and agents on OpenAI's own silicon — and buying fewer Nvidia GPUs. From the project's 2024 kickoff and the poaching of Google's TPU team, to tape-out now imminent, OpenAI has formally joined the custom-silicon club.
Background: From Buying Cards to Building Chips
In October 2024, Reuters first reported that OpenAI was working with Broadcom on its first custom chip, and had hired Google TPU veteran Richard Ho to lead the hardware team. At the time, OpenAI's compute was almost entirely Nvidia: H100s for training, H100s and the follow-on Blackwells for inference, with each H100 reportedly priced around $30,000 and chronically supply-constrained. The bigger pain was inference cost — once ChatGPT crossed a hundred million users, every query was real money, and inference spend had overtaken training as OpenAI's heaviest bill.
Jalapeño's mandate is clear: inference first, training later. Training stays on Nvidia's top-tier GPU clusters; the inference workload — the largest and most expensive slice — is what the in-house chip is built to absorb. This tracks with the Stargate project OpenAI announced in early 2025: a $500 billion, four-year compute buildout with SoftBank and Oracle, aimed at grabbing the compute lifeline with both hands. Jalapeño is a key piece on that board.
Why Self-Develop
Three reasons, each harder than the last.
First, cost. A general-purpose GPU is a Swiss Army knife — good at everything, optimal at nothing. An application-specific accelerator (ASIC) tailored to your own model architecture can deliver materially better performance per dollar on inference. Google's internal data has long shown that TPUs running its own models beat general GPUs on price-performance by a wide margin.
Second, supply. Nvidia's near-monopoly means H100s and Blackwells are perpetually sold out, with lead times measured in months. For a company of OpenAI's scale, betting everything on a single supplier is a systemic risk. An in-house chip is a second supply line.
Third, strategic leverage. Chips are the power grid of the AI era; whoever controls compute controls pricing and iteration pace. OpenAI doesn't want to remain Nvidia's super-customer — it wants vertical integration across models, chips, and data centers. That is the real reason it raided Google's TPU team: a decade of custom-silicon know-how that money alone cannot buy. Conversely, the cost of not building chips is stark: the compute bill stays in someone else's hands, model iteration bends to GPU lead times, and pricing power follows the supply chain.
Alongside Google TPU and Amazon Trainium
Custom AI silicon isn't OpenAI's invention — it's table stakes for hyperscalers. The landscape:
| Company | Chip | Focus | Status |
|---|---|---|---|
| TPU (now v5/v6) | Training + inference | A decade in-house; runs Gemini, Search, full stack | |
| Amazon | Trainium (Trn2/Trn3) | Inference-led | Used internally; Anthropic and others onboard |
| AMD | MI300/MI400 series | General accelerator | Targets open models and large customers |
| Meta | MTIA | Inference + ranking | Deployed in recommendation and AI workloads |
| Microsoft | Maia | Inference | Powers Copilot and Azure |
| OpenAI | Jalapeño (reported codename) | Inference | Taping out; mass production expected 2026 |
Google is the granddaddy here — TPU is on its sixth generation, running the entire Gemini lineup and Search on its own silicon. Amazon's Trainium already serves external customers like Anthropic, turning into a sell-compute business. Meta and Microsoft each have their wins. OpenAI is a late entrant, but its model scale and inference traffic are among the world's largest, so once Jalapeño works the scale effects will compound fast. The gap: rivals have a decade of head start; OpenAI is starting from zero, and the first generation is more likely validation and proving ground than a real Nvidia replacement — that waits for later iterations.
Impact on Developers and API Pricing
For developers, the direct question is: will the API get cheaper?
Probably yes, but not overnight. Inference cost is the core variable in OpenAI's pricing — the o-series reasoning models are expensive precisely because every answer burns heavy inference compute. Once a dedicated chip like Jalapeño compresses unit inference cost, OpenAI has room to do two things: cut API prices directly, and make the pricier reasoning profiles (long context, multi-step agents) affordable. That's a concrete win for builders doing agents and long-chain reasoning.
But there's a catch. In-house silicon means OpenAI's compute stack gets more closed, not less. Developers still consume via its API — there's no self-hosting here, unlike with open-weight models. Real downward pressure on price still has to come from the open-source camp (Kimi K3, DeepSeek) and from Google and Amazon competing in parallel. What Jalapeño gives OpenAI is room to cut; how much of that room it passes on depends on how hard the competition pushes.
What It Means for the Compute Landscape
Zoom out, and Jalapeño is less a chip than a signal: the AI compute landscape is loosening.
For two years Nvidia has feasted on the H100 and Blackwell boom, its market cap briefly touching $3 trillion. But hyperscalers won't let that margin sit with a middleman forever — Google, Amazon, Meta, Microsoft, and now OpenAI are all building their own chips. The trend is plain: training stays on Nvidia's general-purpose GPUs for the near term, while the ever-larger inference slice gets eaten by dedicated ASICs. The compute market is splitting from "Nvidia takes all" into "GPUs train, ASICs infer."
For OpenAI, Jalapeño is the first step from model company to compute company. Models, chips, and data centers (Stargate) lock together into a complete, vertically integrated moat. There's a geopolitical wrinkle too — in-house chips still depend on TSMC's fabs, so US export controls and Taiwan risk remain the sword overhead; but at least that sword no longer sits in Nvidia's hand alone.
Nvidia's moat isn't breached yet. But outside the moat, a row of people have shown up with their own shovels. How deep Jalapeño can dig will be settled by the real-world bill once mass production lands in 2026: only when it actually runs OpenAI's own reasoning models and the per-token cost truly drops will the first step count as landed.
References
- OpenAI Stargate announcement (OpenAI official): https://openai.com/index/stargate/
- Reuters: OpenAI works with Broadcom on first custom AI chip (October 2024): https://www.reuters.com/technology/artificial-intelligence/
- Google Cloud TPU product page: https://cloud.google.com/tpu
- AWS Trainium product page: https://aws.amazon.com/machine-learning/trainium/
- Broadcom custom AI accelerators (XPU): https://www.broadcom.com/products/artificial-intelligence