Why inference is becoming a commodity

Right now, if you want Claude or Codex to write code for you, your options are a subscription with usage caps and rate limits, or the API direct — no caps, but a heavy day swings from $5 to $30 with no ceiling. Either way one company sets the price, and you pay it or you don’t get to use the model.

It doesn’t have to work that way.

The problem: monopoly pricing

Today’s inference market is a collection of monopolies. OpenAI sets GPT’s price, Anthropic sets Claude’s, Google sets Gemini’s. There’s no competition on price for the same model — if you want Claude Opus, you pay Anthropic’s price, period.

But two things are true that most people haven’t internalized: frontier models are temporary monopolies, and open-weight models are commodities. And commodities get cheaper when markets are allowed to work. Open-weight models now trail frontier proprietary models by only a few months, and the gap closes with every release.

The 1,000x cost collapse

The cost of inference has dropped roughly 1,000x in three years. Equivalent quality that cost hundreds of dollars per million tokens in early 2023 costs cents today. Four factors compound — hardware, software optimization, model architecture, and quantization — each multiplying the others.

But who captures those savings today? The providers. The actual cost to serve a token — electricity, amortized GPU, bandwidth — is a fraction of the list price. The difference is margin and the absence of competition.

The solution: a two-sided marketplace

Picture inference that works like a commodity exchange:

Supply side. Anyone with GPU capacity registers as a provider, runs an open model, and sets their price per million tokens.
Demand side. Developers and agents submit requests specifying the model, their latency requirements, and the most they’re willing to pay. They don’t care who serves it — only that the model is correct, the latency is acceptable, and the price is the best available.
The routing layer. Sits between the two: tracks provider quality, latency, throughput, and reliability, and routes each request to the best provider within the user’s constraints — settling payment per request at machine speed.

This is how every other fungible market works — electricity, bandwidth, compute. A token generated by a given open model on cluster A is identical to one from cluster B. When the product is fungible, the market drives price toward marginal cost.

What this means for developers

In a competitive marketplace with many providers bidding to serve the same open model:

Open-weight models get several times cheaper as price converges on marginal cost.
Smart routing eliminates waste. “Write a unit test” goes to a cheap commodity model; “architect this distributed system” goes to a frontier model. Frontier quality where you need it, commodity pricing everywhere else.
The blended math changes. If 80% of your tokens go to commodity models and 20% to frontier, your blended cost drops dramatically versus paying frontier rates for everything — a month of intensive AI-assisted coding can land in the low tens of dollars, with no caps, rate limits, or throttling.

Crucially, that price doesn’t depend on subsidy. It’s what the free market puts on inference, and it trends down over time, not up.

The subsidy trap

Today’s consumer pricing from the major providers isn’t a service — it’s customer acquisition. The cheap tiers lose money on purpose: hook users, build dependency, then raise prices and reserve the best models for premium plans. It’s the classic playbook, and it only works when there’s no alternative.

An open marketplace is the alternative. When model weights are public and anyone can serve them, the subscription lock-in breaks. You’re not paying for access to a proprietary model — you’re paying for compute, and compute is a commodity.

The trust question

The obvious objection: how do I know some random provider is actually running the correct model, unmodified?

UsePod’s answer today is reputation plus benchmark canaries: providers accrue a reputation score from real request outcomes, and a small fraction of traffic is sampled as a hidden canary whose output is checked for deviation — catching providers that misreport what they serve. Bonds give that enforcement teeth. See Trust & reputation for how it works in production.

Stronger, hardware-level guarantees — cryptographic attestation that a specific model ran on specific hardware — are on the roadmap, not shipped. That’s covered in Verification is the product.

The bigger picture

The centralized API model — a handful of companies setting prices and terms for the whole industry — is a temporary artifact of proprietary models and few providers. As open models reach parity, value shifts from “who has the best model” to “who serves it cheapest and most reliably.” That’s a commodity market, and commodity markets have one inevitable outcome: the price drops to the cost of production.

The companies that win that world aren’t the ones running the GPUs. They’re the ones building the routing, reputation, verification, and payment infrastructure that makes the market work — so a developer or an agent can reach any model, from any provider, at the best available price.

Ready to try it? Start with the Quickstart.