How we rebuilt provider routing for better, faster inference

OpenRouter has changed its default provider routing to weigh cost, speed and reliability instead of sending most traffic to the cheapest provider. It monitors provider endpoints and adjusts routing for each new request, with no code changes needed.

OpenRouter reports a 16.9% improvement in time to first token, a 16.3% improvement in throughput and a 67% reduction in capacity errors, alongside a 6.0% increase in cost.

If price is your priority, price-only routing is still available by pinning and sorting providers.