Skip to main content

AI Gateway: Production-ready reliability for your AI apps

By Steven Van ·

Vercel's AI Gateway exits beta, promising automatic failover between LLM providers for production AI apps.

Vercel's Vercel AI Gateway is now generally available, moving out of the reliability layer teams previously had to build themselves when connecting directly to a single LLM provider. If that provider goes down or hits a rate limit, the app connected directly to it goes down too; AI Gateway is built to keep serving requests through those failures instead.

Vercel says it's the same system that has powered v0.app for millions of users, and is now described as battle-tested and stable for production use by customers. The pitch is aimed at teams that want to switch between models to stay on the best available one without getting locked into a single vendor, without having to hand-roll failure handling, per-provider key management, and spend tracking across separate dashboards themselves.

It builds on the AI SDK, which Vercel says now sees more than 2 million downloads a week and powers apps including Browserbase and Perplexity.

Vercel
Vercel
The platform for frontend developers — deploy, preview, and scale web apps and AI agents with zero config.
View Vercel →

Original source

Read AI Gateway: Production-ready reliability for your AI apps on Creators Toolbox