Introducing the AI Gateway
By Steven Van ·
The alpha release, built on AI SDK 5, lets developers call about 100 AI models through one key instead of separate provider accounts.
Vercel has opened alpha testing for the Vercel AI Gateway, a new product built on the AI SDK 5 alpha that lets developers switch between around 100 AI models without managing separate API keys, rate limits, or provider accounts. The Gateway handles authentication and usage tracking, with billing planned for later.
Vercel says the goal is to stop locking application code to a single provider or model API at a time when new state-of-the-art models ship almost every week. The Gateway can also load balance across providers, or fail over automatically if one has downtime or degraded performance, and is meant to help developers take advantage of falling model inference costs as providers compete on price.
Vercel built the Gateway out of what it learned load balancing and switching between providers while scaling v0 to millions of users.
