Skip to main content

AI Gateway supports OpenAI's Responses API

By Steven Van ·

Developers can now call the Responses API directly through AI Gateway, in TypeScript or Python, instead of going through the AI SDK or Chat Completions API.

Vercel's AI Gateway now supports OpenAI's Responses API, a newer alternative to the Chat Completions API. Developers point their OpenAI SDK at AI Gateway's base URL and use provider/model names to route requests to OpenAI, Anthropic, Google and other supported providers, in TypeScript or Python.

The functionality was already reachable through AI Gateway via the AI SDK and Chat Completions API, but the Responses API can now be called directly. It covers:

  • Text generation and streaming: send prompts, get responses, stream tokens as they arrive
  • Tool calling: define functions the model can invoke, then feed results back
  • Structured output: constrain responses to a JSON schema
  • Reasoning: control how much effort the model spends thinking, with configurable effort levels
Vercel
Vercel
The platform for frontend developers — deploy, preview, and scale web apps and AI agents with zero config.
View Vercel →

Read the original announcement →

Read AI Gateway supports OpenAI's Responses API on Creators Toolbox