Baseten's Mammoth-1 and Elephant-1 now available on AI Gateway for free
By Steven Van ·
Both Baseten decision models cost nothing on AI Gateway through October 27, and work with the AI SDK, HTTP API and OpenAI- or TypeSafe-compatible clients.
Baseten's Mammoth-1 and Elephant-1 are free on Vercel's AI Gateway for one week, through October 27. Both are decision models, which classify text, route requests and score content against criteria the developer defines.
The two models
- Mammoth-1 is the larger model at 27B parameters. It is #1 on the Jev Decision Index.
- Elephant-1 is a smaller 9B option. It is tied for #1 on the Artificial Analysis Decision Index.
Both support a 16k-token context window and return choices, probabilities and scores.
How decisions work
Several questions can be asked about the same input in one request. A Choice question can select a support team, a Boolean question can check whether a refund is being requested, and a Score question can rate urgency. The application sets the probability threshold for acting automatically or sending a result for review.
The model names are baseten/mammoth-1 and baseten/elephant-1. In the decision documentation, requests go through the AI SDK's experimental_decide (ai 7.0.128 or later), the HTTP API at /v1/evaluate, the OpenAI-compatible Decisions API, or the TypeSafe-compatible API. They are not supported through Chat Completions, Responses, or the Anthropic-compatible or Cohere-compatible endpoints.
Usage tracking
Decision calls appear in AI Gateway logs and count toward budgets alongside other model requests.