Skip to main content

GPT-6.1 Sol is now available in Devin

By Steven Van ·

GPT-6.1 Sol matches GPT-6 Sol on Devin's FrontierCode 1.1 benchmark at 44% to 57% lower cost per task, in Devin Desktop and CLI.

OpenAI's GPT-6.1 Sol is now live in Devin Desktop and Devin CLI, according to Devin.

Benchmark results

On FrontierCode 1.1, Devin's proprietary benchmark that grades models on real-world engineering tasks based on quality and mergeability, GPT-6.1 Sol scores 60.4%. That is in line with GPT-6 Sol (60.7%) and GPT-5.6 Sol (60.6%).

Cost per task

  • At medium reasoning effort, GPT-6.1 Sol costs $0.31 per task. GPT-6 Sol spends $1.66 at max effort to reach its best score, so this is 81% less.
  • Across every effort level, GPT-6.1 Sol runs 44% to 57% cheaper per task than GPT-6 Sol, while landing within a point of it or ahead.

Low effort

At low effort, GPT-6.1 Sol scores 58.1% for $0.21 per task, up from 50.5% for GPT-6 Sol at the same setting. Devin says this is the highest score of any model under $0.30 per task on the FrontierCode leaderboard.

Pricing

The list price is the same $2/$10 as GPT-6 Sol, but cache reads are now 95% off.

Devin
Devin
AI software engineering agent for building features, fixing bugs, reviewing code, and handling work across repositories.
View Devin →
Sources

Original source

Read GPT-6.1 Sol is now available in Devin on Creators Toolbox