SWE Bench

    🏆 Leaderboard

    As of August 20, 2026, Gemini 3 Pro is #1 for SWE Bench at 76.2%. Ranked by the SWE Bench score 8 models in this index have a published SWE Bench score. Methodology: SWE-bench leaderboards (https://www.swebench.com/). SWE Bench leaderboard with live API prices. SWE-bench — evaluates models on real-world GitHub issues requiring code changes across entire repositories. Official methodology: SWE-bench leaderboards (https://www.swebench.com/).

    Updated August 20, 2026282 models33 providers
    Gemini 3 Pro
    Google · Proprietary
    76.2%$14.00
    Grok-4
    xAI · Proprietary
    75%$18.00
    o4-mini
    OpenAI · Proprietary
    68.1%$5.50
    o3-mini
    OpenAI · Proprietary
    61%$5.50
    Gemini 2.5 Pro
    Google · Proprietary
    59.6%$11.25
    Gemini 2.0 Flash
    Google · Proprietary
    51.8%$0.50
    DeepSeek-R1OSS
    DeepSeek · Open Source
    49.2%$2.74
    DeepSeek-V3OSS
    DeepSeek · Open Source
    38.8%$1.37
    ChatGPT-4o Latest
    OpenAI · Proprietary
    $12.50
    Claude 3 Haiku
    Anthropic · Proprietary
    $1.50
    Claude 3 Opus
    Anthropic · Proprietary
    $90.00
    Claude 3 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.5 Haiku
    Anthropic · Proprietary
    $4.80
    Claude 3.5 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.5 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.7 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude Fable 5
    Anthropic · Proprietary
    $60.00
    Claude Haiku 4.5
    Anthropic · Proprietary
    $6.00
    Claude Mythos 5
    Anthropic · Proprietary
    $60.00
    Claude Mythos Preview
    Anthropic · Proprietary
    $60.00
    Claude Opus 4
    Anthropic · Proprietary
    $90.00
    Claude Opus 4.1
    Anthropic · Proprietary
    $90.00
    Claude Opus 4.5
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.6
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.7
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.8
    Anthropic · Proprietary
    $30.00
    Claude Opus 5
    Anthropic · Proprietary
    $30.00
    Claude Sonnet 4
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 4.5
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 4.6
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 5
    Anthropic · Proprietary
    $12.00
    Command A+OSS
    Cohere · Open Source
    $12.50
    Command R+OSS
    Cohere · Open Source
    $1.25
    Composer 2
    Cursor · Proprietary
    $3.00
    Composer 2 Fast
    Cursor · Proprietary
    $9.00
    DeepSeek R1 Distill Llama 70BOSS
    DeepSeek · Open Source
    $0.50
    DeepSeek R1 Distill Qwen 32BOSS
    DeepSeek · Open Source
    $0.30
    DeepSeek-R1-0528OSS
    DeepSeek · Open Source
    $2.74
    DeepSeek-V2.5OSS
    DeepSeek · Open Source
    $0.42
    DeepSeek-V3 0324OSS
    DeepSeek · Open Source
    $1.42
    DeepSeek-V3.1OSS
    DeepSeek · Open Source
    $1.27
    DeepSeek-V3.2OSS
    DeepSeek · Open Source · via OpenRouter
    $0.57
    DeepSeek-V3.2 (Non-thinking)OSS
    DeepSeek · Open Source
    $0.70
    DeepSeek-V3.2-ExpOSS
    DeepSeek · Open Source
    $0.68
    DeepSeek-V4-Flash-0423OSS
    DeepSeek · Open Source
    $0.30
    DeepSeek-V4-Flash-0731OSS
    DeepSeek · Open Source
    $1.76
    DeepSeek-V4-Flash-MaxOSS
    DeepSeek · Open Source
    $0.42
    DeepSeek-V4-Pro-0813OSS
    DeepSeek · Open Source
    $5.28
    DeepSeek-V4-Pro-MaxOSS
    DeepSeek · Open Source
    $5.22
    Devstral Medium
    Mistral · Proprietary · via Mistral AI
    $2.40
    Showing 150 of 282 models

    Next step

    You found the model. Now ship the product.

    Auth, billing, and the API layer are already decided. Fork 8 finished AI apps, or have us build the first version with you.

    The index

    All Large Language Models

    282 models across 33 providers. Search or jump to a lab — every model page stays linked here.

    Baidu

    1 models

    Inception

    1 models

    inclusionAI

    1 models

    LG AI Research

    1 models

    Nous Research

    1 models

    Sakana AI

    1 models

    StepFun

    1 models

    Tencent

    1 models

    Thinking Machines

    1 models

    Unisound

    1 models

    Upstage

    1 models

    Which model leads SWE Bench right now?

    As of August 20, 2026, Gemini 3 Pro by Google is #1 for SWE Bench at 76.2%. Ranked by the SWE Bench score This board also tracks SWE Bench. Next on the same board: Grok-4 and o4-mini. This swe bench leaderboard ranks models by SWE Bench. Scores come from public evals. Prices are the live API rates in the table above.

    Sources: SWE-bench leaderboards (https://www.swebench.com/); OpenAI API pricing (https://developers.openai.com/api/docs/pricing); Anthropic Claude API pricing (https://platform.claude.com/docs/en/about-claude/pricing); Gemini API pricing (https://ai.google.dev/gemini-api/docs/pricing)

    Top 8 for swe bench. Ranked by the SWE Bench score Input and output are dollars per million tokens.
    RankModelSWE BenchInput /MOutput /M
    1Gemini 3 Pro76.2%$2.00$12.00
    2Grok-475%$3.00$15.00
    3o4-mini68.1%$1.10$4.40
    4o3-mini61%$1.10$4.40
    5Gemini 2.5 Pro59.6%$1.25$10.00
    6Gemini 2.0 Flash51.8%$0.10$0.40
    7DeepSeek-R149.2%$0.55$2.19
    8DeepSeek-V338.8%$0.27$1.10

    SWE Bench FAQ

    Who ranks #1 on the SWE Bench leaderboard?

    As of August 20, 2026, Gemini 3 Pro by Google ranks #1 on SWE Bench at 76.2%. API pricing is $2.00/M input and $12.00/M output.

    What are the top models on SWE Bench?

    The current SWE Bench ranking as of August 20, 2026 is 1. Gemini 3 Pro at 76.2%; 2. Grok-4 at 75%; 3. o4-mini at 68.1%.

    Which swe bench model is the cheapest?

    Gemini 2.0 Flash is the cheapest scored model on this swe bench leaderboard at $0.10/M input and $0.40/M output ($0.50 blended). Gemini 3 Pro still leads SWE Bench at 76.2%.

    Should I always pick the #1 SWE Bench model?

    Not automatically. Gemini 3 Pro leads SWE Bench, but a cheaper scored model can be the better production choice if the quality gap is small. Use the table to weigh SWE Bench against input/output price, context window, and related evals.

    How often is the SWE Bench leaderboard updated?

    Scores and API prices on this page are refreshed from published evals and provider rates. The snapshot is labeled August 20, 2026. Treat it as a current index, not a one-off blog post.

    What is SWE Bench?

    SWE-bench — evaluates models on real-world GitHub issues requiring code changes across entire repositories. This page ranks models that have published a SWE Bench score, with live API token prices on the same row. Official methodology: SWE-bench leaderboards (https://www.swebench.com/).

    Where is the SWE Bench leaderboard?

    This page is the SWE Bench leaderboard. Models are sorted by SWE Bench, with input and output token prices on the same row so you can weigh score against cost. Official boards often omit price; that comparison is the point of this index.

    How is this SWE Bench ranking different from the official board?

    The official SWE-bench leaderboards page owns the methodology. This page keeps the published SWE Bench score next to live API $/M so you can pick a production SKU, not only a trophy number. Source: https://www.swebench.com/