Mbpp

    ๐Ÿ† Leaderboard

    As of August 20, 2026, Qwen2.5-Coder 32B Instruct is #1 for Mbpp at 90.2%. Ranked by the Mbpp score 15 models in this index have a published Mbpp score. Mbpp leaderboard: rank models by Mbpp next to live API token prices.

    Updated August 20, 2026282 models33 providers
    Qwen2.5-Coder 32B InstructOSS
    Qwen ยท Open Source
    90.2%$0.18
    Qwen2.5 72B InstructOSS
    Qwen ยท Open Source
    88.2%$0.75
    Qwen3 235B A22BOSS
    Qwen ยท Open Source
    81.4%$0.20
    Qwen2.5 7B InstructOSS
    Qwen ยท Open Source
    79.2%$0.60
    Llama 4 MaverickOSS
    Meta ยท Open Source
    77.6%$1.02
    Mistral Small 3.1 24B InstructOSS
    Mistral ยท Open Source ยท via OpenRouter
    74.7%$0.91
    Gemma 3 27BOSS
    Google ยท Open Source
    74.4%$0.30
    MiMo-V2.5-ProOSS
    Xiaomi ยท Open Source
    74.1%$1.30
    Gemma 3 12BOSS
    Google ยท Open Source
    73%$0.15
    Phi-3.5-mini-instructOSS
    Microsoft ยท Open Source
    69.6%$0.20
    Llama 4 ScoutOSS
    Meta ยท Open Source
    67.8%$0.38
    Gemma 3n E4B Instructed
    Google ยท Proprietary
    63.6%$60.00
    Gemma 3 4BOSS
    Google ยท Open Source
    63.2%$0.06
    Gemma 2 27BOSS
    Google ยท Open Source ยท via OpenRouter
    62.6%$1.30
    ERNIE 4.5
    Baidu ยท Proprietary
    40.2%$4.40
    ChatGPT-4o Latest
    OpenAI ยท Proprietary
    โ€”$12.50
    Claude 3 Haiku
    Anthropic ยท Proprietary
    โ€”$1.50
    Claude 3 Opus
    Anthropic ยท Proprietary
    โ€”$90.00
    Claude 3 Sonnet
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude 3.5 Haiku
    Anthropic ยท Proprietary
    โ€”$4.80
    Claude 3.5 Sonnet
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude 3.5 Sonnet
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude 3.7 Sonnet
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude Fable 5
    Anthropic ยท Proprietary
    โ€”$60.00
    Claude Haiku 4.5
    Anthropic ยท Proprietary
    โ€”$6.00
    Claude Mythos 5
    Anthropic ยท Proprietary
    โ€”$60.00
    Claude Mythos Preview
    Anthropic ยท Proprietary
    โ€”$60.00
    Claude Opus 4
    Anthropic ยท Proprietary
    โ€”$90.00
    Claude Opus 4.1
    Anthropic ยท Proprietary
    โ€”$90.00
    Claude Opus 4.5
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Opus 4.6
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Opus 4.7
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Opus 4.8
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Opus 5
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Sonnet 4
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude Sonnet 4.5
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude Sonnet 4.6
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude Sonnet 5
    Anthropic ยท Proprietary
    โ€”$12.00
    Command A+OSS
    Cohere ยท Open Source
    โ€”$12.50
    Command R+OSS
    Cohere ยท Open Source
    โ€”$1.25
    Composer 2
    Cursor ยท Proprietary
    โ€”$3.00
    Composer 2 Fast
    Cursor ยท Proprietary
    โ€”$9.00
    DeepSeek R1 Distill Llama 70BOSS
    DeepSeek ยท Open Source
    โ€”$0.50
    DeepSeek R1 Distill Qwen 32BOSS
    DeepSeek ยท Open Source
    โ€”$0.30
    DeepSeek-R1OSS
    DeepSeek ยท Open Source
    โ€”$2.74
    DeepSeek-R1-0528OSS
    DeepSeek ยท Open Source
    โ€”$2.74
    DeepSeek-V2.5OSS
    DeepSeek ยท Open Source
    โ€”$0.42
    DeepSeek-V3OSS
    DeepSeek ยท Open Source
    โ€”$1.37
    DeepSeek-V3 0324OSS
    DeepSeek ยท Open Source
    โ€”$1.42
    DeepSeek-V3.1OSS
    DeepSeek ยท Open Source
    โ€”$1.27
    Showing 1โ€“50 of 282 models

    Next step

    You found the model. Now ship the product.

    Auth, billing, and the API layer are already decided. Fork 8 finished AI apps, or have us build the first version with you.

    The index

    All Large Language Models

    282 models across 33 providers. Search or jump to a lab โ€” every model page stays linked here.

    Baidu

    1 models

    Inception

    1 models

    inclusionAI

    1 models

    LG AI Research

    1 models

    Nous Research

    1 models

    Sakana AI

    1 models

    StepFun

    1 models

    Tencent

    1 models

    Thinking Machines

    1 models

    Unisound

    1 models

    Upstage

    1 models

    Which model leads Mbpp right now?

    As of August 20, 2026, Qwen2.5-Coder 32B Instruct by Qwen is #1 for Mbpp at 90.2%. Ranked by the Mbpp score This board also tracks Mbpp. Next on the same board: Qwen2.5 72B Instruct and Qwen3 235B A22B. This mbpp leaderboard ranks models by Mbpp. Scores come from public evals. Prices are the live API rates in the table above.

    Sources: OpenAI API pricing (https://developers.openai.com/api/docs/pricing); Anthropic Claude API pricing (https://platform.claude.com/docs/en/about-claude/pricing); Gemini API pricing (https://ai.google.dev/gemini-api/docs/pricing)

    Top 8 for mbpp. Ranked by the Mbpp score Input and output are dollars per million tokens.
    RankModelMbppInput /MOutput /M
    1Qwen2.5-Coder 32B Instruct90.2%$0.09$0.09
    2Qwen2.5 72B Instruct88.2%$0.35$0.40
    3Qwen3 235B A22B81.4%$0.10$0.10
    4Qwen2.5 7B Instruct79.2%$0.30$0.30
    5Llama 4 Maverick77.6%$0.17$0.85
    6Mistral Small 3.1 24B Instruct74.7%$0.35$0.56
    7Gemma 3 27B74.4%$0.10$0.20
    8MiMo-V2.5-Pro74.1%$0.43$0.87

    Mbpp FAQ

    Who ranks #1 on the Mbpp leaderboard?

    As of August 20, 2026, Qwen2.5-Coder 32B Instruct by Qwen ranks #1 on Mbpp at 90.2%. API pricing is $0.09/M input and $0.09/M output.

    What are the top models on Mbpp?

    The current Mbpp ranking as of August 20, 2026 is 1. Qwen2.5-Coder 32B Instruct at 90.2%; 2. Qwen2.5 72B Instruct at 88.2%; 3. Qwen3 235B A22B at 81.4%.

    Which mbpp model is the cheapest?

    Gemma 3 4B is the cheapest scored model on this mbpp leaderboard at $0.02/M input and $0.04/M output ($0.06 blended). Qwen2.5-Coder 32B Instruct still leads Mbpp at 90.2%.

    Should I always pick the #1 Mbpp model?

    Not automatically. Qwen2.5-Coder 32B Instruct leads Mbpp, but a cheaper scored model can be the better production choice if the quality gap is small. Use the table to weigh Mbpp against input/output price, context window, and related evals.

    How often is the Mbpp leaderboard updated?

    Scores and API prices on this page are refreshed from published evals and provider rates. The snapshot is labeled August 20, 2026. Treat it as a current index, not a one-off blog post.

    What is Mbpp?

    Mbpp is a public LLM eval (the Mbpp score). This page ranks models that have published a score, next to live API prices.

    Where is the Mbpp leaderboard?

    This page is the Mbpp leaderboard. Models are sorted by Mbpp, with input and output token prices on the same row so you can weigh score against cost. Official boards often omit price; that comparison is the point of this index.

    How is this Mbpp ranking different from the official board?

    Official eval pages own the methodology. This page keeps the published Mbpp score next to live API $/M so you can pick a production SKU, not only a trophy number.