AnotherWrapper
    $249
    LLMImageVideoSpeechTranscription

    Mbpp Evalplus Base

    🏆 Leaderboard

    As of August 20, 2026, Llama 3.1 8B Instruct is #1 for Mbpp Evalplus Base at 72.8%. Ranked by the Mbpp Evalplus Base score 1 models in this index have a published Mbpp Evalplus Base score. Mbpp Evalplus Base leaderboard: rank models by Mbpp Evalplus Base next to live API token prices.

    Updated August 20, 2026282 models33 providers
    Llama 3.1 8B InstructOSS
    Meta · Open Source
    		72.8%$0.06
    ChatGPT-4o Latest
    OpenAI · Proprietary
    		—$12.50
    Claude 3 Haiku
    Anthropic · Proprietary
    		—$1.50
    Claude 3 Opus
    Anthropic · Proprietary
    		—$90.00
    Claude 3 Sonnet
    Anthropic · Proprietary
    		—$18.00
    Claude 3.5 Haiku
    Anthropic · Proprietary
    		—$4.80
    Claude 3.5 Sonnet
    Anthropic · Proprietary
    		—$18.00
    Claude 3.5 Sonnet
    Anthropic · Proprietary
    		—$18.00
    Claude 3.7 Sonnet
    Anthropic · Proprietary
    		—$18.00
    Claude Fable 5
    Anthropic · Proprietary
    		—$60.00
    Claude Haiku 4.5
    Anthropic · Proprietary
    		—$6.00
    Claude Mythos 5
    Anthropic · Proprietary
    		—$60.00
    Claude Mythos Preview
    Anthropic · Proprietary
    		—$60.00
    Claude Opus 4
    Anthropic · Proprietary
    		—$90.00
    Claude Opus 4.1
    Anthropic · Proprietary
    		—$90.00
    Claude Opus 4.5
    Anthropic · Proprietary
    		—$30.00
    Claude Opus 4.6
    Anthropic · Proprietary
    		—$30.00
    Claude Opus 4.7
    Anthropic · Proprietary
    		—$30.00
    Claude Opus 4.8
    Anthropic · Proprietary
    		—$30.00
    Claude Opus 5
    Anthropic · Proprietary
    		—$30.00
    Claude Sonnet 4
    Anthropic · Proprietary
    		—$18.00
    Claude Sonnet 4.5
    Anthropic · Proprietary
    		—$18.00
    Claude Sonnet 4.6
    Anthropic · Proprietary
    		—$18.00
    Claude Sonnet 5
    Anthropic · Proprietary
    		—$12.00
    Command A+OSS
    Cohere · Open Source
    		—$12.50
    Command R+OSS
    Cohere · Open Source
    		—$1.25
    Composer 2
    Cursor · Proprietary
    		—$3.00
    Composer 2 Fast
    Cursor · Proprietary
    		—$9.00
    DeepSeek R1 Distill Llama 70BOSS
    DeepSeek · Open Source
    		—$0.50
    DeepSeek R1 Distill Qwen 32BOSS
    DeepSeek · Open Source
    		—$0.30
    DeepSeek-R1OSS
    DeepSeek · Open Source
    		—$2.74
    DeepSeek-R1-0528OSS
    DeepSeek · Open Source
    		—$2.74
    DeepSeek-V2.5OSS
    DeepSeek · Open Source
    		—$0.42
    DeepSeek-V3OSS
    DeepSeek · Open Source
    		—$1.37
    DeepSeek-V3 0324OSS
    DeepSeek · Open Source
    		—$1.42
    DeepSeek-V3.1OSS
    DeepSeek · Open Source
    		—$1.27
    DeepSeek-V3.2OSS
    DeepSeek · Open Source · via OpenRouter
    		—$0.57
    DeepSeek-V3.2 (Non-thinking)OSS
    DeepSeek · Open Source
    		—$0.70
    DeepSeek-V3.2-ExpOSS
    DeepSeek · Open Source
    		—$0.68
    DeepSeek-V4-Flash-0423OSS
    DeepSeek · Open Source
    		—$0.30
    DeepSeek-V4-Flash-0731OSS
    DeepSeek · Open Source
    		—$1.76
    DeepSeek-V4-Flash-MaxOSS
    DeepSeek · Open Source
    		—$0.42
    DeepSeek-V4-Pro-0813OSS
    DeepSeek · Open Source
    		—$5.28
    DeepSeek-V4-Pro-MaxOSS
    DeepSeek · Open Source
    		—$5.22
    Devstral Medium
    Mistral · Proprietary · via Mistral AI
    		—$2.40
    Devstral Small 1.1OSS
    Mistral · Open Source · via Mistral AI
    		—$0.40
    ERNIE 4.5
    Baidu · Proprietary
    		—$4.40
    Gemini 1.0 Pro
    Google · Proprietary
    		—$2.00
    Gemini 1.5 Flash
    Google · Proprietary
    		—$0.75
    Gemini 1.5 Flash 8B
    Google · Proprietary
    		—$0.37
    Showing 1–50 of 282 models

    Next step

    You found the model. Now ship the product.

    Auth, billing, and the API layer are already decided. Fork 8 finished AI apps, or have us build the first version with you.

    Get the stack — $249Have us build it with you

    The index

    All Large Language Models

    282 models across 33 providers. Search or jump to a lab — every model page stays linked here.

    OpenAI51Anthropic22Google25Cursor2xAI15DeepSeek16MiniMax6Qwen38AI21 Labs2Amazon5Baidu1ByteDance2Cohere3IBM1Inception1inclusionAI1LG AI Research1Meituan4Meta12Microsoft5Mistral23Moonshot AI9Nous Research1NVIDIA5Poolside2Sakana AI1StepFun1Tencent1Thinking Machines1Unisound1Upstage1Xiaomi3Z AI20

    Baidu

    1 models
    ERNIE 4.5

    Inception

    1 models
    Mercury 2

    inclusionAI

    1 models
    Ling-3.0-flash

    LG AI Research

    1 models
    K-EXAONE-236B-A23B

    Nous Research

    1 models
    Hermes 3 70B

    Sakana AI

    1 models
    Sakana Namazu

    StepFun

    1 models
    Step-3.5-Flash

    Tencent

    1 models
    Hy3

    Thinking Machines

    1 models
    Inkling-Small

    Unisound

    1 models
    U2

    Upstage

    1 models
    Solar Pro 4

    Which model leads Mbpp Evalplus Base right now?

    As of August 20, 2026, Llama 3.1 8B Instruct by Meta is #1 for Mbpp Evalplus Base at 72.8%. Ranked by the Mbpp Evalplus Base score This board also tracks Mbpp Evalplus Base. This mbpp evalplus base leaderboard ranks models by Mbpp Evalplus Base. Scores come from public evals. Prices are the live API rates in the table above.

    Sources: OpenAI API pricing (https://developers.openai.com/api/docs/pricing); Anthropic Claude API pricing (https://platform.claude.com/docs/en/about-claude/pricing); Gemini API pricing (https://ai.google.dev/gemini-api/docs/pricing)

    Top 1 for mbpp evalplus base. Ranked by the Mbpp Evalplus Base score Input and output are dollars per million tokens.
    RankModelMbpp Evalplus BaseInput /MOutput /M
    1Llama 3.1 8B Instruct72.8%$0.03$0.03

    Related LLM leaderboards

    LLM LeaderboardCodingMathAgenticReasoningWritingScienceFinanceLong ContextVisionOpen Source

    Individual benchmark pages

    Rank one eval at a time. All LLM benchmarks.

    HLESWE BenchHumanity's Last Exam (No Tools)Humanity's Last Exam (With Tools)Terminal-Bench 2.0Terminal-BenchTerminal-Bench 2.1Terminal-Bench 2Terminal-Bench 3.0ARC-AGI-1 Verified

    Mbpp Evalplus Base FAQ

    Who ranks #1 on the Mbpp Evalplus Base leaderboard?

    As of August 20, 2026, Llama 3.1 8B Instruct by Meta ranks #1 on Mbpp Evalplus Base at 72.8%. API pricing is $0.03/M input and $0.03/M output.

    Which mbpp evalplus base model is the cheapest?

    Llama 3.1 8B Instruct currently leads Mbpp Evalplus Base and is also the cheapest scored model on this page, at $0.03/M input and $0.03/M output ($0.06 blended).

    Should I always pick the #1 Mbpp Evalplus Base model?

    Not automatically. Llama 3.1 8B Instruct leads Mbpp Evalplus Base, but a cheaper scored model can be the better production choice if the quality gap is small. Use the table to weigh Mbpp Evalplus Base against input/output price, context window, and related evals.

    How often is the Mbpp Evalplus Base leaderboard updated?

    Scores and API prices on this page are refreshed from published evals and provider rates. The snapshot is labeled August 20, 2026. Treat it as a current index, not a one-off blog post.

    What is Mbpp Evalplus Base?

    Mbpp Evalplus Base is a public LLM eval (the Mbpp Evalplus Base score). This page ranks models that have published a score, next to live API prices.

    Where is the Mbpp Evalplus Base leaderboard?

    This page is the Mbpp Evalplus Base leaderboard. Models are sorted by Mbpp Evalplus Base, with input and output token prices on the same row so you can weigh score against cost. Official boards often omit price; that comparison is the point of this index.

    How is this Mbpp Evalplus Base ranking different from the official board?

    Official eval pages own the methodology. This page keeps the published Mbpp Evalplus Base score next to live API $/M so you can pick a production SKU, not only a trophy number.