Mmlu Cot

    🏆 Leaderboard

    As of August 20, 2026, Llama 3.1 405B Instruct is #1 for Mmlu Cot at 88.6%. Ranked by the Mmlu Cot score 3 models in this index have a published Mmlu Cot score. Mmlu Cot leaderboard: rank models by Mmlu Cot next to live API token prices.

    Updated August 20, 2026282 models33 providers
    Llama 3.1 405B InstructOSS
    Meta · Open Source
    88.6%$1.78
    Llama 3.1 70B InstructOSS
    Meta · Open Source
    86%$0.40
    Llama 3.1 8B InstructOSS
    Meta · Open Source
    73%$0.06
    ChatGPT-4o Latest
    OpenAI · Proprietary
    $12.50
    Claude 3 Haiku
    Anthropic · Proprietary
    $1.50
    Claude 3 Opus
    Anthropic · Proprietary
    $90.00
    Claude 3 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.5 Haiku
    Anthropic · Proprietary
    $4.80
    Claude 3.5 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.5 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.7 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude Fable 5
    Anthropic · Proprietary
    $60.00
    Claude Haiku 4.5
    Anthropic · Proprietary
    $6.00
    Claude Mythos 5
    Anthropic · Proprietary
    $60.00
    Claude Mythos Preview
    Anthropic · Proprietary
    $60.00
    Claude Opus 4
    Anthropic · Proprietary
    $90.00
    Claude Opus 4.1
    Anthropic · Proprietary
    $90.00
    Claude Opus 4.5
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.6
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.7
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.8
    Anthropic · Proprietary
    $30.00
    Claude Opus 5
    Anthropic · Proprietary
    $30.00
    Claude Sonnet 4
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 4.5
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 4.6
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 5
    Anthropic · Proprietary
    $12.00
    Command A+OSS
    Cohere · Open Source
    $12.50
    Command R+OSS
    Cohere · Open Source
    $1.25
    Composer 2
    Cursor · Proprietary
    $3.00
    Composer 2 Fast
    Cursor · Proprietary
    $9.00
    DeepSeek R1 Distill Llama 70BOSS
    DeepSeek · Open Source
    $0.50
    DeepSeek R1 Distill Qwen 32BOSS
    DeepSeek · Open Source
    $0.30
    DeepSeek-R1OSS
    DeepSeek · Open Source
    $2.74
    DeepSeek-R1-0528OSS
    DeepSeek · Open Source
    $2.74
    DeepSeek-V2.5OSS
    DeepSeek · Open Source
    $0.42
    DeepSeek-V3OSS
    DeepSeek · Open Source
    $1.37
    DeepSeek-V3 0324OSS
    DeepSeek · Open Source
    $1.42
    DeepSeek-V3.1OSS
    DeepSeek · Open Source
    $1.27
    DeepSeek-V3.2OSS
    DeepSeek · Open Source · via OpenRouter
    $0.57
    DeepSeek-V3.2 (Non-thinking)OSS
    DeepSeek · Open Source
    $0.70
    DeepSeek-V3.2-ExpOSS
    DeepSeek · Open Source
    $0.68
    DeepSeek-V4-Flash-0423OSS
    DeepSeek · Open Source
    $0.30
    DeepSeek-V4-Flash-0731OSS
    DeepSeek · Open Source
    $1.76
    DeepSeek-V4-Flash-MaxOSS
    DeepSeek · Open Source
    $0.42
    DeepSeek-V4-Pro-0813OSS
    DeepSeek · Open Source
    $5.28
    DeepSeek-V4-Pro-MaxOSS
    DeepSeek · Open Source
    $5.22
    Devstral Medium
    Mistral · Proprietary · via Mistral AI
    $2.40
    Devstral Small 1.1OSS
    Mistral · Open Source · via Mistral AI
    $0.40
    ERNIE 4.5
    Baidu · Proprietary
    $4.40
    Gemini 1.0 Pro
    Google · Proprietary
    $2.00
    Showing 150 of 282 models

    Next step

    You found the model. Now ship the product.

    Auth, billing, and the API layer are already decided. Fork 8 finished AI apps, or have us build the first version with you.

    The index

    All Large Language Models

    282 models across 33 providers. Search or jump to a lab — every model page stays linked here.

    Baidu

    1 models

    Inception

    1 models

    inclusionAI

    1 models

    LG AI Research

    1 models

    Nous Research

    1 models

    Sakana AI

    1 models

    StepFun

    1 models

    Tencent

    1 models

    Thinking Machines

    1 models

    Unisound

    1 models

    Upstage

    1 models

    Which model leads Mmlu Cot right now?

    As of August 20, 2026, Llama 3.1 405B Instruct by Meta is #1 for Mmlu Cot at 88.6%. Ranked by the Mmlu Cot score This board also tracks Mmlu Cot. Next on the same board: Llama 3.1 70B Instruct and Llama 3.1 8B Instruct. This mmlu cot leaderboard ranks models by Mmlu Cot. Scores come from public evals. Prices are the live API rates in the table above.

    Sources: OpenAI API pricing (https://developers.openai.com/api/docs/pricing); Anthropic Claude API pricing (https://platform.claude.com/docs/en/about-claude/pricing); Gemini API pricing (https://ai.google.dev/gemini-api/docs/pricing)

    Top 3 for mmlu cot. Ranked by the Mmlu Cot score Input and output are dollars per million tokens.
    RankModelMmlu CotInput /MOutput /M
    1Llama 3.1 405B Instruct88.6%$0.89$0.89
    2Llama 3.1 70B Instruct86%$0.20$0.20
    3Llama 3.1 8B Instruct73%$0.03$0.03

    Mmlu Cot FAQ

    Who ranks #1 on the Mmlu Cot leaderboard?

    As of August 20, 2026, Llama 3.1 405B Instruct by Meta ranks #1 on Mmlu Cot at 88.6%. API pricing is $0.89/M input and $0.89/M output.

    What are the top models on Mmlu Cot?

    The current Mmlu Cot ranking as of August 20, 2026 is 1. Llama 3.1 405B Instruct at 88.6%; 2. Llama 3.1 70B Instruct at 86%; 3. Llama 3.1 8B Instruct at 73%.

    Which mmlu cot model is the cheapest?

    Llama 3.1 8B Instruct is the cheapest scored model on this mmlu cot leaderboard at $0.03/M input and $0.03/M output ($0.06 blended). Llama 3.1 405B Instruct still leads Mmlu Cot at 88.6%.

    Should I always pick the #1 Mmlu Cot model?

    Not automatically. Llama 3.1 405B Instruct leads Mmlu Cot, but a cheaper scored model can be the better production choice if the quality gap is small. Use the table to weigh Mmlu Cot against input/output price, context window, and related evals.

    How often is the Mmlu Cot leaderboard updated?

    Scores and API prices on this page are refreshed from published evals and provider rates. The snapshot is labeled August 20, 2026. Treat it as a current index, not a one-off blog post.

    What is Mmlu Cot?

    Mmlu Cot is a public LLM eval (the Mmlu Cot score). This page ranks models that have published a score, next to live API prices.

    Where is the Mmlu Cot leaderboard?

    This page is the Mmlu Cot leaderboard. Models are sorted by Mmlu Cot, with input and output token prices on the same row so you can weigh score against cost. Official boards often omit price; that comparison is the point of this index.

    How is this Mmlu Cot ranking different from the official board?

    Official eval pages own the methodology. This page keeps the published Mmlu Cot score next to live API $/M so you can pick a production SKU, not only a trophy number.