Agieval

    ๐Ÿ† Leaderboard

    As of August 20, 2026, Hermes 3 70B is #1 for Agieval at 56.2%. Ranked by the Agieval score 4 models in this index have a published Agieval score. Agieval leaderboard: rank models by Agieval next to live API token prices.

    Updated August 20, 2026282 models33 providers
    Hermes 3 70BOSS
    Nous Research ยท Open Source
    56.2%$1.75
    Gemma 2 27BOSS
    Google ยท Open Source ยท via OpenRouter
    55.1%$1.30
    Ministral 8B InstructOSS
    Mistral ยท Open Source ยท via Mistral AI
    48.3%$0.20
    ERNIE 4.5
    Baidu ยท Proprietary
    28.5%$4.40
    ChatGPT-4o Latest
    OpenAI ยท Proprietary
    โ€”$12.50
    Claude 3 Haiku
    Anthropic ยท Proprietary
    โ€”$1.50
    Claude 3 Opus
    Anthropic ยท Proprietary
    โ€”$90.00
    Claude 3 Sonnet
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude 3.5 Haiku
    Anthropic ยท Proprietary
    โ€”$4.80
    Claude 3.5 Sonnet
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude 3.5 Sonnet
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude 3.7 Sonnet
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude Fable 5
    Anthropic ยท Proprietary
    โ€”$60.00
    Claude Haiku 4.5
    Anthropic ยท Proprietary
    โ€”$6.00
    Claude Mythos 5
    Anthropic ยท Proprietary
    โ€”$60.00
    Claude Mythos Preview
    Anthropic ยท Proprietary
    โ€”$60.00
    Claude Opus 4
    Anthropic ยท Proprietary
    โ€”$90.00
    Claude Opus 4.1
    Anthropic ยท Proprietary
    โ€”$90.00
    Claude Opus 4.5
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Opus 4.6
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Opus 4.7
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Opus 4.8
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Opus 5
    Anthropic ยท Proprietary
    โ€”$30.00
    Claude Sonnet 4
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude Sonnet 4.5
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude Sonnet 4.6
    Anthropic ยท Proprietary
    โ€”$18.00
    Claude Sonnet 5
    Anthropic ยท Proprietary
    โ€”$12.00
    Command A+OSS
    Cohere ยท Open Source
    โ€”$12.50
    Command R+OSS
    Cohere ยท Open Source
    โ€”$1.25
    Composer 2
    Cursor ยท Proprietary
    โ€”$3.00
    Composer 2 Fast
    Cursor ยท Proprietary
    โ€”$9.00
    DeepSeek R1 Distill Llama 70BOSS
    DeepSeek ยท Open Source
    โ€”$0.50
    DeepSeek R1 Distill Qwen 32BOSS
    DeepSeek ยท Open Source
    โ€”$0.30
    DeepSeek-R1OSS
    DeepSeek ยท Open Source
    โ€”$2.74
    DeepSeek-R1-0528OSS
    DeepSeek ยท Open Source
    โ€”$2.74
    DeepSeek-V2.5OSS
    DeepSeek ยท Open Source
    โ€”$0.42
    DeepSeek-V3OSS
    DeepSeek ยท Open Source
    โ€”$1.37
    DeepSeek-V3 0324OSS
    DeepSeek ยท Open Source
    โ€”$1.42
    DeepSeek-V3.1OSS
    DeepSeek ยท Open Source
    โ€”$1.27
    DeepSeek-V3.2OSS
    DeepSeek ยท Open Source ยท via OpenRouter
    โ€”$0.57
    DeepSeek-V3.2 (Non-thinking)OSS
    DeepSeek ยท Open Source
    โ€”$0.70
    DeepSeek-V3.2-ExpOSS
    DeepSeek ยท Open Source
    โ€”$0.68
    DeepSeek-V4-Flash-0423OSS
    DeepSeek ยท Open Source
    โ€”$0.30
    DeepSeek-V4-Flash-0731OSS
    DeepSeek ยท Open Source
    โ€”$1.76
    DeepSeek-V4-Flash-MaxOSS
    DeepSeek ยท Open Source
    โ€”$0.42
    DeepSeek-V4-Pro-0813OSS
    DeepSeek ยท Open Source
    โ€”$5.28
    DeepSeek-V4-Pro-MaxOSS
    DeepSeek ยท Open Source
    โ€”$5.22
    Devstral Medium
    Mistral ยท Proprietary ยท via Mistral AI
    โ€”$2.40
    Devstral Small 1.1OSS
    Mistral ยท Open Source ยท via Mistral AI
    โ€”$0.40
    Gemini 1.0 Pro
    Google ยท Proprietary
    โ€”$2.00
    Showing 1โ€“50 of 282 models

    Next step

    You found the model. Now ship the product.

    Auth, billing, and the API layer are already decided. Fork 8 finished AI apps, or have us build the first version with you.

    The index

    All Large Language Models

    282 models across 33 providers. Search or jump to a lab โ€” every model page stays linked here.

    Baidu

    1 models

    Inception

    1 models

    inclusionAI

    1 models

    LG AI Research

    1 models

    Nous Research

    1 models

    Sakana AI

    1 models

    StepFun

    1 models

    Tencent

    1 models

    Thinking Machines

    1 models

    Unisound

    1 models

    Upstage

    1 models

    Which model leads Agieval right now?

    As of August 20, 2026, Hermes 3 70B by Nous Research is #1 for Agieval at 56.2%. Ranked by the Agieval score This board also tracks Agieval. Next on the same board: Gemma 2 27B and Ministral 8B Instruct. This agieval leaderboard ranks models by Agieval. Scores come from public evals. Prices are the live API rates in the table above.

    Sources: OpenAI API pricing (https://developers.openai.com/api/docs/pricing); Anthropic Claude API pricing (https://platform.claude.com/docs/en/about-claude/pricing); Gemini API pricing (https://ai.google.dev/gemini-api/docs/pricing)

    Top 4 for agieval. Ranked by the Agieval score Input and output are dollars per million tokens.
    RankModelAgievalInput /MOutput /M
    1Hermes 3 70B56.2%$0.35$1.40
    2Gemma 2 27B55.1%$0.65$0.65
    3Ministral 8B Instruct48.3%$0.10$0.10
    4ERNIE 4.528.5%$0.40$4.00

    Agieval FAQ

    Who ranks #1 on the Agieval leaderboard?

    As of August 20, 2026, Hermes 3 70B by Nous Research ranks #1 on Agieval at 56.2%. API pricing is $0.35/M input and $1.40/M output.

    What are the top models on Agieval?

    The current Agieval ranking as of August 20, 2026 is 1. Hermes 3 70B at 56.2%; 2. Gemma 2 27B at 55.1%; 3. Ministral 8B Instruct at 48.3%.

    Which agieval model is the cheapest?

    Ministral 8B Instruct is the cheapest scored model on this agieval leaderboard at $0.10/M input and $0.10/M output ($0.20 blended). Hermes 3 70B still leads Agieval at 56.2%.

    Should I always pick the #1 Agieval model?

    Not automatically. Hermes 3 70B leads Agieval, but a cheaper scored model can be the better production choice if the quality gap is small. Use the table to weigh Agieval against input/output price, context window, and related evals.

    How often is the Agieval leaderboard updated?

    Scores and API prices on this page are refreshed from published evals and provider rates. The snapshot is labeled August 20, 2026. Treat it as a current index, not a one-off blog post.

    What is Agieval?

    Agieval is a public LLM eval (the Agieval score). This page ranks models that have published a score, next to live API prices.

    Where is the Agieval leaderboard?

    This page is the Agieval leaderboard. Models are sorted by Agieval, with input and output token prices on the same row so you can weigh score against cost. Official boards often omit price; that comparison is the point of this index.

    How is this Agieval ranking different from the official board?

    Official eval pages own the methodology. This page keeps the published Agieval score next to live API $/M so you can pick a production SKU, not only a trophy number.