Claude 3.5 Sonnet Model Card
by Anthropic
Explore detailed LLM evaluation metrics and benchmarks for Claude 3.5 Sonnet, a proprietary large language model by Anthropic. Compare API costs, context windows, and performance across multiple LLM benchmarks including MMLU (general knowledge), MMMU (multimodal capabilities), HellaSwag (common sense reasoning), HumanEval (code generation), and MATH (mathematical reasoning).
Share:
Pricing
Input Processing
Cost per million tokens for processing prompts
$3.00per million tokens
Generation
Cost per million tokens for responses
$15.00per million tokens
Model Details
Context Length
Maximum input length the model can process at once
200000Ktokens
Response Length
Maximum length of a single generated response
8192Ktokens
Release Date
First public release date
June 20, 2024
Training Cutoff
Latest date of data included in training
April 2024
License Type
Model licensing and availability
Proprietary
Performance Metrics
General Knowledge (MMLU)
Accuracy on diverse academic and real-world topics
90.4score
Multimodal Tasks (MMMU)
Performance on tasks combining text, images, and other media
68.3score
Common Sense (HellaSwag)
Understanding of everyday scenarios and situations
Not available
Code Generation (HumanEval)
Ability to write and understand programming code
Not available
Mathematical Ability (MATH)
Accuracy in mathematical computations and reasoning
71.1score
0-shot
- 🚀
10+ AI Templates
Ready-to-use demos for text, image & chat
- ⚡
Modern Tech Stack
Next.js 14, TypeScript & Tailwind
- 🔌
AI Integrations
OpenAI, Anthropic & Replicate ready
- 🛠️
Full Infrastructure
Auth, database & payments included
- 🎨
Professional Design
6+ landing pages & modern UI kit
- 📱
Production Ready
SEO optimized & ready to deploy
All Large Language Models
OpenAI
Anthropic
Fireworks
Mistral
Stop wasting time on infrastructure
Focus on building a great product, not on setting up infrastructure. AnotherWrapper gives you the foundation to launch your AI product in days, not months.
- 10+ ready-to-use AI demo apps
- Pre-configured APIs and AI models
- All essential SaaS features (auth, database, payments, etc.)
FAQ
Frequently asked questions
Need help with something? Here are some of the most common questions we get.