Anthropic
๐บ๐ธUnited StatesWebsite
18
Total Models
tracked on BenchGecko
0
Open Source
0% of models
$0.25
Cheapest Model
per 1M input tokens
39.5
Avg Benchmark
across 18 scored models
Model Categories
Multimodal13LLM5
Pricing Range โ $/1M input tokens
$0.25
$0.80
$1.00
$3.00
$3.00
$3.00
$3.00
$3.00
$5.00
$5.00
$6.00
$15.00
$15.00
Low: $0.25Median: $3.00High: $15.00
Open Source Ratio
0%
0 open source18 proprietary
All Anthropic Models18 total
| #โฒ | Model | Avg | ARC AI2? | BBH? | GSM8K? | HellaSwag? | LAMBADA? | MMLU? | GPQA diamond? | MATH level 5? | otis mock ? | WeirdML? | Winogrande? | SimpleBench? | aider poly? | lech mazur? | GSO-Bench? | fiction li? | swe bench ? | terminal b? | frontierma? | simpleqa v? | frontierma? | chess puzz? | APEX-Agents? | OSWorld? | ARC-AGI-2? | HLE? | TriviaQA? | ScienceQA? | PIQA? | OpenBookQA? | CadEval? | Balrog? | GeoBench? | Cybench? | ANLI? | the agent ? | VideoMME? | ARC-AGI? | deepresear? | VPCT? | $/1M in | Context | Released |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 78.0 | 81.7 | - | 86.7 | - | - | 64.5 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 78.9 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | Jan 242y ago | |
| 2 | 55.5 | - | - | - | - | - | - | 87.4 | - | 94.4 | 77.9 | - | 61.1 | - | - | 33.3 | - | - | 69.9 | 40.7 | 46.5 | 22.9 | 17.0 | 31.7 | - | 69.2 | 31.1 | - | - | - | - | - | - | - | - | - | - | - | 94.0 | - | - | $5.00 | 1.0M | Feb 261mo ago | |
| 3 | 47.3 | - | - | - | - | - | - | 83.2 | - | 85.8 | 66.1 | - | - | - | - | - | - | - | - | 32.4 | 29.0 | 8.3 | 13.0 | - | - | 60.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | $3.00 | 1.0M | Feb 261mo ago | |
| 4 | 46.5 | - | - | - | - | - | - | 81.4 | - | 86.1 | 63.7 | - | 54.4 | - | - | 26.5 | - | 74.4 | 63.1 | 20.7 | 41.8 | 4.2 | 12.0 | 18.4 | 66.3 | 37.6 | 21.4 | - | - | - | - | - | - | 75.0 | - | - | - | - | 80.0 | - | 10.0 | $5.00 | 200K | Nov 254mo ago | |
| 5 | 42.1 | - | - | - | - | - | - | 73.0 | 91.2 | 57.7 | - | - | 35.7 | 64.9 | 81.1 | 3.8 | 83.3 | 52.8 | - | 4.1 | - | - | - | - | 35.8 | 0.9 | 3.4 | - | - | - | - | 54.0 | - | 68.0 | 20.0 | - | 30.9 | - | 28.6 | 43.6 | 8.5 | $3.00 | 200K | Feb 251y ago | |
| 6 | 42.1 | - | - | - | - | - | - | 73.0 | 91.2 | 57.7 | - | - | 35.7 | 64.9 | 81.1 | 3.8 | 83.3 | 52.8 | - | 4.1 | - | - | - | - | 35.8 | 0.9 | 3.4 | - | - | - | - | 54.0 | - | 68.0 | 20.0 | - | 30.9 | - | 28.6 | 43.6 | 8.5 | $3.00 | 200K | Feb 251y ago | |
| 7 | 40.6 | - | - | - | - | - | - | 76.4 | 97.7 | 77.8 | 47.7 | - | 45.2 | - | - | 14.7 | - | 70.6 | 42.8 | 15.2 | 23.6 | 4.2 | 12.0 | - | 62.9 | 13.6 | 9.4 | - | - | - | - | - | - | - | 55.0 | - | - | - | - | 52.6 | 9.7 | $3.00 | 1.0M | Sep 256mo ago | |
| 8 | 40.1 | - | - | - | - | - | - | 68.3 | 85.0 | 64.4 | 43.4 | - | 50.6 | 72.0 | - | 6.9 | 61.1 | 67.6 | - | 4.5 | - | 4.2 | - | - | - | 8.6 | 6.2 | - | - | - | - | - | - | 49.0 | 38.0 | - | - | - | 35.7 | 49.0 | 7.0 | $15.00 | 200K | May 2510mo ago | |
| 9 | 38.5 | - | - | - | - | - | - | 69.7 | - | 68.9 | 42.8 | - | 52.0 | - | 85.4 | - | - | - | 38.0 | 7.2 | 34.8 | 4.2 | - | - | - | - | 7.1 | - | - | - | - | - | - | - | 38.0 | - | - | - | - | 49.7 | 2.5 | $15.00 | 200K | Aug 257mo ago | |
| 10 | 37.2 | - | - | - | - | - | 71.3 | 12.9 | 11.7 | 2.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 87.5 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | Jan 242y ago | |
| 11 | 36.9 | - | - | - | - | - | - | 72.3 | 84.4 | 71.1 | 46.1 | - | 34.6 | 61.3 | - | 4.9 | 46.9 | 64.9 | - | 4.1 | - | 0.1 | - | - | 43.9 | 5.9 | 3.1 | - | - | - | - | - | - | 37.0 | 35.0 | - | 33.1 | - | 40.0 | 47.8 | 1.0 | $3.00 | 200K | May 2510mo ago | |
| 12 | 35.3 | - | - | - | - | - | - | 61.6 | 96.4 | 66.6 | 45.4 | - | - | - | - | - | - | - | 29.8 | 5.9 | 5.9 | 2.1 | - | - | - | 4.0 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | $1.00 | 200K | Oct 255mo ago | |
| 13 | 33.7 | - | - | - | - | - | 79.5 | 29.6 | 37.5 | 4.6 | 23.2 | 77.0 | 8.2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 10.0 | - | - | - | - | - | - | - | - | Jan 242y ago | |
| 14 | 29.9 | - | - | - | - | - | 65.7 | 17.5 | 46.4 | 4.2 | 30.7 | - | - | 28.0 | 73.5 | - | - | - | - | 0.3 | 6.7 | - | - | - | - | - | - | - | - | - | - | 32.0 | 19.3 | 34.0 | - | - | - | - | - | - | - | $0.80 | 200K | Nov 241y ago | |
| 15 | 28.8 | - | - | - | - | - | 82.0 | 38.7 | 51.7 | 6.4 | 31.0 | - | 13.0 | - | - | - | - | - | - | 1.0 | - | 0.1 | - | - | - | - | - | - | - | - | - | - | - | - | 17.5 | - | - | 46.7 | - | - | - | $6.00 | 200K | Oct 241y ago | |
| 16 | 28.7 | - | - | - | - | - | 65.1 | 15.1 | 14.9 | 1.7 | 9.8 | 48.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 62.7 | - | - | 12.0 | - | - | - | - | - | - | - | - | - | $0.25 | 200K | Mar 242y ago | |
| 17 | 28.3 | - | - | - | - | - | 67.9 | 20.8 | 18.2 | 2.4 | 10.2 | 50.2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | Jan 242y ago | |
| 18 | 21.0 | - | - | - | - | - | 64.7 | 10.6 | - | 1.9 | 7.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | Jan 242y ago |
90+ 80-89 70-79 60-69 <60Scores in % unless noted. Avg = unweighted mean across tested benchmarks.