Compare · ModelsLive · 2 picked · head to head
Grok 4.20 vs Qwen3.8 Max (0902)
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Qwen3.8 Max (0902) wins on 9/9 benchmarks
Qwen3.8 Max (0902) wins 9 of 9 shared benchmarks. Leads in knowledge · general · math.
Category leads
knowledge·Qwen3.8 Max (0902)general·Qwen3.8 Max (0902)math·Qwen3.8 Max (0902)
Hype vs Reality
Attention vs performance
Grok 4.20
#129 by perf·#15 by attention
Qwen3.8 Max (0902)
#102 by perf·#2 by attention
Best value
Grok 4.20
2.0x better value than Qwen3.8 Max (0902)
Grok 4.20
26.0 pts/$
$1.88/M
Qwen3.8 Max (0902)
13.2 pts/$
$4.00/M
Vendor risk
Who is behind the model
xAI
$250.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
9 benchmarks · 2 models
Grok 4.20Qwen3.8 Max (0902)
Chess Puzzles
Qwen3.8 Max (0902) leads by +5.3
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
Grok 4.20
20.0
Qwen3.8 Max (0902)
25.3
Dtbench
Qwen3.8 Max (0902) leads by +3.1
Grok 4.20
83.5
Qwen3.8 Max (0902)
86.7
FrontierMath-Tier-4-v2-Private
Qwen3.8 Max (0902) leads by +29.3
Grok 4.20
17.1
Qwen3.8 Max (0902)
46.3
FrontierMath-Tiers-1-3-v2-Private
Qwen3.8 Max (0902) leads by +29.8
Grok 4.20
44.9
Qwen3.8 Max (0902)
74.7
GPQA diamond
Qwen3.8 Max (0902) leads by +4.5
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Grok 4.20
85.8
Qwen3.8 Max (0902)
90.2
Lmca
Qwen3.8 Max (0902) leads by +8.9
Grok 4.20
45.5
Qwen3.8 Max (0902)
54.4
OTIS Mock AIME 2024-2025
Qwen3.8 Max (0902) leads by +7.2
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Grok 4.20
92.2
Qwen3.8 Max (0902)
99.4
Proofbench
Qwen3.8 Max (0902) leads by +44.0
Grok 4.20
14.0
Qwen3.8 Max (0902)
58.0
SimpleQA Verified
Qwen3.8 Max (0902) leads by +15.6
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
Grok 4.20
30.2
Qwen3.8 Max (0902)
45.8
Full benchmark table
| Benchmark | Grok 4.20 | Qwen3.8 Max (0902) |
|---|---|---|
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 20.0 | 25.3 |
Dtbench | 83.5 | 86.7 |
FrontierMath-Tier-4-v2-Private | 17.1 | 46.3 |
FrontierMath-Tiers-1-3-v2-Private | 44.9 | 74.7 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 85.8 | 90.2 |
Lmca | 45.5 | 54.4 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 92.2 | 99.4 |
Proofbench | 14.0 | 58.0 |
SimpleQA Verified SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information. | 30.2 | 45.8 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $1.25 | $2.50 | 2.0M tokens (~1,000 books) | $15.63 | |
| $2.00 | $6.00 | 1.0M tokens (~500 books) | $30.00 |