Compare · ModelsLive · 2 picked · head to head
Gemini 3 Pro vs gpt-oss-20b
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Gemini 3 Pro wins on 11/12 benchmarks
Gemini 3 Pro wins 11 of 12 shared benchmarks. Leads in speed · arena · knowledge.
Category leads
speed·Gemini 3 Proarena·Gemini 3 Proknowledge·Gemini 3 Prolanguage·Gemini 3 Promath·gpt-oss-20breasoning·Gemini 3 Procoding·Gemini 3 Pro
Hype vs Reality
Attention vs performance
Gemini 3 Pro
#71 by perf·#5 by attention
gpt-oss-20b
#97 by perf·no signal
Vendor risk
Who is behind the model
Google DeepMind
$4.20T·Tier 1
OpenAI
$840.0B·Tier 1
Head to head
12 benchmarks · 2 models
Gemini 3 Progpt-oss-20b
Artificial Analysis · Quality Index
Gemini 3 Pro leads by +32.3
Gemini 3 Pro
41.3
gpt-oss-20b
9.0
Chatbot Arena Elo · Overall
Gemini 3 Pro leads by +167.9
Gemini 3 Pro
1485.5
gpt-oss-20b
1317.6
Chess Puzzles
Gemini 3 Pro leads by +27.4
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
Gemini 3 Pro
27.4
gpt-oss-20b
0.0
GPQA diamond
Gemini 3 Pro leads by +42.4
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Gemini 3 Pro
90.2
gpt-oss-20b
47.7
HELM · GPQA
Gemini 3 Pro leads by +20.9
Gemini 3 Pro
80.3
gpt-oss-20b
59.4
HELM · IFEval
Gemini 3 Pro leads by +14.4
Gemini 3 Pro
87.6
gpt-oss-20b
73.2
HELM · MMLU-Pro
Gemini 3 Pro leads by +16.3
Gemini 3 Pro
90.3
gpt-oss-20b
74.0
HELM · Omni-MATH
gpt-oss-20b leads by +0.9
Gemini 3 Pro
55.6
gpt-oss-20b
56.5
HELM · WildBench
Gemini 3 Pro leads by +12.2
Gemini 3 Pro
85.9
gpt-oss-20b
73.7
OTIS Mock AIME 2024-2025
Gemini 3 Pro leads by +26.1
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Gemini 3 Pro
91.4
gpt-oss-20b
65.2
Terminal Bench
Gemini 3 Pro leads by +66.0
Terminal-Bench 2.0 · evaluates AI agents on real terminal-based coding tasks · writing scripts, debugging, running tests, and managing projects entirely through command-line interaction. Tests both code quality and terminal fluency. Claude Opus 4.7 scores 69.4%, demonstrating significant agentic terminal competence.
Gemini 3 Pro
69.4
gpt-oss-20b
3.4
WeirdML
Gemini 3 Pro leads by +29.0
WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns.
Gemini 3 Pro
69.9
gpt-oss-20b
40.9
Full benchmark table
| Benchmark | Gemini 3 Pro | gpt-oss-20b |
|---|---|---|
Artificial Analysis · Quality Index | 41.3 | 9.0 |
Chatbot Arena Elo · Overall | 1485.5 | 1317.6 |
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 27.4 | 0.0 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 90.2 | 47.7 |
HELM · GPQA | 80.3 | 59.4 |
HELM · IFEval | 87.6 | 73.2 |
HELM · MMLU-Pro | 90.3 | 74.0 |
HELM · Omni-MATH | 55.6 | 56.5 |
HELM · WildBench | 85.9 | 73.7 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 91.4 | 65.2 |
Terminal Bench Terminal-Bench 2.0 · evaluates AI agents on real terminal-based coding tasks · writing scripts, debugging, running tests, and managing projects entirely through command-line interaction. Tests both code quality and terminal fluency. Claude Opus 4.7 scores 69.4%, demonstrating significant agentic terminal competence. | 69.4 | 3.4 |
WeirdML WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns. | 69.9 | 40.9 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| — | — | — | — | |
| $0.02 | $0.09 | 131K tokens (~66 books) | $0.36 |