o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following....
Tested on 50 benchmarks · BenchGecko score 55.1. Top scores: MATH level 5 (97.8%), Fiction.LiveBench (88.9%), HELM — IFEval (86.9%).
Qwen3 235B A22B Thinking 2507 scores 55.3 (100% as good) at $0.23/1M input · 89% cheaper
Multi-language code editing from Aider. Tests editing ability across Python, JavaScript, TypeScript, Java, C++, Go, Rust, and more.
Computer-aided design evaluation. Tests understanding of CAD concepts, 3D modeling, and engineering design principles.
Real-world software engineering tasks from GitHub issues. Models must diagnose bugs and write patches that pass test suites. Human-verified subset of SWE-bench.
Stanford HELM WildBench evaluation. Tests reasoning on challenging real-world tasks.
Abstraction and Reasoning Corpus. Tests fluid intelligence through novel visual pattern recognition puzzles. Core measure of general intelligence.
Deceptively simple questions that humans find easy but AI models often get wrong. Tests common sense and reasoning gaps.
Competition-level math from AMC, AIME, and olympiad problems. Level 5 is the hardest tier, requiring creative problem-solving.
Mock AIME (American Invitational Mathematics Exam) problems from OTIS. Tests mathematical competition performance.
Stanford HELM evaluation of mathematical reasoning across diverse problem types.
- Typemultimodal
- Context200K tokens (~100 books)
- ReleasedApr 2025
- LicenseProprietary
- StatusActive
- Cost / Message~$0.012
Frequently Asked Questions
Key facts · as of 2026-10-05
- o3 by OpenAI. BenchGecko score 55.1, rank 118 of 312 scored models (normalized average of public benchmark scores).
- List price $2.00 input · $8.00 output per 1M tokens (as of 2026-10-05).
- Sold by 1 provider (as of 2026-10-05): OpenAI $2.00 in / $8.00 out.
How to cite · data as of 2026-10-05
o3 · benchmarks, pricing and providers. BenchGecko, data as of 2026-10-05. https://benchgecko.ai/model/o3
Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP