The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more here. GPT-4o ("o" for "omni") is...
Tested on 11 benchmarks · BenchGecko score 39.6. Top scores: Chatbot Arena Elo — Overall (1335.5%), MMLU (79.1%), Aider — Code Editing (71.4%).
Qwen3 30B A3B Instruct 2507 scores 40.1 (101% as good) at $0.05/1M input · 98% cheaper
Code editing benchmark from the Aider project. Measures ability to apply targeted code changes while maintaining correctness and style.
Computer-aided design evaluation. Tests understanding of CAD concepts, 3D modeling, and engineering design principles.
Multi-language code editing from Aider. Tests editing ability across Python, JavaScript, TypeScript, Java, C++, Go, Rust, and more.
Deceptively simple questions that humans find easy but AI models often get wrong. Tests common sense and reasoning gaps.
Competition-level math from AMC, AIME, and olympiad problems. Level 5 is the hardest tier, requiring creative problem-solving.
Mock AIME (American Invitational Mathematics Exam) problems from OTIS. Tests mathematical competition performance.
Original research-level math problems created by professional mathematicians. Problems are unpublished and cannot be memorized.
- Typemultimodal
- Context128K tokens (~64 books)
- ReleasedAug 2024
- LicenseProprietary
- StatusActive
- Cost / Message~$0.015
Frequently Asked Questions
Key facts · as of 2026-10-05
- GPT-4o (2024-08-06) by OpenAI. BenchGecko score 39.6, rank 200 of 312 scored models (normalized average of public benchmark scores).
- List price $2.50 input · $10.00 output per 1M tokens (as of 2026-10-05).
- Sold by 2 providers (as of 2026-10-05): Azure $2.50 in / $10.00 out · OpenAI $2.50 in / $10.00 out. Every provider
How to cite · data as of 2026-10-05
GPT-4o (2024-08-06) · benchmarks, pricing and providers. BenchGecko, data as of 2026-10-05. https://benchgecko.ai/model/gpt-4o-2024-08-06
Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP