Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities,...
Tested on 17 benchmarks · BenchGecko score 22.7. Top scores: Chatbot Arena Elo — Overall (1365.4%), OpenCompass — IFEval (81.0%), Lech Mazur Writing (79.9%).
OpenCompass Live Code Bench v6. Fresh competitive programming problems to evaluate code generation without memorization.
Multi-language code editing from Aider. Tests editing ability across Python, JavaScript, TypeScript, Java, C++, Go, Rust, and more.
Competition-level math from AMC, AIME, and olympiad problems. Level 5 is the hardest tier, requiring creative problem-solving.
Mock AIME (American Invitational Mathematics Exam) problems from OTIS. Tests mathematical competition performance.
OpenCompass evaluation on AIME 2025 problems. Tests mathematical reasoning on fresh competition problems.
Writing quality evaluation by Lech Mazur. Tests prose quality, coherence, and stylistic ability.
OpenCompass MMLU-Pro evaluation. Harder knowledge test with more answer choices.
Geography benchmark testing knowledge of world geography, landmarks, borders, and geopolitical facts.
- Typemultimodal
- Context131K tokens (~66 books)
- ReleasedMar 2025
- LicenseOpen Source
- StatusActive
- Cost / Message~$0.001
Frequently Asked Questions
Related Models
Mistral Small 3.1 24B · Mistral AIGPT-4.1 Nano · OpenAIClaude 2.1 · AnthropicLlama 4 Maverick · MetaMistral Small 3.2 24B · Mistral AIKey facts · as of 2026-10-05
- Gemma 3 27B by Google DeepMind. BenchGecko score 22.7, rank 272 of 312 scored models (normalized average of public benchmark scores).
- List price $0.0800 input · $0.45 output per 1M tokens (as of 2026-10-05).
- Sold by 4 providers (as of 2026-10-05): DeepInfra (fp8) $0.0800 in / $0.16 out · Parasail (fp8) $0.0800 in / $0.45 out · Nebius (fp8) $0.10 in / $0.30 out · Novita (bf16) $0.12 in / $0.20 out. Every provider
How to cite · data as of 2026-10-05
Gemma 3 27B · benchmarks, pricing and providers. BenchGecko, data as of 2026-10-05. https://benchgecko.ai/model/gemma-3-27b-it
Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP