Tested on 4 benchmarks · BenchGecko score 54.6. Top scores: GSM8K (75.7%), HellaSwag (61.2%), ARC AI2 (37.2%).
Grade school math word problems. 8,500 problems testing multi-step arithmetic reasoning. A foundational math benchmark.
Sentence completion requiring commonsense reasoning about physical and social situations. Tests real-world understanding.
AI2 Reasoning Challenge. Grade-school science questions requiring multi-step reasoning. Easy and Challenge sets test different difficulty levels.
Commonsense coreference resolution. Tests understanding of pronoun references in ambiguous sentences.
- Typetext
- ContextN/A
- ReleasedJan 2024
- LicenseOpen Source
- Statusbenchmark-only
Frequently Asked Questions
Key facts · as of 2026-06-22
- Qwen2.5-Coder-3B by Alibaba Qwen. BenchGecko score 54.6, rank 120 of 312 scored models (normalized average of public benchmark scores).
- List price n/a input · n/a output per 1M tokens (as of 2026-06-22).
How to cite · data as of 2026-06-22
Qwen2.5-Coder-3B · benchmarks, pricing and providers. BenchGecko, data as of 2026-06-22. https://benchgecko.ai/model/qwen2-5-coder-3b
Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP