Tested on 8 benchmarks · BenchGecko score 79.2. Top scores: ARC AI2 (87.6%), OpenBookQA (84.0%), BBH (72.1%).
BIG-Bench Hard. 23 challenging tasks from BIG-Bench where prior language models fell below average human performance.
AI2 Reasoning Challenge. Grade-school science questions requiring multi-step reasoning. Easy and Challenge sets test different difficulty levels.
Elementary science questions with access to a small book of core science facts. Tests reasoning beyond memorization.
Sentence completion requiring commonsense reasoning about physical and social situations. Tests real-world understanding.
- Typetext
- ContextN/A
- ReleasedJan 2024
- LicenseOpen Source
- Statusbenchmark-only
Frequently Asked Questions
Key facts · as of 2026-04-09
- phi-3-small 7.4B by Microsoft. BenchGecko score 79.2, rank 21 of 312 scored models (normalized average of public benchmark scores).
- List price n/a input · n/a output per 1M tokens (as of 2026-04-09).
How to cite · data as of 2026-04-09
phi-3-small 7.4B · benchmarks, pricing and providers. BenchGecko, data as of 2026-04-09. https://benchgecko.ai/model/phi-3-small-7-4b
Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP