Beta
Microsoft

Microsoft

๐Ÿ‡บ๐Ÿ‡ธUnited StatesWebsite
Top Model
phi-3-small 7.4B
67.4
avg score
7
Total Models
tracked on BenchGecko
7
Open Source
100% of models
$0.07
Cheapest Model
per 1M input tokens
50.2
Avg Benchmark
across 6 scored models

Model Categories

LLM7

Pricing Range โ€” $/1M input tokens

$0.07
$0.62
Low: $0.07Median: $0.62High: $0.62

Open Source Ratio

100%
7 open source0 proprietary

All Microsoft Models7 total

#โ–ฒModelAvgARC AI2?BBH?GSM8K?HellaSwag?LAMBADA?MMLU?GPQA diamond?MATH level 5?otis mock ?WeirdML?Winogrande?SimpleBench?aider poly?lech mazur?GSO-Bench?fiction li?swe bench ?terminal b?frontierma?simpleqa v?frontierma?chess puzz?APEX-Agents?OSWorld?ARC-AGI-2?HLE?TriviaQA?ScienceQA?PIQA?OpenBookQA?CadEval?Balrog?GeoBench?Cybench?ANLI?the agent ?VideoMME?ARC-AGI?deepresear?VPCT?$/1M inContextReleased
1Microsoftphi-3-small 7.4B๐Ÿ‡บ๐Ÿ‡ธ MicrosoftOpen67.487.672.1-69.3-67.6----63.0---------------58.1--84.0----37.1-------Jan 242y ago
2Microsoftphi-3-mini 3.8B๐Ÿ‡บ๐Ÿ‡ธ MicrosoftOpen61.079.962.3-68.9-58.4----41.6---------------64.0--84.0----29.2-------Jan 242y ago
3Microsoftphi-3-medium 14B๐Ÿ‡บ๐Ÿ‡ธ MicrosoftOpen58.688.875.2-76.5-70.73.517.6--63.0---------------73.9--83.2----33.7-------Jan 242y ago
4MicrosoftPhi 4๐Ÿ‡บ๐Ÿ‡ธ MicrosoftOpen45.7-----79.741.464.913.7----62.6-----------------11.6--------$0.0716KJan 251y ago
5MicrosoftPhi-2๐Ÿ‡บ๐Ÿ‡ธ MicrosoftOpen41.267.945.9-38.1-44.5----9.4---------------45.2--64.8----13.8-------Jan 242y ago
6MicrosoftPhi-1.5๐Ÿ‡บ๐Ÿ‡ธ MicrosoftOpen27.225.9--30.1-16.8----46.8------------------16.3------------Jan 242y ago
90+ 80-89 70-79 60-69 <60Scores in % unless noted. Avg = unweighted mean across tested benchmarks.