NEWHow AI models draw the world map · Gecko Tests
Beta
Home/Models/Phi 3.5 Mini Instruct
Microsoft logo

Phi 3.5 Mini Instruct

by Microsoft · Released Aug 2024

Open Source
51.1
avg score
Rank #139
Compare
Better than 55% of all models
Context
N/A
Input $/1M
n/a
Output $/1M
n/a
Type
text-generation
License
Open Source
Benchmarks
6 tested
Data as of
About

Microsoft text generation model. 879K downloads on HuggingFace.

Tested on 6 benchmarks · BenchGecko score 51.1. Top scores: IFEval (57.8%), BBH (HuggingFace) (36.8%), MMLU-PRO (32.9%).

Capabilities
reasoning
10.1
#177 globally
math
19.6
#227 globally
knowledge
22.4
#258 globally
general
36.8
#85 globally
language
57.8
#110 globally
Benchmark Scores
Compare All
Tested on 6 benchmarks · Ranked across 5 categories
Score Distribution (all 312 models)
0255075100
▲ You are here
reasoningCompare reasoning →
MUSR

HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.

10.1·
mathCompare math →
MATH Level 5

HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.

19.6·
knowledgeCompare knowledge →
MMLU-PRO

HuggingFace MMLU-Pro. Harder version of MMLU with 10 answer choices instead of 4 and more challenging questions.

32.9·
GPQA

HuggingFace evaluation of GPQA (Graduate-Level Google-Proof Q&A). PhD-level science questions that cannot be easily searched.

12.0·
Quick compare:Google DeepMind logovs Gemma 2 9Bminimax logovs MiniMax M2.7DeepSeek logovs DeepSeek V3.2
Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Model Family · Microsoft Phi 3
Apr 2024
50.8
n/an/actx7 benchmarks
Aug 2024
51.1+0.3
n/an/actx6 benchmarks
Aug 2024
n/an/actx
Jan 2024
69.2+18.1
n/an/actx10 benchmarks
Jan 2024
61.5-7.7
n/an/actx9 benchmarks
Jan 2024
79.2+17.7
n/an/actx8 benchmarks
See the full Phi 3 family →
Similar Models
Google DeepMind logo
Gemma 2 9B
Google DeepMind
51.1$0.03/1M
minimax logo
MiniMax M2.7
minimax
51.2$0.21/1M
DeepSeek logo
DeepSeek V3.2
DeepSeek
51.3$0.28/1M
Links
Info
MicrosoftPricing explorerDevelopers · API
Research
Technical Report
Documentation
API DocsPlayground
Community
@Microsoft
Source Code
GitHubHugging Face
BenchGecko API
microsoft-phi-35-mini-instruct
Specifications
  • Typetext-generation
  • ContextN/A
  • ReleasedAug 2024
  • LicenseOpen Source
  • StatusActive
Available On
Microsoft logoMicrosoftn/a
Categories
reasoningmathknowledgegenerallanguage
Learn More
transformeropen weightstokens
Share & Export
Tweet
Related Models
Google DeepMind logoGemma 2 9B
51.1
minimax logoMiniMax M2.7
51.2
DeepSeek logoDeepSeek V3.2
51.3
anthracite-org logoMagnum v4 72B
50.9
Phi 3.5 Mini Instruct is an open-source text-generation AI model by Microsoft, released in August 2024. It has an average benchmark score of 51.1.

Related Models

Gemma 2 9B · Google DeepMindMiniMax M2.7 · minimaxDeepSeek V3.2 · DeepSeekMagnum v4 72B · anthracite-orgMiniMax M2.5 · minimax

Benchmarks

IFEvalBBH (HuggingFace)MMLU-PROMATH Level 5GPQA

Related Pages

Microsoft · ProviderMicrosoft · EconomyAll ModelsCompare ModelsPricingDevelopers · API

Key facts · as of 2026-04-09

  • Phi 3.5 Mini Instruct by Microsoft. BenchGecko score 51.1, rank 139 of 312 scored models (normalized average of public benchmark scores).
  • List price n/a input · n/a output per 1M tokens (as of 2026-04-09).

How to cite · data as of 2026-04-09

Phi 3.5 Mini Instruct · benchmarks, pricing and providers. BenchGecko, data as of 2026-04-09. https://benchgecko.ai/model/microsoft-phi-35-mini-instruct

Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP