Beta
Leaderboard/Qwen2.5 Coder 32B Instruct
Alibaba Qwen

Qwen2.5 Coder 32B Instruct

Open Source

by Alibaba Qwen 路 Released 2024-11-11

72.6
avg score
$0.66/1M
Input Price
$1.00/1M
Output Price
33K tokens (~16 books)
Context Window
text
Type

Tested on 5 benchmarks with 72.6% average. Top scores: GSM8K (91.1%), HellaSwag (77.3%), MMLU (72.1%).

Benchmark Scores

BenchmarkCategoryScoreBar
GSM8Kmath91.1
HellaSwagknowledge77.3
MMLUknowledge72.1
Winograndeknowledge61.6
ARC AI2knowledge60.7

Similar Models

U
Stable Beluga 2
unknown
69.3
DeepSeekDeepSeek-V2 (MoE-236B, May 2024)
DeepSeek
76.5
Google DeepMindGemini 3.1 Pro Preview
Google DeepMind
67.4
Microsoftphi-3-small 7.4B
Microsoft
67.4

Alibaba Qwen Qwen 2.5 Timeline

Qwen2.5 72B Instruct
52.3
$0.12/M in33Kctx15 benchmarks
Qwen2.5 7B Instruct
$0.04/M in(-0.08)33Kctx
Qwen2.5 Coder 32B Instruct
72.6+72.6
$0.66/M in(+0.62)33Kctx5 benchmarks
Qwen2.5 Coder 7B Instruct
61.4-11.2
$0.03/M in(-0.63)33Kctx5 benchmarks
Qwen2.5 VL 32B Instruct
$0.20/M in(+0.17)128Kctx(+95K)
Qwen2.5 VL 72B Instruct
$0.80/M in(+0.60)33Kctx(-95K)