Phi-1.5
Open Sourceby Microsoft 路 Released 2024-01-01
27.2
avg score
N/A
Input Price
N/A
Output Price
N/A
Context Window
text
Type
Tested on 5 benchmarks with 27.2% average. Top scores: Winogrande (46.8%), HellaSwag (30.1%), ARC AI2 (25.9%).
Benchmark Scores
| Benchmark | Category | Score | Bar |
|---|---|---|---|
| Winogrande | knowledge | 46.8 | |
| HellaSwag | knowledge | 30.1 | |
| ARC AI2 | knowledge | 25.9 | |
| MMLU | knowledge | 16.8 | |
| OpenBookQA | knowledge | 16.3 |