LLaMA-33B
Open Sourceby Meta 路 Released 2024-01-01
57.9
avg score
N/A
Input Price
N/A
Output Price
N/A
Context Window
text
Type
Tested on 10 benchmarks with 57.9% average. Top scores: TriviaQA (83.8%), LAMBADA (77.2%), HellaSwag (77.1%).
Benchmark Scores
| Benchmark | Category | Score | Bar |
|---|---|---|---|
| TriviaQA | knowledge | 83.8 | |
| LAMBADA | knowledge | 77.2 | |
| HellaSwag | knowledge | 77.1 | |
| PIQA | knowledge | 64.6 | |
| ARC AI2 | knowledge | 56.7 | |
| Winogrande | knowledge | 52.0 | |
| MMLU | knowledge | 44.9 | |
| OpenBookQA | knowledge | 44.8 | |
| GSM8K | math | 44.1 | |
| BBH | reasoning | 33.3 |