Tested on 16 benchmarks · BenchGecko score 32.0. Top scores: TriviaQA (73.6%), LAMBADA (70.0%), HellaSwag (68.5%).
BIG-Bench Hard. 23 challenging tasks from BIG-Bench where prior language models fell below average human performance.
HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.
Grade school math word problems. 8,500 problems testing multi-step arithmetic reasoning. A foundational math benchmark.
HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.
Trivia questions sourced from trivia enthusiasts and quiz websites. Tests breadth of general knowledge.
Language modeling benchmark testing ability to predict the last word of passages requiring long-range context understanding.
Sentence completion requiring commonsense reasoning about physical and social situations. Tests real-world understanding.
- Typetext
- ContextN/A
- ReleasedJan 2024
- LicenseProprietary
- Statusbenchmark-only
Frequently Asked Questions
Key facts · as of 2026-04-09
- MPT-30B by Unknown. BenchGecko score 32.0, rank 238 of 312 scored models (normalized average of public benchmark scores).
- List price n/a input · n/a output per 1M tokens (as of 2026-04-09).
How to cite · data as of 2026-04-09
MPT-30B · benchmarks, pricing and providers. BenchGecko, data as of 2026-04-09. https://benchgecko.ai/model/mpt-30b
Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP