Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong...
Tested on 9 benchmarks · BenchGecko score 30.6. Top scores: Chatbot Arena Elo — Overall (1275.1%), MMLU (72.4%), Winogrande (67.0%).
Llama 3.1 8B Instruct scores 30.7 (100% as good) at $0.02/1M input · 96% cheaper
Capture-the-flag cybersecurity challenges. Tests vulnerability analysis, reverse engineering, cryptography, and exploitation skills.
Competition-level math from AMC, AIME, and olympiad problems. Level 5 is the hardest tier, requiring creative problem-solving.
Mock AIME (American Invitational Mathematics Exam) problems from OTIS. Tests mathematical competition performance.
Massive Multitask Language Understanding. 57 subjects from STEM, humanities, and social sciences. The most widely-cited knowledge benchmark.
Commonsense coreference resolution. Tests understanding of pronoun references in ambiguous sentences.
Chinese MMLU. Comprehensive knowledge test specifically designed for Chinese language and culture.
- Typetext
- Context8K tokens (~4 books)
- ReleasedApr 2024
- LicenseOpen Source
- StatusActive
- Cost / Message~$0.002
Frequently Asked Questions
Key facts · as of 2026-05-03
- Llama 3 70B Instruct by Meta. BenchGecko score 30.6, rank 244 of 312 scored models (normalized average of public benchmark scores).
- List price $0.51 input · $0.74 output per 1M tokens (as of 2026-05-03).
How to cite · data as of 2026-05-03
Llama 3 70B Instruct · benchmarks, pricing and providers. BenchGecko, data as of 2026-05-03. https://benchgecko.ai/model/llama-3-70b-instruct
Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP