NEWHow AI models draw the world map · Gecko Tests
Beta
Home/Models/Gemini 1.5 Flash (May 2024)
Google DeepMind logo

Gemini 1.5 Flash (May 2024)

by Google DeepMind · Released Jan 2024

41.7
avg score
Rank #190
Compare
Better than 39% of all models
Context
N/A
Input $/1M
n/a
Output $/1M
n/a
Type
text
License
Proprietary
Benchmarks
18 tested
Data as of
About

Tested on 18 benchmarks · BenchGecko score 41.7. Top scores: Chatbot Arena Elo — Overall (1286.5%), HELM — IFEval (83.1%), GSM8K (82.4%).

Capabilities
coding
24.9
#173 globally
reasoning
79.2
#17 globally
math
28.4
#198 globally
knowledge
52.6
#106 globally
multimodal
60.4
#5 globally
general
19.0
#165 globally
language
83.1
#48 globally
Benchmark Scores
Compare All
Tested on 18 benchmarks · Ranked across 8 categories
Score Distribution (all 312 models)
0255075100
▲ You are here
codingCompare coding →
WeirdML

Unusual and adversarial machine learning challenges. Tests robustness of reasoning about edge cases in ML systems.

24.9·
reasoningCompare reasoning →
HELM — WildBench

Stanford HELM WildBench evaluation. Tests reasoning on challenging real-world tasks.

79.2·
mathCompare math →
GSM8K

Grade school math word problems. 8,500 problems testing multi-step arithmetic reasoning. A foundational math benchmark.

82.4·
HELM — Omni-MATH

Stanford HELM evaluation of mathematical reasoning across diverse problem types.

30.5·
MATH level 5

Competition-level math from AMC, AIME, and olympiad problems. Level 5 is the hardest tier, requiring creative problem-solving.

25.1·
Quick compare:Meta logovs Llama 3 8B InstructGoogle DeepMind logovs Gemma 2 2b ItMeta logovs Llama 3-70B
Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Similar Models
Meta logo
Llama 3 8B Instruct
Meta
41.8$0.14/1M
Google DeepMind logo
Gemma 2 2b It
Google DeepMind
41.6n/a
Meta logo
Llama 3-70B
Meta
41.6n/a
Links
Info
Google DeepMindPricing explorerDevelopers · API
Research
Technical Report
Documentation
API DocsPlayground
Community
@Google DeepMind
BenchGecko API
gemini-1-5-flash-may-2024
Specifications
  • Typetext
  • ContextN/A
  • ReleasedJan 2024
  • LicenseProprietary
  • Statusbenchmark-only
Available On
Google DeepMind logoGoogle DeepMindn/a
Categories
codingreasoningmathknowledgemultimodalgenerallanguage
Learn More
transformertokens
Share & Export
Tweet
Related Models
Meta logoLlama 3 8B Instruct
41.8
Google DeepMind logoGemma 2 2b It
41.6
Meta logoLlama 3-70B
41.6
DeepSeek logoR1 Distill Qwen 32B
41.9
Gemini 1.5 Flash (May 2024) is a proprietary text AI model by Google DeepMind, released in January 2024. It has an average benchmark score of 41.7.

Related Models

Llama 3 8B Instruct · MetaGemma 2 2b It · Google DeepMindLlama 3-70B · MetaR1 Distill Qwen 32B · DeepSeekClaude Opus 4.1 · Anthropic

Benchmarks

Chatbot Arena Elo — OverallHELM — IFEvalGSM8KHELM — WildBenchGeoBench

Related Pages

Google DeepMind · ProviderGoogle DeepMind · EconomyAll ModelsCompare ModelsPricingDevelopers · API

Key facts · as of 2026-04-09

  • Gemini 1.5 Flash (May 2024) by Google DeepMind. BenchGecko score 41.7, rank 190 of 312 scored models (normalized average of public benchmark scores).
  • List price n/a input · n/a output per 1M tokens (as of 2026-04-09).

How to cite · data as of 2026-04-09

Gemini 1.5 Flash (May 2024) · benchmarks, pricing and providers. BenchGecko, data as of 2026-04-09. https://benchgecko.ai/model/gemini-1-5-flash-may-2024

Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP