Which model leads on SimpleQA Verified?

GPT-6 Astra from OpenAI leads SimpleQA Verified with a score of 75.6. The median score across 79 tested models is 41.0.

Is SimpleQA Verified saturated?

No · the top score is 75.6 out of 100 (76%). There is still meaningful room for improvement on SimpleQA Verified.

Does SimpleQA Verified predict performance on other benchmarks?

Yes · SimpleQA Verified scores correlate 0.93 with Osworld 2 0 across 6 shared models. Models that do well on SimpleQA Verified tend to do well on Osworld 2 0.

How often is SimpleQA Verified data refreshed?

BenchGecko pulls updates daily. New model scores on SimpleQA Verified appear as soon as they are published by Epoch AI or the model provider.

Benchmark · KnowledgeSettled

SimpleQA Verified

Name: SimpleQA Verified Benchmark
Creator: BenchGecko
License: https://creativecommons.org/licenses/by/4.0/

SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.

Updated 2026-09-28

Models tested

Top score

75.6

GPT-6 Astra

Median

41.0

min 6.0

Top-5 spread

σ 1.6

Settled

The Frontier

Best score over time · one chart, every benchmark

Chart type

Frontier on SimpleQA Verified rose from 26.0 to 75.6 in 22 months · +49.6 points · latest leader GPT-6 Astra from OpenAI.

Pink dots = frontier records · 7 totalClick to open model page

Full rankings

79 models tested · sorted by score

#	Model	Score	Price
1	GPT-6 Astra· OpenAI	75.6	$10.00
2	Gemini 3.1 Pro Preview· Google DeepMind	73.5	$2.00
3	Gemini 3 Pro· Google DeepMind	72.9	n/a
4	Claude Opus 5.5· Anthropic	72.2	$4.00
5	Claude Fable 5.1· Anthropic	70.8	$10.00
6	Claude Fable 5· Anthropic	70.7	$10.00
7	Gemini 3.8 Flash· Google DeepMind	69.7	$0.75
8	GPT-5.6 Sol· OpenAI	69.7	$2.00
9	Gemini 3.7 Flash· Google DeepMind	69.2	$0.75
10	Gemini 3 Flash Preview· Google DeepMind	66.8	$0.50
11	U Muse Spark· Unknown	66.3	n/a
12	Gemini 3.5 Flash· Google DeepMind	66.2	$1.50
13	Gemini 3.6 Flash· Google DeepMind	66.2	$0.75
14	Claude Opus 5· Anthropic	59.9	$5.00
15	Gemini 2.5 Pro· Google DeepMind	56.0	$1.25
16	Qwen3.7 Max· Alibaba Qwen	55.8	$1.25
17	Claude Opus 4.8· Anthropic	53.0	$5.00
18	DeepSeek V4 Pro 0813· DeepSeek	52.9	$0.55
19	Qwen3.6 Max Preview· Alibaba Qwen	52.0	$1.03
20	Claude Opus 4.7· Anthropic	51.7	$5.00
21	Kimi K3· moonshotai	50.6	$0.67
22	GPT-5· OpenAI	50.1	$1.25
23	o3· OpenAI	49.4	$2.00
24	Grok 4.6· xAI	49.3	$2.00
25	Qwen3 Max· Alibaba Qwen	48.8	$0.78
26	Grok 4.5· xAI	48.3	$2.00
27	GPT-5.1· OpenAI	48.0	$1.25
28	Grok 4· xAI	47.9	n/a
29	Claude Opus 4.6· Anthropic	47.0	$5.00
30	DeepSeek V4 Pro· DeepSeek	47.0	$0.21
31	Claude Sonnet 5.5· Anthropic	46.5	$2.00
32	GPT-5.4 Pro· OpenAI	46.3	$30.00
33	Qwen3.8 Max (0902)· Alibaba Qwen	45.8	$2.00
34	GPT-5.4· OpenAI	45.1	$2.50
35	Qwen3.6 Plus· Alibaba Qwen	44.1	$0.33
36	GPT-5.6 Terra· OpenAI	43.2	$2.00
37	Claude Opus 4.5· Anthropic	41.8	$5.00
38	o1· OpenAI	41.1	$15.00
39	GLM 5.3· z-ai	41.0	$1.40
40	GPT-5.6 Luna· OpenAI	41.0	$0.20
41	Qwen3 235B A22B Thinking 2507· Alibaba Qwen	40.4	$0.23
42	GPT-5.2· OpenAI	37.1	$1.75
43	Kimi K2.7 Code· moonshotai	36.5	$0.61
44	Claude Sonnet 4.6· Anthropic	35.5	$3.00
45	Kimi K2.6· moonshotai	34.9	$0.95
46	Claude Opus 4.1· Anthropic	34.8	$15.00
47	Kimi K2.5· moonshotai	34.3	$0.45
48	GLM 5.2· z-ai	34.2	$1.00
49	GLM 5.1· z-ai	34.0	$0.97
50	Claude Sonnet 5· Anthropic	33.7	$2.00
51	DeepSeek V4 Flash 0731· DeepSeek	33.6	$0.02
52	Grok 4.3· xAI	33.2	$1.25
53	GLM 4.7· z-ai	32.2	$0.60
54	Kimi K2 Thinking· moonshotai	31.6	$0.60
55	GPT-4.1· OpenAI	31.1	$2.00
56	Claude Sonnet 4.5· Anthropic	30.7	$3.00
57	Grok 4.20· xAI	30.2	$1.25
58	GPT-5.4 Mini· OpenAI	29.4	$0.75
59	DeepSeek V3.2· DeepSeek	27.5	$0.28
60	R1· DeepSeek	27.4	$0.70
61	R1 0528· DeepSeek	27.4	$0.50
62	GPT-4o (2024-11-20)· OpenAI	26.0	$2.50
63	Qwen 3.5 Plus (hosted 397B-A17B)· Alibaba Qwen	25.4	n/a
64	GPT-5 Mini· OpenAI	21.6	$0.25
65	Grok-3 mini· xAI	21.1	n/a
66	Qwen3.5-Flash· Alibaba Qwen	20.3	$0.07
67	o4 Mini· OpenAI	19.6	$1.10
68	Qwen3.6 Flash· Alibaba Qwen	15.9	$0.19
69	o3 Mini· OpenAI	15.3	$1.10
70	gpt-oss-120b· OpenAI	13.9	$0.04
71	Claude Haiku 4.5· Anthropic	13.2	$1.00
72	GPT-4.1 Mini· OpenAI	12.7	$0.40
73	Claude 3 Opus· Anthropic	12.6	n/a
74	GPT-5 Nano· OpenAI	11.7	$0.05
75	GPT-5.4 Nano· OpenAI	11.7	$0.20
76	Gemma 4 31B· Google DeepMind	10.4	$0.09
77	GPT-4o-mini· OpenAI	8.3	$0.15
78	Claude 3.5 Haiku· Anthropic	6.7	n/a
79	GPT-4.1 Nano· OpenAI	6.0	$0.10