What does BBH (HuggingFace) measure?

BBH (HuggingFace) is a knowledge benchmark in the BenchGecko catalog. 78 AI models have been tested on it. Scores range from 1.0 to 61.9 out of 100.

Which model leads on BBH (HuggingFace)?

Qwen2.5 72B Instruct from Alibaba Qwen leads BBH (HuggingFace) with a score of 61.9. The median score across 78 tested models is 24.7.

Is BBH (HuggingFace) saturated?

No · the top score is 61.9 out of 100 (62%). There is still meaningful room for improvement on BBH (HuggingFace).

Does BBH (HuggingFace) predict performance on other benchmarks?

Yes · BBH (HuggingFace) scores correlate 0.93 with MMLU-PRO across 78 shared models. Models that do well on BBH (HuggingFace) tend to do well on MMLU-PRO.

How often is BBH (HuggingFace) data refreshed?

BenchGecko pulls updates daily. New model scores on BBH (HuggingFace) appear as soon as they are published by Epoch AI or the model provider.

Benchmark · KnowledgeSettled

BBH (HuggingFace)

Name: BBH (HuggingFace) Benchmark
Creator: BenchGecko
License: https://creativecommons.org/licenses/by/4.0/

Updated 2025-10-17

Models tested

Top score

61.9

Qwen2.5 72B Instruct

Median

24.7

min 1.0

Top-5 spread

σ 2.4

Competitive

The Frontier

Best score over time · one chart, every benchmark

Chart type

Only 21 models have been tested on BBH (HuggingFace) · not enough history to compute a frontier yet.

Pink dots = frontier records · 0 totalClick to open model page

Full rankings

78 models tested · sorted by score

#	Model	Score	Price
1	Qwen2.5 72B Instruct· Alibaba Qwen	61.9	$0.36
2	HA Qwen2.5 72B Instruct Abliterated· HuiHui AI	60.5	n/a
3	Llama 3.3 70B Instruct· Meta	56.6	$0.10
4	Qwen2.5 32B Instruct· Alibaba	56.5	n/a
5	Llama 3.1 70B Instruct· Meta	55.9	$0.40
6	Phi 4· Microsoft	55.7	$0.07
7	Hermes 3 70B Instruct· nousresearch	53.8	$0.70
8	Qwen2.5 Coder 32B Instruct· Alibaba Qwen	52.3	$0.66
9	Qwen2-72B· Alibaba Qwen	51.9	n/a
10	Gemma 2 27B· Google DeepMind	49.3	$0.65
11	Meta Llama 3 8B· Meta	48.7	n/a
12	WizardLM-2 8x22B· Microsoft	48.6	$0.62
13	Qwen2.5 14B Instruct· Alibaba	48.6	n/a
14	Qwen2.5 Coder 14B Instruct· Alibaba	44.2	n/a
15	D Dolphin 2.9.1 Yi 1.5 34b· DPHN	44.2	n/a
16	Gemma 2 9B· Google DeepMind	42.1	$0.03
17	U Stable Beluga 2· Unknown	41.3	n/a
18	DeepSeek R1 Distill Qwen 14B· DeepSeek	40.7	n/a
19	Phi 4 Mini Instruct· Microsoft	38.7	$0.08
20	Phi 4 Mini Instruct· Microsoft	38.7	n/a
21	Qwen2 7B Instruct· Alibaba	37.8	n/a
22	Phi 3.5 Mini Instruct· Microsoft	36.8	n/a
23	Phi 3 Mini 4k Instruct· Microsoft	36.6	n/a
24	Qwen2 VL 7B Instruct· Alibaba	35.9	n/a
25	DeepSeek R1 Distill Llama 8B· DeepSeek	35.8	n/a
26	R1 Distill Llama 70B· DeepSeek	35.8	$0.80
27	GLM 4 32B · z-ai	35.8	$0.10
28	Magnum v4 72B· anthracite-org	35.5	$3.00
29	U Yi 6B· Unknown	35.5	n/a
30	Qwen2.5 7B Instruct· Alibaba Qwen	34.9	$0.10
31	Hermes 2 Pro - Llama-3 8B· nousresearch	30.7	$0.14
32	Llama 3.1 8B Instruct· Meta	29.2	$0.02
33	Qwen2.5 Coder 7B Instruct· Alibaba Qwen	28.9	$0.03
34	Qwen2.5 Coder 7B Instruct· Alibaba	28.9	n/a
35	Meta Llama 3 8B Instruct· Meta	28.2	n/a
36	Phi 2· Microsoft	28.0	n/a
37	Llama 3-70B· Meta	26.7	n/a
38	Qwen2.5 3B Instruct· Alibaba	25.8	n/a
39	LLaMA-13B· Meta	25.3	n/a
40	Llama 3.2 3B Instruct· Meta	24.1	$0.05
41	Mistral 7B Instruct V0.2· Mistral AI	22.9	n/a
42	Mistral 7B V0.1· Mistral AI	22.0	n/a
43	Falcon-180B· TII	21.9	n/a
44	Gemma 2B· Google DeepMind	21.1	n/a
45	U StarCoder 2 15B· Unknown	20.4	n/a
46	Qwen2.5 1.5B Instruct· Alibaba	19.8	n/a
47	Llama 3 8B Instruct· Meta	18.4	$0.14
48	Gemma 2 2b It· Google DeepMind	18.0	n/a
49	DeepSeek R1 Distill Qwen 32B· DeepSeek	17.1	n/a
50	R1 Distill Qwen 32B· DeepSeek	17.1	$0.29
51	L Vicuna 7b V1.5· LMSYS	15.2	n/a
52	Llama 3.2 3B Instruct (free)· Meta	14.2	$0.00
53	Qwen2 1.5B Instruct· Alibaba	13.7	n/a
54	Gemma 2 2b· Google DeepMind	12.5	n/a
55	Llama 2 7b Hf· Meta	10.3	n/a
56	Llama 3.2 1B Instruct· Meta	8.3	$0.03
57	Qwen2.5 0.5B Instruct· Alibaba	8.2	n/a
58	Qwen2 0.5B· Alibaba	7.9	n/a
59	DeepSeek R1 Distill Qwen 7B· DeepSeek	7.9	n/a
60	Llama 3.1 405B· Meta	7.8	n/a
61	Mistral 7B Instruct v0.1· Mistral AI	7.7	$0.11
62	Phi-1.5· Microsoft	7.5	n/a
63	U MPT-30B· Unknown	6.5	n/a
64	Qwen2 0.5B Instruct· Alibaba	5.9	n/a
65	U RedPajama-INCITE-7B-Base· Unknown	5.1	n/a
66	DeepSeek R1 Distill Qwen 1.5B· DeepSeek	4.7	n/a
67	HF SmolLM2 135M Instruct· Hugging Face TB	4.7	n/a
68	Llama 2 7b Chat Hf· Meta	4.5	n/a
69	T TinyLlama 1.1B Chat V1.0· TinyLlama	4.0	n/a
70	HF SmolLM2 135M· Hugging Face TB	3.7	n/a
71	Gpt Neo 125m· eleutherai	3.4	n/a
72	Gpt2 Large· OpenAI	3.3	n/a
73	QwQ 32B· Alibaba Qwen	2.9	$0.15
74	D Distilgpt2· DistilBERT	2.8	n/a
75	Gpt2 Medium· OpenAI	2.7	n/a
76	Gpt2· OpenAI	2.7	n/a
77	Pythia 160m· eleutherai	2.2	n/a
78	U INTELLECT-1· Unknown	1.0	n/a