NEWHow AI models draw the world map · Gecko Tests
Beta
Home/Models/Vicuna 7b V1.5

Vicuna 7b V1.5

by LMSYS · Released Jul 2023

Open Source
18.8
avg score
Rank #282
Compare
Better than 10% of all models
Context
N/A
Input $/1M
n/a
Output $/1M
n/a
Type
text-generation
License
Open Source
Benchmarks
6 tested
Data as of
About

Lmsys text generation model. 2866K downloads on HuggingFace.

Tested on 6 benchmarks · BenchGecko score 18.8. Top scores: IFEval (23.5%), BBH (HuggingFace) (15.2%), MMLU-PRO (12.7%).

Capabilities
reasoning
11.4
#167 globally
math
1.4
#279 globally
knowledge
6.9
#292 globally
general
15.2
#179 globally
language
23.5
#155 globally
Benchmark Scores
Compare All
Tested on 6 benchmarks · Ranked across 5 categories
Score Distribution (all 312 models)
0255075100
▲ You are here
reasoningCompare reasoning →
MUSR

HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.

11.4·
mathCompare math →
MATH Level 5

HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.

1.4·
knowledgeCompare knowledge →
MMLU-PRO

HuggingFace MMLU-Pro. Harder version of MMLU with 10 answer choices instead of 4 and more challenging questions.

12.7·
GPQA

HuggingFace evaluation of GPQA (Graduate-Level Google-Proof Q&A). PhD-level science questions that cannot be easily searched.

1.1·
Quick compare:Google DeepMind logovs Gemma 2 2bOpenAI logovs Cerebras-GPT-13BMistral AI logovs Mistral 7B Instruct v0.1
Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Similar Models
Google DeepMind logo
Gemma 2 2b
Google DeepMind
18.4n/a
OpenAI logo
Cerebras-GPT-13B
OpenAI
18.2n/a
Mistral AI logo
Mistral 7B Instruct v0.1
Mistral AI
18.0$0.11/1M
Links
Info
LMSYSPricing explorerDevelopers · API
Research
Technical Report
Documentation
API DocsPlayground
Community
@LMSYS
Source Code
GitHubHugging Face
BenchGecko API
lmsys-vicuna-7b-v15
Specifications
  • Typetext-generation
  • ContextN/A
  • ReleasedJul 2023
  • LicenseOpen Source
  • StatusActive
Available On
LMSYSn/a
Categories
reasoningmathknowledgegenerallanguage
Learn More
transformeropen weightstokens
Share & Export
Tweet
Related Models
Google DeepMind logoGemma 2 2b
18.4
OpenAI logoCerebras-GPT-13B
18.2
Mistral AI logoMistral 7B Instruct v0.1
18.0
Google DeepMind logoGemini 1.0 Pro
19.9
Vicuna 7b V1.5 is an open-source text-generation AI model by LMSYS, released in July 2023. It has an average benchmark score of 18.8.

Related Models

Gemma 2 2b · Google DeepMindCerebras-GPT-13B · OpenAIMistral 7B Instruct v0.1 · Mistral AIGemini 1.0 Pro · Google DeepMindRedPajama-INCITE-7B-Base · Unknown

Benchmarks

IFEvalBBH (HuggingFace)MMLU-PROMUSRMATH Level 5

Related Pages

LMSYS · ProviderLMSYS · EconomyAll ModelsCompare ModelsPricingDevelopers · API

Key facts · as of 2026-04-09

  • Vicuna 7b V1.5 by LMSYS. BenchGecko score 18.8, rank 282 of 312 scored models (normalized average of public benchmark scores).
  • List price n/a input · n/a output per 1M tokens (as of 2026-04-09).

How to cite · data as of 2026-04-09

Vicuna 7b V1.5 · benchmarks, pricing and providers. BenchGecko, data as of 2026-04-09. https://benchgecko.ai/model/lmsys-vicuna-7b-v15

Credit "Source: BenchGecko" with a link. Prices per provider and Gecko Tests are BenchGecko data (CC BY 4.0); benchmark scores keep their original source, listed in the JSON. JSON · llms.txt · MCP