Mbpp

🏆 Leaderboard

As of August 31, 2026, Sarvam-30B is #1 for Mbpp at 92.7%. Ranked by the Mbpp score 32 models in this index have a published Mbpp score. Mbpp leaderboard: rank models by Mbpp next to live API token prices.

Updated August 31, 2026345 models36 providers

Mbpp vs price

32 models. Left is cheaper. Up is a higher score. The line is the best score you can buy at each price — a dot under it is a worse deal than something on the line.

Best score at each price#1 on this board


Sarvam-30BOSS Sarvam AI · Open Source	92.7%	$0.60
Llama-3.3 Nemotron Super 49B v1OSS NVIDIA · Open Source	91.3%	$0.50
Qwen2.5-Coder 32B InstructOSS Qwen · Open Source	90.2%	$0.18
MiniCPM-SALAOSS OpenBMB · Open Source	89.1%	$0.20
Qwen2.5 72B InstructOSS Qwen · Open Source	88.2%	$0.75
Llama 3.1 Nemotron Nano 8B V1OSS NVIDIA · Open Source	84.6%	$0.20
Qwen2.5 VL 32B InstructOSS Qwen · Open Source	84%	$0.90
Qwen2.5 32B InstructOSS Qwen · Open Source	84%	$3.50
Qwen2.5-Coder 7B InstructOSS Qwen · Open Source	83.5%	$0.60
Qwen2.5 14B InstructOSS Qwen · Open Source	82%	$1.75
Qwen3 235B A22BOSS Qwen · Open Source	81.4%	$0.20
Phi-3.5-MoE-instructOSS Microsoft · Open Source	80.8%	$0.21
Qwen2 72B InstructOSS Qwen · Open Source	80.2%	$0.75
Qwen2.5 7B InstructOSS Qwen · Open Source	79.2%	$0.60
Codestral-22BOSS Mistral · Open Source · via Mistral AI	78.2%	$1.20
Llama 4 MaverickOSS Meta · Open Source	77.6%	$1.02
Gemini Diffusion Google · Proprietary	76%	$2.80
Mistral Small 3.1 24B InstructOSS Mistral · Open Source · via OpenRouter	74.7%	$0.91
Gemma 3 27BOSS Google · Open Source	74.4%	$0.30
MiMo-V2.5-ProOSS Xiaomi · Open Source	74.1%	$1.30
Qwen2.5-Omni-7BOSS Qwen · Open Source	73.2%	$0.50
Gemma 3 12BOSS Google · Open Source	73%	$0.15
Phi-3.5-mini-instructOSS Microsoft · Open Source	69.6%	$0.20
Llama 4 ScoutOSS Meta · Open Source	67.8%	$0.38
Qwen2 7B InstructOSS Qwen · Open Source	67.2%	$0.60
Gemma 3n E4B Instructed Google · Proprietary	63.6%	$60.00
Gemma 3 4BOSS Google · Open Source	63.2%	$0.06
Gemma 2 27BOSS Google · Open Source · via OpenRouter	62.6%	$1.30
Gemma 3n E2B Instructed Google · Proprietary	56.6%	$0.06
Gemma 2 9BOSS Google · Open Source · via Groq	52.4%	$0.40
ERNIE 4.5 Baidu · Proprietary	40.2%	$4.40
Gemma 3 1BOSS Google · Open Source	35.2%	$0.06
ChatGPT-4o Latest OpenAI · Proprietary	—	$12.50
Claude 3 Haiku Anthropic · Proprietary	—	$1.50
Claude 3 Opus Anthropic · Proprietary	—	$90.00
Claude 3 Sonnet Anthropic · Proprietary	—	$18.00
Claude 3.5 Haiku Anthropic · Proprietary	—	$4.80
Claude 3.5 Sonnet Anthropic · Proprietary	—	$18.00
Claude 3.5 Sonnet Anthropic · Proprietary	—	$18.00
Claude 3.7 Sonnet Anthropic · Proprietary	—	$18.00
Claude Fable 5 Anthropic · Proprietary	—	$60.00
Claude Haiku 4.5 Anthropic · Proprietary	—	$6.00
Claude Mythos 5 Anthropic · Proprietary	—	$60.00
Claude Mythos Preview Anthropic · Proprietary	—	$60.00
Claude Opus 4 Anthropic · Proprietary	—	$90.00
Claude Opus 4.1 Anthropic · Proprietary	—	$90.00
Claude Opus 4.5 Anthropic · Proprietary	—	$30.00
Claude Opus 4.6 Anthropic · Proprietary	—	$30.00
Claude Opus 4.7 Anthropic · Proprietary	—	$30.00
Claude Opus 4.8 Anthropic · Proprietary	—	$30.00

Showing 1–50 of 345 models

Next step

You found the model. Now ship the product.

Auth, billing, and the API layer are already decided. Fork 8 finished AI apps, or have us build the first version with you.

Build with the APIs Have us build it with you

The index

All Large Language Models

345 models across 36 providers. Search or jump to a lab — every model page stays linked here.

Cursor

2 models

Composer 2 Composer 2 Fast

xAI

17 models

Grok 4.6 Grok 4.5 Grok 4.3 Grok-4.1 Grok-4.1 Fast Non-Reasoning Grok-4.1 Fast Reasoning Grok-4.1 Thinking Grok 4 Fast Grok Code Fast 1 Grok-4 Fast Non-Reasoning Grok-4 Fast Reasoning Grok-4 Grok-3 Grok-3 Mini Grok-2 Grok-1.5V Grok-1.5

MiniMax

7 models

MiniMax M3 MiniMax M2.7 MiniMax M2.5 MiniMax M2.1 MiniMax M2 MiniMax M1 40K MiniMax M1 80K

Qwen

55 models

Qwen3.8 Flash Qwen3.8-Flash-Next Qwen3.8-27B Qwen3.8-2.4T-A95B Qwen3.8 Max Qwen3.7 Flash Qwen3.7-Plus Qwen3.7 Max Qwen3.6-27B Qwen3.6-35B-A3B Qwen3.6 Plus Qwen3.5-0.8B Qwen3.5-2B Qwen3.5-4B Qwen3.5-9B Qwen3.5-122B-A10B Qwen3.5-27B Qwen3.5-35B-A3B Qwen3.5-397B-A17B Qwen3 Max Qwen3 VL 235B A22B Instruct Qwen3 VL 235B A22B Thinking Qwen3 VL 30B A3B Instruct Qwen3 VL 30B A3B Thinking Qwen3 VL 32B Instruct Qwen3 VL 32B Thinking Qwen3 VL 4B Instruct Qwen3 VL 4B Thinking Qwen3 VL 8B Instruct Qwen3 VL 8B Thinking Qwen3-Next-80B-A3B-Instruct Qwen3-Next-80B-A3B-Thinking Qwen3-235B-A22B-Thinking-2507 Qwen3-235B-A22B-Instruct-2507 Qwen3 235B A22B Qwen3 30B A3B Qwen3 32B Qwen2.5-Omni-7B QwQ-32B Qwen2.5 VL 32B Instruct Qwen3-Coder 480B A35B Instruct Qwen2.5 VL 72B Instruct Qwen2.5 VL 7B Instruct Qwen3-Coder QvQ-72B-Preview QwQ-32B-Preview Qwen2.5 14B Instruct Qwen2.5 32B Instruct Qwen2.5 72B Instruct Qwen2.5 7B Instruct Qwen2.5-Coder 32B Instruct Qwen2.5-Coder 7B Instruct Qwen2-VL-72B-Instruct Qwen2 72B Instruct Qwen2 7B Instruct

AI21 Labs

2 models

Jamba 1.5 Large Jamba 1.5 Mini

Amazon

7 models

Nova 2 Lite Nova 2 Omni Nova 2 Pro Nova 2 Sonic Nova Lite Nova Micro Nova Pro

Baidu

2 models

ERNIE 5.0 ERNIE 4.5

ByteDance

4 models

Seed 2.1 Pro Seed 2.1 Turbo Seed 2.0 Lite Seed 2.0 Pro

Cohere

4 models

North Micro Vision Instruct North Mini Code 1.0 Command A+Command R+

IBM

2 models

IBM Granite 4.0 Tiny Preview Granite 3.3 8B Instruct

Inception

1 models

Mercury 2

inclusionAI

1 models

Ling-3.0-flash

LG AI Research

1 models

K-EXAONE-236B-A23B

Liquid AI

2 models

LFM2.5-VL-3B LFM2.5-2.6B

Meituan

4 models

LongCat-Flash-Lite LongCat-Flash-Thinking-2601 LongCat-Flash-Thinking LongCat-Flash-Chat

Microsoft

9 models

MAI-Code-1.1-Flash MAI-Code-1-Flash MAI-Thinking-1 Phi 4 Mini Phi-4-multimodal-instruct Phi 4 Phi-3.5-mini-instruct Phi-3.5-MoE-instruct Phi-3.5-vision-instruct

Moonshot AI

11 models

Kimi K3 Kimi K2.7 Code Kimi K2.7 Code HighSpeed Kimi K2.6 Kimi K2.5 Kimi K2 0905 Kimi K2-Instruct-0905 Kimi K2-Thinking-0905 Kimi K2 Base Kimi K2 Instruct Kimi-k1.5

Nous Research

1 models

Hermes 3 70B

NVIDIA

9 models

Nemotron 3.5 Lightning (30B A3B)Nemotron 3 Ultra (550B A55B)Nemotron 3 Super (120B A12B)Nemotron 3 Nano (30B A3B)Nemotron Nano 9B v2 Llama 3.1 Nemotron Ultra 253B v1 Llama 3.1 Nemotron Nano 8B V1 Llama-3.3 Nemotron Super 49B v1 Llama 3.1 Nemotron 70B Instruct

OpenBMB

1 models

MiniCPM-SALA

Poolside

2 models

Laguna S 2.1 Laguna XS 2.1

Sakana AI

1 models

Sakana Namazu

Sarvam AI

2 models

Sarvam-105B Sarvam-30B

StepFun

2 models

Step-3.5-Flash Step3-VL-10B

Tencent

1 models

Hy3

Thinking Machines

1 models

Inkling-Small

Unisound

1 models

Upstage

1 models

Solar Pro 4

Xiaomi

5 models

MiMo-V2.5-Pro MiMo-V2.5 MiMo-V2-Omni MiMo-V2-Pro MiMo-V2-Flash

Which model leads Mbpp right now?

As of August 31, 2026, Sarvam-30B by Sarvam AI is #1 for Mbpp at 92.7%. Ranked by the Mbpp score This board also tracks Mbpp. Next on the same board: Llama-3.3 Nemotron Super 49B v1 and Qwen2.5-Coder 32B Instruct. This mbpp leaderboard ranks models by Mbpp. Scores come from public evals. Prices are the live API rates in the table above.

Sources: OpenAI API pricing (https://developers.openai.com/api/docs/pricing); Anthropic Claude API pricing (https://platform.claude.com/docs/en/about-claude/pricing); Gemini API pricing (https://ai.google.dev/gemini-api/docs/pricing)

Top 8 for mbpp. Ranked by the Mbpp score Input and output are dollars per million tokens.
Rank	Model	Mbpp	Input /M	Output /M
1	Sarvam-30B	92.7%	$0.30	$0.30
2	Llama-3.3 Nemotron Super 49B v1	91.3%	$0.10	$0.40
3	Qwen2.5-Coder 32B Instruct	90.2%	$0.09	$0.09
4	MiniCPM-SALA	89.1%	$0.10	$0.10
5	Qwen2.5 72B Instruct	88.2%	$0.35	$0.40
6	Llama 3.1 Nemotron Nano 8B V1	84.6%	$0.04	$0.16
7	Qwen2.5 VL 32B Instruct	84%	$0.40	$0.50
8	Qwen2.5 32B Instruct	84%	$0.70	$2.80

Related LLM leaderboards

LLM Leaderboard Coding Math Agentic Reasoning Writing Science Finance Long Context Vision Open Source

Individual benchmark pages

Rank one eval at a time. All LLM benchmarks.

HLE SWE Bench Humanity's Last Exam (No Tools)Humanity's Last Exam (With Tools)Terminal-Bench 2.0 Terminal-Bench Terminal-Bench 2.1 Terminal-Bench 2 Terminal-Bench 3.0 ARC-AGI-1 Verified

Mbpp FAQ

Who ranks #1 on the Mbpp leaderboard?

As of August 31, 2026, Sarvam-30B by Sarvam AI ranks #1 on Mbpp at 92.7%. API pricing is $0.30/M input and $0.30/M output.

What are the top models on Mbpp?

The current Mbpp ranking as of August 31, 2026 is 1. Sarvam-30B at 92.7%; 2. Llama-3.3 Nemotron Super 49B v1 at 91.3%; 3. Qwen2.5-Coder 32B Instruct at 90.2%.

Which mbpp model is the cheapest?

Gemma 3 4B is the cheapest scored model on this mbpp leaderboard at $0.02/M input and $0.04/M output ($0.06 blended). Sarvam-30B still leads Mbpp at 92.7%.

Should I always pick the #1 Mbpp model?

Not automatically. Sarvam-30B leads Mbpp, but a cheaper scored model can be the better production choice if the quality gap is small. Use the table to weigh Mbpp against input/output price, context window, and related evals.

How often is the Mbpp leaderboard updated?

Scores and API prices on this page are refreshed from published evals and provider rates. The snapshot is labeled August 31, 2026. Treat it as a current index, not a one-off blog post.

What is Mbpp?

Mbpp is a public LLM eval (the Mbpp score). This page ranks models that have published a score, next to live API prices.

Where is the Mbpp leaderboard?

This page is the Mbpp leaderboard. Models are sorted by Mbpp, with input and output token prices on the same row so you can weigh score against cost. Official boards often omit price; that comparison is the point of this index.

How is this Mbpp ranking different from the official board?

Official eval pages own the methodology. This page keeps the published Mbpp score next to live API $/M so you can pick a production SKU, not only a trophy number.

Mbpp vs price

You found the model. Now ship the product.

All Large Language Models

OpenAI

Anthropic

Google

Cursor

xAI

DeepSeek

MiniMax

Qwen

AI21 Labs

Amazon

Baidu

ByteDance

Cohere

IBM

Inception

inclusionAI

LG AI Research

Liquid AI

Meituan

Meta

Microsoft

Mistral

Moonshot AI

Nous Research

NVIDIA

OpenBMB

Poolside

Sakana AI

Sarvam AI

StepFun

Tencent

Thinking Machines

Unisound

Upstage

Xiaomi

Z AI

Which model leads Mbpp right now?

Related LLM leaderboards

Individual benchmark pages

Mbpp FAQ

Who ranks #1 on the Mbpp leaderboard?

What are the top models on Mbpp?

Which mbpp model is the cheapest?

Should I always pick the #1 Mbpp model?

How often is the Mbpp leaderboard updated?

What is Mbpp?

Where is the Mbpp leaderboard?

How is this Mbpp ranking different from the official board?