Muirbench

    🏆 Leaderboard

    As of August 31, 2026, Qwen3 VL 32B Thinking is #1 for Muirbench at 80.3%. Ranked by the Muirbench score 12 models in this index have a published Muirbench score. Muirbench leaderboard: rank models by Muirbench next to live API token prices.

    Updated August 31, 2026345 models36 providers

    Muirbench vs price

    12 models. Left is cheaper. Up is a higher score. The line is the best score you can buy at each price — a dot under it is a worse deal than something on the line.

    Best score at each price#1 on this board
    Qwen3 VL 32B ThinkingOSS
    Qwen · Open Source
    80.3%$0.80
    Qwen3 VL 235B A22B ThinkingOSS
    Qwen · Open Source
    80.1%$3.94
    Qwen3 VL 30B A3B ThinkingOSS
    Qwen · Open Source
    77.6%$1.20
    Qwen3 VL 8B ThinkingOSS
    Qwen · Open Source
    76.8%$2.27
    Qwen3 VL 4B ThinkingOSS
    Qwen · Open Source
    75%$1.10
    Qwen3 VL 32B InstructOSS
    Qwen · Open Source · via OpenRouter
    72.8%$0.52
    Qwen3 VL 235B A22B InstructOSS
    Qwen · Open Source
    72.8%$1.79
    Qwen3 VL 8B InstructOSS
    Qwen · Open Source
    64.4%$0.58
    Qwen3 VL 4B InstructOSS
    Qwen · Open Source
    63.8%$0.70
    Qwen3 VL 30B A3B InstructOSS
    Qwen · Open Source
    62.9%$0.90
    Qwen2.5-Omni-7BOSS
    Qwen · Open Source
    59.2%$0.50
    LFM2.5-VL-3BOSS
    Liquid AI · Open Source
    58.3%$0.15
    ChatGPT-4o Latest
    OpenAI · Proprietary
    $12.50
    Claude 3 Haiku
    Anthropic · Proprietary
    $1.50
    Claude 3 Opus
    Anthropic · Proprietary
    $90.00
    Claude 3 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.5 Haiku
    Anthropic · Proprietary
    $4.80
    Claude 3.5 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.5 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude 3.7 Sonnet
    Anthropic · Proprietary
    $18.00
    Claude Fable 5
    Anthropic · Proprietary
    $60.00
    Claude Haiku 4.5
    Anthropic · Proprietary
    $6.00
    Claude Mythos 5
    Anthropic · Proprietary
    $60.00
    Claude Mythos Preview
    Anthropic · Proprietary
    $60.00
    Claude Opus 4
    Anthropic · Proprietary
    $90.00
    Claude Opus 4.1
    Anthropic · Proprietary
    $90.00
    Claude Opus 4.5
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.6
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.7
    Anthropic · Proprietary
    $30.00
    Claude Opus 4.8
    Anthropic · Proprietary
    $30.00
    Claude Opus 5
    Anthropic · Proprietary
    $30.00
    Claude Sonnet 4
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 4.5
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 4.6
    Anthropic · Proprietary
    $18.00
    Claude Sonnet 5
    Anthropic · Proprietary
    $12.00
    Codestral-22BOSS
    Mistral · Open Source · via Mistral AI
    $1.20
    Command A+OSS
    Cohere · Open Source
    $12.50
    Command R+OSS
    Cohere · Open Source
    $1.25
    Composer 2
    Cursor · Proprietary
    $3.00
    Composer 2 Fast
    Cursor · Proprietary
    $9.00
    DeepSeek R1 Distill Llama 70BOSS
    DeepSeek · Open Source
    $0.50
    DeepSeek R1 Distill Qwen 32BOSS
    DeepSeek · Open Source
    $0.30
    DeepSeek VL2OSS
    DeepSeek · Open Source · via Replicate
    $2.80
    DeepSeek VL2 SmallOSS
    DeepSeek · Open Source · via Replicate
    $1.70
    DeepSeek VL2 TinyOSS
    DeepSeek · Open Source · via Replicate
    $0.90
    DeepSeek-R1OSS
    DeepSeek · Open Source
    $2.74
    DeepSeek-R1-0528OSS
    DeepSeek · Open Source
    $2.74
    DeepSeek-V2.5OSS
    DeepSeek · Open Source
    $0.42
    DeepSeek-V3OSS
    DeepSeek · Open Source
    $1.37
    DeepSeek-V3 0324OSS
    DeepSeek · Open Source
    $1.42
    Showing 150 of 345 models

    Next step

    You found the model. Now ship the product.

    Auth, billing, and the API layer are already decided. Fork 8 finished AI apps, or have us build the first version with you.

    The index

    All Large Language Models

    345 models across 36 providers. Search or jump to a lab — every model page stays linked here.

    Baidu

    2 models

    Inception

    1 models

    inclusionAI

    1 models

    LG AI Research

    1 models

    Liquid AI

    2 models

    Nous Research

    1 models

    OpenBMB

    1 models

    Sakana AI

    1 models

    Sarvam AI

    2 models

    Tencent

    1 models

    Thinking Machines

    1 models

    Unisound

    1 models

    Upstage

    1 models

    Which model leads Muirbench right now?

    As of August 31, 2026, Qwen3 VL 32B Thinking by Qwen is #1 for Muirbench at 80.3%. Ranked by the Muirbench score This board also tracks Muirbench. Next on the same board: Qwen3 VL 235B A22B Thinking and Qwen3 VL 30B A3B Thinking. This muirbench leaderboard ranks models by Muirbench. Scores come from public evals. Prices are the live API rates in the table above.

    Sources: OpenAI API pricing (https://developers.openai.com/api/docs/pricing); Anthropic Claude API pricing (https://platform.claude.com/docs/en/about-claude/pricing); Gemini API pricing (https://ai.google.dev/gemini-api/docs/pricing)

    Top 8 for muirbench. Ranked by the Muirbench score Input and output are dollars per million tokens.
    RankModelMuirbenchInput /MOutput /M
    1Qwen3 VL 32B Thinking80.3%$0.16$0.64
    2Qwen3 VL 235B A22B Thinking80.1%$0.45$3.49
    3Qwen3 VL 30B A3B Thinking77.6%$0.20$1.00
    4Qwen3 VL 8B Thinking76.8%$0.18$2.09
    5Qwen3 VL 4B Thinking75%$0.10$1.00
    6Qwen3 VL 235B A22B Instruct72.8%$0.30$1.49
    7Qwen3 VL 32B Instruct72.8%$0.10$0.42
    8Qwen3 VL 8B Instruct64.4%$0.08$0.50

    Muirbench FAQ

    Who ranks #1 on the Muirbench leaderboard?

    As of August 31, 2026, Qwen3 VL 32B Thinking by Qwen ranks #1 on Muirbench at 80.3%. API pricing is $0.16/M input and $0.64/M output.

    What are the top models on Muirbench?

    The current Muirbench ranking as of August 31, 2026 is 1. Qwen3 VL 32B Thinking at 80.3%; 2. Qwen3 VL 235B A22B Thinking at 80.1%; 3. Qwen3 VL 30B A3B Thinking at 77.6%.

    Which muirbench model is the cheapest?

    LFM2.5-VL-3B is the cheapest scored model on this muirbench leaderboard at $0.05/M input and $0.10/M output ($0.15 blended). Qwen3 VL 32B Thinking still leads Muirbench at 80.3%.

    Should I always pick the #1 Muirbench model?

    Not automatically. Qwen3 VL 32B Thinking leads Muirbench, but a cheaper scored model can be the better production choice if the quality gap is small. Use the table to weigh Muirbench against input/output price, context window, and related evals.

    How often is the Muirbench leaderboard updated?

    Scores and API prices on this page are refreshed from published evals and provider rates. The snapshot is labeled August 31, 2026. Treat it as a current index, not a one-off blog post.

    What is Muirbench?

    Muirbench is a public LLM eval (the Muirbench score). This page ranks models that have published a score, next to live API prices.

    Where is the Muirbench leaderboard?

    This page is the Muirbench leaderboard. Models are sorted by Muirbench, with input and output token prices on the same row so you can weigh score against cost. Official boards often omit price; that comparison is the point of this index.

    How is this Muirbench ranking different from the official board?

    Official eval pages own the methodology. This page keeps the published Muirbench score next to live API $/M so you can pick a production SKU, not only a trophy number.