Who ranks #1 on the Collie leaderboard?
As of August 31, 2026, GPT-5 by OpenAI ranks #1 on Collie at 99%. API pricing is $1.25/M input and $10.00/M output.
Collie
🏆 LeaderboardAs of August 31, 2026, GPT-5 is #1 for Collie at 99%. Ranked by the Collie score 10 models in this index have a published Collie score. Collie leaderboard: rank models by Collie next to live API token prices.
Updated August 31, 2026345 models36 providers
Collie vs price
10 models. Left is cheaper. Up is a higher score. The line is the best score you can buy at each price — a dot under it is a worse deal than something on the line.
Best score at each price#1 on this board
Showing 1–50 of 345 models
Next step
You found the model. Now ship the product.
Auth, billing, and the API layer are already decided. Fork 8 finished AI apps, or have us build the first version with you.
The index
All Large Language Models
345 models across 36 providers. Search or jump to a lab — every model page stays linked here.
OpenAI
52 modelsGPT-5.6 CyberGPT-5.6 LunaGPT-5.6 SolGPT-5.6 TerraGPT-5.5 InstantGPT-5.5GPT-5.5 ProGPT-5.4 miniGPT-5.4 nanoGPT-5.4GPT-5.3 ChatGPT-5.3 CodexGPT-5.2 CodexGPT-5.2GPT-5.2 ProGPT-5.1 CodexGPT-5.1GPT-5.1 Codex HighGPT-5.1 Codex MiniGPT-5.1 HighGPT-5.1 InstantGPT-5.1 MediumGPT-5.1 ThinkingGPT-5 CodexGPT-5GPT-5 HighGPT-5 MediumGPT-5 miniGPT-5 nanoGPT OSS 120BGPT OSS 120B HighGPT OSS 20BGPT OSS 20B Higho3-proo3o4-miniGPT-4.1GPT-4.1 miniGPT-4.1 nanoGPT-4.5o3-minio1o1-proo1-minio1-previewGPT-4oGPT-4o miniChatGPT-4o LatestGPT-4oGPT-4 TurboGPT-4GPT-3.5 Turbo
Anthropic
22 modelsClaude Opus 5Claude Sonnet 5Claude Fable 5Claude Mythos 5Claude Opus 4.8Claude Opus 4.7Claude Sonnet 4.6Claude Opus 4.6Claude Opus 4.5Claude Haiku 4.5Claude Sonnet 4.5Claude Opus 4.1Claude Opus 4Claude Sonnet 4Claude 3.7 SonnetClaude 3.5 HaikuClaude 3.5 SonnetClaude 3.5 SonnetClaude 3 HaikuClaude 3 OpusClaude 3 SonnetClaude Mythos Preview
Gemini 3.7 FlashGemini 3.5 Flash-LiteGemini 3.6 FlashDiffusionGemma 26B-A4BGemma 4 12BGemini 3.5 FlashGemma 4 26B-A4BGemma 4 31BGemma 4 E2BGemma 4 E4BGemini 3.1 Flash-LiteGemini 3.1 ProGemini 3 FlashGemini 3 ProGemma 3n E2B InstructedGemma 3n E4B InstructedGemini 2.5 Flash-LiteGemini 2.5 Pro Preview 06-05Gemini 2.5 FlashGemini 2.5 ProGemini DiffusionMedGemma 4B ITGemma 3 12BGemma 3 1BGemma 3 27BGemma 3 4BGemini 2.0 Flash-LiteGemini 2.0 FlashGemma 2 27BGemma 2 9BGemini 1.5 FlashGemini 1.5 ProGemini 1.5 Flash 8BGemini 1.0 Pro
Cursor
2 models
xAI
17 models
DeepSeek
20 modelsDeepSeek-V4-Flash-Vision-ExpDeepSeek-V4-Pro-0813DeepSeek-V4-Flash-0731DeepSeek-V4-Flash-0423DeepSeek-V4-Flash-MaxDeepSeek-V4-Pro-MaxDeepSeek-V3.2DeepSeek-V3.2 (Non-thinking)DeepSeek-V3.2-ExpDeepSeek-R1-0528DeepSeek-V3 0324DeepSeek R1 Distill Llama 70BDeepSeek R1 Distill Qwen 32BDeepSeek-R1DeepSeek-V3.1DeepSeek-V3DeepSeek VL2DeepSeek VL2 SmallDeepSeek VL2 TinyDeepSeek-V2.5
Qwen
55 modelsQwen3.8 FlashQwen3.8-Flash-NextQwen3.8-27BQwen3.8-2.4T-A95BQwen3.8 MaxQwen3.7 FlashQwen3.7-PlusQwen3.7 MaxQwen3.6-27BQwen3.6-35B-A3BQwen3.6 PlusQwen3.5-0.8BQwen3.5-2BQwen3.5-4BQwen3.5-9BQwen3.5-122B-A10BQwen3.5-27BQwen3.5-35B-A3BQwen3.5-397B-A17BQwen3 MaxQwen3 VL 235B A22B InstructQwen3 VL 235B A22B ThinkingQwen3 VL 30B A3B InstructQwen3 VL 30B A3B ThinkingQwen3 VL 32B InstructQwen3 VL 32B ThinkingQwen3 VL 4B InstructQwen3 VL 4B ThinkingQwen3 VL 8B InstructQwen3 VL 8B ThinkingQwen3-Next-80B-A3B-InstructQwen3-Next-80B-A3B-ThinkingQwen3-235B-A22B-Thinking-2507Qwen3-235B-A22B-Instruct-2507Qwen3 235B A22BQwen3 30B A3BQwen3 32BQwen2.5-Omni-7BQwQ-32BQwen2.5 VL 32B InstructQwen3-Coder 480B A35B InstructQwen2.5 VL 72B InstructQwen2.5 VL 7B InstructQwen3-CoderQvQ-72B-PreviewQwQ-32B-PreviewQwen2.5 14B InstructQwen2.5 32B InstructQwen2.5 72B InstructQwen2.5 7B InstructQwen2.5-Coder 32B InstructQwen2.5-Coder 7B InstructQwen2-VL-72B-InstructQwen2 72B InstructQwen2 7B Instruct
AI21 Labs
2 models
ByteDance
4 models
Inception
1 models
inclusionAI
1 models
LG AI Research
1 models
Liquid AI
2 models
Meituan
4 models
Meta
12 models
Microsoft
9 models
Mistral
26 modelsShieldstral 1.0 (3B)Mistral Medium 3.5Mistral Small 4Min istral 3 (3B Reasoning 2512)MiniStral 3 (14B Instruct 2512)Ministral 3 (14B Reasoning 2512)Ministral 3 (3B Instruct 2512)Ministral 3 (8B Instruct 2512)Ministral 3 (8B Reasoning 2512)Mistral Large 3 (675B Instruct 2512)Mistral Large 3Devstral Small 1.1Devstral MediumMistral Small 3.2 24B InstructMagistral MediumMagistral Small 2506Mistral Small 3.1 24B BaseMistral Small 3.1 24B InstructMistral Small 3 24B InstructPixtral LargeMinistral 8B InstructMistral SmallPixtral-12BMistral Large 2Mistral NeMo InstructCodestral-22B
Moonshot AI
11 models
Nous Research
1 models
NVIDIA
9 models
OpenBMB
1 models
Poolside
2 models
Sakana AI
1 models
Sarvam AI
2 models
StepFun
2 models
Tencent
1 models
Thinking Machines
1 models
Unisound
1 models
Upstage
1 modelsWhich model leads Collie right now?
As of August 31, 2026, GPT-5 by OpenAI is #1 for Collie at 99%. Ranked by the Collie score This board also tracks Collie. Next on the same board: o3-mini and o3. This collie leaderboard ranks models by Collie. Scores come from public evals. Prices are the live API rates in the table above.
Sources: OpenAI API pricing (https://developers.openai.com/api/docs/pricing); Anthropic Claude API pricing (https://platform.claude.com/docs/en/about-claude/pricing); Gemini API pricing (https://ai.google.dev/gemini-api/docs/pricing)
| Rank | Model | Collie | Input /M | Output /M |
|---|---|---|---|---|
| 1 | GPT-5 | 99% | $1.25 | $10.00 |
| 2 | o3-mini | 98.7% | $1.10 | $4.40 |
| 3 | o3 | 98.4% | $2.00 | $8.00 |
| 4 | Mistral Medium 3.5 | 95.8% | $1.50 | $7.50 |
| 5 | GPT-4.5 | 72.3% | $75.00 | $150.00 |
| 6 | GPT-4.1 | 65.8% | $2.00 | $8.00 |
| 7 | Mistral Small 4 | 62.9% | $0.15 | $0.60 |
| 8 | GPT-4o | 61% | $2.50 | $10.00 |
Related LLM leaderboards
Individual benchmark pages
Rank one eval at a time. All LLM benchmarks.
Collie FAQ
What are the top models on Collie?
The current Collie ranking as of August 31, 2026 is 1. GPT-5 at 99%; 2. o3-mini at 98.7%; 3. o3 at 98.4%.
Which collie model is the cheapest?
GPT-4.1 nano is the cheapest scored model on this collie leaderboard at $0.10/M input and $0.40/M output ($0.50 blended). GPT-5 still leads Collie at 99%.
Should I always pick the #1 Collie model?
Not automatically. GPT-5 leads Collie, but a cheaper scored model can be the better production choice if the quality gap is small. Use the table to weigh Collie against input/output price, context window, and related evals.
How often is the Collie leaderboard updated?
Scores and API prices on this page are refreshed from published evals and provider rates. The snapshot is labeled August 31, 2026. Treat it as a current index, not a one-off blog post.
What is Collie?
Collie is a public LLM eval (the Collie score). This page ranks models that have published a score, next to live API prices.
Where is the Collie leaderboard?
This page is the Collie leaderboard. Models are sorted by Collie, with input and output token prices on the same row so you can weigh score against cost. Official boards often omit price; that comparison is the point of this index.
How is this Collie ranking different from the official board?
Official eval pages own the methodology. This page keeps the published Collie score next to live API $/M so you can pick a production SKU, not only a trophy number.