Open-weight AI models: benchmarks and pricing
Weights are the model files needed to run it yourself, with suitable software and hardware. Compare models with downloadable weights. Open weights do not automatically mean an open-source license, unrestricted commercial use, or free hosting. API prices here describe the reported hosted service; check each model’s license before deployment.
Which should you choose?
No single benchmark covers every use case. Try your own prompts and compare accuracy, response time, input/output support, and the actual bill.
AI models
| Model | Intelligence score | Benchmark cost (USD) | Input price / 1M tokens (USD) | Output price / 1M tokens (USD) | Output speed |
|---|---|---|---|---|---|
| Apertus 70B InstructSwiss AI Initiative | 2.00 | - | 0.82 | 2.92 | - |
| Apertus 8B InstructSwiss AI Initiative | 1.00 | - | 0.10 | 0.20 | - |
| Apriel-v1.5-15B-ThinkerServiceNow | 21.60 | - | 0.00 | 0.00 | - |
| Apriel-v1.6-15B-ThinkerServiceNow | 20.80 | - | 0.00 | 0.00 | - |
| Arctic InstructSnowflake | 3.00 | - | - | - | - |
| Cogito v2.1 (Reasoning)Deep Cogito | - | - | 1.25 | 1.25 | - |
| Command ACohere | 7.50 | - | 2.50 | 10.00 | 58 tok/s |
| Command-R (Mar '24)Cohere | 1.70 | - | 0.50 | 1.50 | - |
| Command-R+ (Apr '24)Cohere | 2.60 | - | 3.00 | 15.00 | - |
| DBRX InstructDatabricks | 2.60 | - | - | - | - |
| DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning)Nous Research | 1.90 | - | - | - | - |
| DeepHermes 3 - Mistral 24B Preview (Non-reasoning)Nous Research | 5.00 | - | - | - | - |
| DeepSeek Coder V2 Lite InstructDeepSeek | 2.70 | - | - | - | - |
| DeepSeek LLM 67B Chat (V1)DeepSeek | 2.60 | - | - | - | - |
| DeepSeek R1 (Jan '25)DeepSeek | 18.60 | $403 | 1.68 | 4.70 | - |
| DeepSeek R1 0528 (May '25)DeepSeek | 20.40 | - | 1.35 | 4.20 | - |
| DeepSeek R1 0528 Qwen3 8BDeepSeek | 10.30 | - | - | - | - |
| DeepSeek R1 Distill Llama 70BDeepSeek | 9.80 | - | 0.70 | 1.10 | 27 tok/s |
| DeepSeek R1 Distill Llama 8BDeepSeek | 6.20 | - | - | - | - |
| DeepSeek R1 Distill Qwen 1.5BDeepSeek | 3.30 | - | - | - | - |
| DeepSeek R1 Distill Qwen 14BDeepSeek | 9.70 | - | - | - | - |
| DeepSeek R1 Distill Qwen 32BDeepSeek | 11.00 | - | - | - | - |
| DeepSeek V3 (Dec '24)DeepSeek | 14.20 | $20.0 | 0.36 | 0.89 | - |
| DeepSeek V3 0324DeepSeek | 15.20 | $35.2 | 0.27 | 1.12 | - |
| DeepSeek V3.1 (Non-reasoning)DeepSeek | 21.40 | - | 0.56 | 1.68 | - |
| DeepSeek V3.1 (Reasoning)DeepSeek | 21.00 | - | 0.59 | 1.69 | - |
| DeepSeek V3.1 Terminus (Non-reasoning)DeepSeek | 21.70 | - | 0.27 | 1.00 | - |
| DeepSeek V3.1 Terminus (Reasoning)DeepSeek | 31.10 | - | 1.64 | 2.75 | - |
| DeepSeek V3.2 (Non-reasoning)DeepSeek | 25.10 | - | 0.28 | 0.42 | - |
| DeepSeek V3.2 (Reasoning)DeepSeek | 32.80 | - | 0.28 | 0.42 | - |
| DeepSeek V3.2 Exp (Non-reasoning)DeepSeek | 21.70 | - | 0.28 | 0.42 | - |
| DeepSeek V3.2 Exp (Reasoning)DeepSeek | 25.90 | - | 0.28 | 0.42 | - |
| DeepSeek V3.2 SpecialeDeepSeek | 22.60 | - | - | - | - |
| DeepSeek V4 Flash (Non-reasoning)DeepSeek | 29.30 | - | 0.14 | 0.28 | - |
| DeepSeek V4 Flash (Reasoning, High Effort)DeepSeek | 39.00 | $58.5 | 0.14 | 0.28 | - |
| DeepSeek V4 Flash (Reasoning, Max Effort)DeepSeek | 42.10 | $104 | 0.13 | 0.28 | - |
| DeepSeek V4 Flash 0731 (Reasoning, Max Effort)DeepSeek | 51.80 | $323 | 0.44 | 1.32 | 114 tok/s |
| DeepSeek V4 Pro (Non-reasoning)DeepSeek | 31.90 | - | 0.43 | 0.87 | 88 tok/s |
| DeepSeek V4 Pro (Reasoning, High Effort)DeepSeek | 43.70 | $109 | 0.43 | 0.87 | 87 tok/s |
| DeepSeek V4 Pro (Reasoning, Max Effort)DeepSeek | 45.30 | $176 | 0.43 | 0.87 | 83 tok/s |
| DeepSeek V4 Pro 0813 (Reasoning, Max Effort)DeepSeek | 53.20 | $605 | 1.32 | 3.96 | 85 tok/s |
| DeepSeek-Coder-V2DeepSeek | 4.70 | - | - | - | - |
| DeepSeek-V2-ChatDeepSeek | 3.30 | - | - | - | - |
| DeepSeek-V2.5DeepSeek | 6.40 | - | - | - | - |
| DeepSeek-V2.5 (Dec '24)DeepSeek | 6.50 | - | - | - | - |
| Devstral Small (Jul '25)Mistral | 9.10 | - | - | - | - |
| Devstral Small (May '25)Mistral | 11.80 | - | - | - | - |
| DiffusionGemma 26B A4BGoogle | 13.50 | - | - | - | - |
| ERNIE 4.5 300B A47BBaidu | 8.90 | - | 0.28 | 1.10 | - |
| Exaone 4.0 1.2B (Non-reasoning)LG AI Research | 2.40 | - | - | - | - |
| Exaone 4.0 1.2B (Reasoning)LG AI Research | 2.50 | - | - | - | - |
| EXAONE 4.0 32B (Non-reasoning)LG AI Research | 5.70 | - | - | - | - |
| EXAONE 4.0 32B (Reasoning)LG AI Research | 10.50 | - | - | - | - |
| EXAONE 4.5 33BLG AI Research | 20.50 | - | - | - | - |
| EXAONE 4.5 33B (Non-reasoning)LG AI Research | - | - | - | - | - |
| Falcon-H1R-7BTII UAE | 9.70 | - | - | - | - |
| G9v3-39A5BAI9Stars | 31.60 | - | 0.00 | 0.00 | - |
| G9v3-3BAI9Stars | 16.20 | - | 0.00 | 0.00 | - |
| Gemma 3 1B InstructGoogle | 1.00 | - | 0.00 | 0.00 | - |
| Gemma 3 270MGoogle | 2.00 | - | - | - | - |
| Gemma 3 4B InstructGoogle | 1.00 | - | 0.00 | 0.00 | - |
| Gemma 3n E2B InstructGoogle | 1.00 | - | 0.00 | 0.00 | - |
| Gemma 3n E4B InstructGoogle | 1.00 | - | 0.06 | 0.12 | 57 tok/s |
| Gemma 3n E4B Instruct Preview (May '25)Google | 4.20 | - | - | - | - |
| Gemma 4 12B (Non-reasoning)Google | 13.20 | - | 0.10 | 0.30 | 116 tok/s |
| Gemma 4 12B (Reasoning)Google | 22.20 | - | 0.10 | 0.30 | 113 tok/s |
| Gemma 4 26B A4B (Non-reasoning)Google | 20.40 | - | 0.13 | 0.40 | 66 tok/s |
| Gemma 4 26B A4B (Reasoning)Google | 26.10 | $59.5 | 0.13 | 0.40 | - |
| Gemma 4 31B (Non-reasoning)Google | 22.30 | $32.8 | 0.15 | 0.40 | 84 tok/s |
| Gemma 4 E2B (Non-reasoning)Google | 6.20 | - | - | - | - |
| Gemma 4 E2B (Reasoning)Google | 9.50 | - | - | - | - |
| Gemma 4 E4B (Non-reasoning)Google | 8.70 | - | 0.02 | 0.10 | 52 tok/s |
| Gemma 4 E4B (Reasoning)Google | 12.20 | - | 0.02 | 0.10 | 48 tok/s |
| GLM-4.5 (Reasoning)Z AI | 19.70 | - | - | - | - |
| GLM-4.5-AirZ AI | 16.70 | - | 0.17 | 0.98 | 75 tok/s |
| GLM-4.5V (Non-reasoning)Z AI | 6.80 | - | 0.60 | 1.80 | 100 tok/s |
| GLM-4.5V (Reasoning)Z AI | 9.00 | - | 0.60 | 1.80 | 85 tok/s |
| GLM-4.6 (Non-reasoning)Z AI | 23.40 | - | 0.57 | 2.20 | 77 tok/s |
| GLM-4.6 (Reasoning)Z AI | 29.30 | $314 | 0.55 | 2.20 | 51 tok/s |
| GLM-4.6V (Non-reasoning)Z AI | 10.90 | - | 0.30 | 0.90 | 71 tok/s |
| GLM-4.6V (Reasoning)Z AI | 16.90 | - | 0.30 | 0.90 | 69 tok/s |
| GLM-4.7 (Non-reasoning)Z AI | 27.10 | - | 0.60 | 2.20 | 115 tok/s |
| GLM-4.7 (Reasoning)Z AI | 34.50 | $607 | 0.60 | 2.20 | 113 tok/s |
| GLM-4.7-Flash (Non-reasoning)Z AI | 15.60 | - | 0.07 | 0.40 | 124 tok/s |
| GLM-4.7-Flash (Reasoning)Z AI | 23.30 | - | 0.07 | 0.40 | 98 tok/s |
| GLM-5 (Non-reasoning)Z AI | 33.20 | - | 1.00 | 3.20 | 40 tok/s |
| GLM-5 (Reasoning)Z AI | 40.60 | - | 1.00 | 3.20 | 42 tok/s |
| GLM-5.1 (Non-reasoning)Z AI | 36.30 | - | 1.38 | 4.40 | 74 tok/s |
| GLM-5.1 (Reasoning)Z AI | 41.00 | $676 | 1.38 | 4.40 | 81 tok/s |
| GLM-5.2 (max)Z AI | 52.60 | $735 | 1.40 | 4.40 | 139 tok/s |
| GLM-5.2 (Non-reasoning)Z AI | 34.80 | - | 1.40 | 4.40 | 140 tok/s |
| gpt-oss-120b (high)OpenAI | 24.10 | $95.0 | 0.15 | 0.60 | 176 tok/s |
| gpt-oss-120b (low)OpenAI | 14.90 | $24.2 | 0.15 | 0.59 | 202 tok/s |
| gpt-oss-20b (high)OpenAI | 15.20 | $32.7 | 0.06 | 0.19 | 125 tok/s |
| gpt-oss-20b (low)OpenAI | 14.40 | - | 0.07 | 0.20 | 152 tok/s |
| Granite 3.3 8B (Non-reasoning)IBM | 1.30 | - | 0.03 | 0.25 | 15 tok/s |
| Granite 4.0 1BIBM | 1.60 | - | - | - | - |
| Granite 4.0 350MIBM | 1.00 | - | - | - | - |
| Granite 4.0 H 1BIBM | 2.20 | - | - | - | - |
| Granite 4.0 H 350MIBM | 1.00 | - | - | - | - |
| Granite 4.0 H SmallIBM | 4.90 | - | 0.06 | 0.25 | 20 tok/s |
| Granite 4.0 MicroIBM | 2.00 | - | - | - | - |
| Granite 4.1 30BIBM | 8.70 | - | - | - | - |
| Granite 4.1 3BIBM | 4.40 | - | - | - | - |
| Granite 4.1 8BIBM | 6.40 | - | 0.05 | 0.10 | 115 tok/s |
| Grok 2 (Dec '24)SpaceXAI | 7.80 | - | - | - | - |
| Grok-1SpaceXAI | 5.80 | - | - | - | - |
| Hermes 3 - Llama-3.1 70BNous Research | 4.80 | - | 0.70 | 0.70 | 32 tok/s |
| Hermes 4 - Llama-3.1 405B (Non-reasoning)Nous Research | 8.60 | - | 1.00 | 3.00 | 29 tok/s |
| Hermes 4 - Llama-3.1 405B (Reasoning)Nous Research | 8.80 | - | 1.00 | 3.00 | 36 tok/s |
| Hermes 4 - Llama-3.1 70B (Non-reasoning)Nous Research | 6.70 | - | 0.13 | 0.40 | 94 tok/s |
| Hermes 4 - Llama-3.1 70B (Reasoning)Nous Research | 9.90 | - | 0.13 | 0.40 | 84 tok/s |
| Hy3Tencent | 42.20 | $93.6 | 0.14 | 0.56 | 72 tok/s |
| Hy3-preview (Non-reasoning)Tencent | 26.60 | - | 0.06 | 0.21 | - |
| Hy3-preview (Reasoning)Tencent | 34.40 | - | 0.06 | 0.21 | - |
| HyperCLOVA X SEED Think (32B)Naver | 17.20 | - | - | - | - |
| HyperNova 60B 2605Multiverse Computing | 18.30 | - | - | - | - |
| Inkling (xhigh)Thinking Machines | 42.30 | $698 | 1.00 | 4.05 | 80 tok/s |
| Inkling SmallThinking Machines | 41.20 | $193 | 0.30 | 1.20 | 65 tok/s |
| INTELLECT-3Prime Intellect | 15.70 | - | - | - | - |
| Jamba 1.5 LargeAI21 Labs | 4.80 | - | 2.00 | 8.00 | - |
| Jamba 1.5 MiniAI21 Labs | 2.30 | - | 0.20 | 0.40 | - |
| Jamba 1.6 LargeAI21 Labs | 4.70 | - | - | - | - |
| Jamba 1.6 MiniAI21 Labs | 2.10 | - | - | - | - |
| Jamba 1.7 LargeAI21 Labs | 5.00 | - | - | - | - |
| Jamba 1.7 MiniAI21 Labs | 2.30 | - | - | - | - |
| Jamba Reasoning 3BAI21 Labs | 3.80 | - | - | - | - |
| K-EXAONE (Non-reasoning)LG AI Research | 16.90 | - | - | - | - |
| K-EXAONE (Reasoning)LG AI Research | 22.50 | - | - | - | - |
| K-EXAONE 2.0 0803LG AI Research | 31.00 | - | - | - | - |
| K2 Think V2MBZUAI Institute of Foundation Models | 17.40 | - | - | - | - |
| K2-V2 (high)MBZUAI Institute of Foundation Models | 14.20 | - | - | - | - |
| K2-V2 (low)MBZUAI Institute of Foundation Models | 8.40 | - | - | - | - |
| K2-V2 (medium)MBZUAI Institute of Foundation Models | 12.40 | - | - | - | - |
| Kimi K2Kimi | 19.70 | - | 0.57 | 2.30 | 41 tok/s |
| Kimi K2 0905Kimi | 24.00 | - | 0.60 | 2.50 | 40 tok/s |
| Kimi K2 ThinkingKimi | 33.50 | - | 0.60 | 2.50 | 124 tok/s |
| Kimi K2.5 (Non-reasoning)Kimi | 30.10 | - | 0.60 | 3.00 | 49 tok/s |
| Kimi K2.5 (Reasoning)Kimi | 36.00 | $304 | 0.60 | 3.00 | 48 tok/s |
| Kimi K2.6Kimi | 45.10 | $841 | 0.95 | 4.00 | 47 tok/s |
| Kimi K2.6 (Non-reasoning)Kimi | 35.40 | - | 0.95 | 4.00 | 44 tok/s |
| Kimi K2.7 CodeKimi | 43.00 | $545 | 0.95 | 4.00 | 39 tok/s |
| Kimi K3 (low)Kimi | 48.30 | $283 | 3.00 | 15.00 | 39 tok/s |
| Kimi K3 (max)Kimi | 59.70 | $2425 | 3.00 | 15.00 | 39 tok/s |
| Kimi Linear 48B A3B InstructKimi | 8.40 | - | - | - | - |
| LFM2 1.2BLiquid AI | 1.00 | - | - | - | - |
| LFM2 2.6BLiquid AI | 2.30 | - | - | - | - |
| LFM2 24B A2BLiquid AI | 4.60 | - | - | - | - |
| LFM2 8B A1BLiquid AI | 1.30 | - | - | - | - |
| LFM2.5-1.2B-InstructLiquid AI | 2.30 | - | - | - | - |
| LFM2.5-1.2B-ThinkingLiquid AI | 2.30 | - | - | - | - |
| LFM2.5-8B-A1BLiquid AI | 8.10 | - | 0.00 | 0.00 | 338 tok/s |
| LFM2.5-VL-1.6BLiquid AI | 1.00 | - | 0.00 | 0.00 | 353 tok/s |
| Ling 2.6 FlashInclusionAI | 14.20 | - | 0.10 | 0.30 | 104 tok/s |
| Ling 3.0 FlashInclusionAI | 37.80 | $72.8 | 0.07 | 0.22 | - |
| Ling-1TInclusionAI | 12.70 | - | - | - | - |
| Ling-2.6-1TInclusionAI | 26.60 | - | 0.30 | 2.50 | - |
| Ling-flash-2.0InclusionAI | 9.60 | - | 0.14 | 0.57 | 91 tok/s |
| Ling-mini-2.0InclusionAI | 3.40 | - | - | - | - |
| Llama 2 Chat 13BMeta | 2.60 | - | - | - | - |
| Llama 2 Chat 70BMeta | 2.60 | - | - | - | - |
| Llama 2 Chat 7BMeta | 3.90 | - | 0.05 | 0.25 | - |
| Llama 3 Instruct 70BMeta | 3.10 | - | 0.65 | 2.75 | - |
| Llama 3 Instruct 8BMeta | 1.00 | - | 0.04 | 0.14 | - |
| Llama 3.1 Instruct 405BMeta | 8.30 | - | - | - | - |
| Llama 3.1 Instruct 70BMeta | 6.50 | - | 0.56 | 0.56 | 56 tok/s |
| Llama 3.1 Instruct 8BMeta | 7.40 | - | 0.02 | 0.05 | 133 tok/s |
| Llama 3.1 Nemotron Instruct 70BNVIDIA | 7.40 | - | 1.20 | 1.20 | 181 tok/s |
| Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)NVIDIA | 8.40 | - | - | - | - |
| Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)NVIDIA | 8.90 | - | 0.60 | 1.80 | 53 tok/s |
| Llama 3.1 Tulu3 405BAllen Institute for AI | 8.10 | - | - | - | - |
| Llama 3.2 Instruct 11B (Vision)Meta | 3.00 | - | 0.34 | 0.34 | 44 tok/s |
| Llama 3.2 Instruct 1BMeta | 1.00 | - | - | - | - |
| Llama 3.2 Instruct 3BMeta | 3.90 | - | - | - | - |
| Llama 3.2 Instruct 90B (Vision)Meta | 6.00 | - | - | - | - |
| Llama 3.3 Instruct 70BMeta | 9.30 | - | 0.66 | 0.72 | 87 tok/s |
| Llama 3.3 Nemotron Super 49B v1 (Non-reasoning)NVIDIA | 8.30 | - | - | - | - |
| Llama 3.3 Nemotron Super 49B v1 (Reasoning)NVIDIA | 12.20 | - | - | - | - |
| Llama 4 MaverickMeta | 14.50 | $35.9 | 0.27 | 0.85 | 118 tok/s |
| Llama 4 ScoutMeta | 10.30 | $11.6 | 0.18 | 0.66 | 133 tok/s |
| Llama 65BMeta | 1.70 | - | - | - | - |
| Llama Nemotron Super 49B v1.5 (Non-reasoning)NVIDIA | 8.50 | - | 0.40 | 0.40 | 126 tok/s |
| Llama Nemotron Super 49B v1.5 (Reasoning)NVIDIA | 12.40 | - | 0.40 | 0.40 | 128 tok/s |
| LongCat 2.0LongCat | 34.00 | $442 | 0.75 | 2.95 | 45 tok/s |
| LongCat Flash LiteLongCat | 17.40 | - | - | - | - |
| Magistral Small 1Mistral | 10.60 | - | - | - | - |
| Magistral Small 1.2Mistral | 11.50 | $301 | 0.50 | 1.50 | 155 tok/s |
| MiMo-V2-Flash (Feb 2026)Xiaomi | 34.00 | - | - | - | - |
| MiMo-V2-Flash (Non-reasoning)Xiaomi | 25.10 | - | - | - | - |
| MiMo-V2-Flash (Reasoning)Xiaomi | 31.90 | - | 0.10 | 0.30 | - |
| MiMo-V2.5Xiaomi | 38.00 | $25.2 | 0.14 | 0.28 | 69 tok/s |
| MiMo-V2.5-ProXiaomi | 42.90 | $98.9 | 0.43 | 0.87 | 55 tok/s |
| MiMo-V2.5-Pro (Non-reasoning)Xiaomi | 28.40 | - | 0.43 | 0.87 | 54 tok/s |
| MiniCPM-V 4.6 1.3BOpenBMB | 3.80 | - | - | - | - |
| MiniCPM5-1B (Non-reasoning)OpenBMB | 11.70 | - | - | - | - |
| MiniCPM5-1B (Reasoning)OpenBMB | 11.90 | - | - | - | - |
| MiniMax M1 40kMiniMax | 14.50 | - | - | - | - |
| MiniMax M1 80kMiniMax | 17.90 | - | 0.55 | 2.20 | - |
| MiniMax-M2MiniMax | 28.90 | - | 0.30 | 1.20 | 101 tok/s |
| MiniMax-M2.1MiniMax | 32.10 | - | 0.30 | 1.20 | 99 tok/s |
| MiniMax-M2.5MiniMax | 34.50 | - | 0.30 | 1.20 | 105 tok/s |
| MiniMax-M2.7MiniMax | 38.90 | $143 | 0.30 | 1.20 | 67 tok/s |
| MiniMax-M3MiniMax | 45.40 | $205 | 0.30 | 1.20 | 109 tok/s |
| Ministral 3 14BMistral | 11.20 | $119 | 0.20 | 0.20 | 98 tok/s |
| Ministral 3 3BMistral | 7.10 | $91.6 | 0.10 | 0.10 | 200 tok/s |
| Ministral 3 8BMistral | 9.00 | $114 | 0.15 | 0.15 | 129 tok/s |
| Mistral 7B InstructMistral | 1.70 | - | 0.25 | 0.25 | 126 tok/s |
| Mistral Large 2 (Jul '24)Mistral | 7.00 | - | 2.00 | 6.00 | - |
| Mistral Large 2 (Nov '24)Mistral | 9.00 | - | - | - | - |
| Mistral Large 3Mistral | 15.90 | $71.1 | 0.50 | 1.50 | 52 tok/s |
| Mistral Medium 3.5Mistral | 30.40 | $883 | 1.50 | 7.50 | 151 tok/s |
| Mistral Small (Sep '24)Mistral | 4.30 | - | 0.20 | 0.60 | 158 tok/s |
| Mistral Small 3Mistral | 6.70 | - | 0.10 | 0.30 | 163 tok/s |
| Mistral Small 3.1Mistral | 14.90 | $29.8 | 0.10 | 0.30 | 153 tok/s |
| Mistral Small 3.2Mistral | 10.70 | $129 | 0.10 | 0.30 | 157 tok/s |
| Mistral Small 4 (Non-reasoning)Mistral | 12.30 | - | 0.15 | 0.60 | 157 tok/s |
| Mistral Small 4 (Reasoning)Mistral | 19.70 | $87.7 | 0.15 | 0.60 | 175 tok/s |
| Mixtral 8x22B InstructMistral | 4.00 | - | - | - | - |
| Mixtral 8x7B InstructMistral | 2.00 | - | 0.45 | 0.70 | - |
| Molmo 7B-DAllen Institute for AI | 3.40 | - | - | - | - |
| Molmo2-8BAllen Institute for AI | 1.60 | - | - | - | - |
| Motif 3Motif Technologies | 47.40 | - | - | - | - |
| Muse Glimmer (high)Meta | 35.10 | $105 | 0.32 | 1.35 | 104 tok/s |
| Nanbeige4.1-3BNanbeige | 11.00 | - | - | - | - |
| Nemotron 3 Nano Omni 30B A3B ReasoningNVIDIA | 15.00 | - | 0.07 | 0.30 | 328 tok/s |
| Nemotron 3 Super 120B A12B (Reasoning)NVIDIA | 25.70 | $254 | 0.20 | 0.80 | 140 tok/s |
| Nemotron 3 Ultra 550B A55B (Reasoning)NVIDIA | 38.30 | $534 | 0.60 | 2.75 | 154 tok/s |
| Nemotron 3.5 LightningNVIDIA | 23.60 | $59.7 | 0.05 | 0.20 | 300 tok/s |
| Nemotron Cascade 2 30B A3BNVIDIA | 17.80 | - | - | - | - |
| Nex-N2-ProNex AGI | 41.70 | - | 0.50 | 2.50 | 138 tok/s |
| NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)NVIDIA | 7.20 | - | 0.05 | 0.20 | 190 tok/s |
| NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)NVIDIA | 14.50 | $39.4 | 0.05 | 0.20 | 227 tok/s |
| NVIDIA Nemotron 3 Nano 4BNVIDIA | 8.60 | - | - | - | - |
| NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)NVIDIA | 4.20 | - | 0.20 | 0.60 | 200 tok/s |
| NVIDIA Nemotron Nano 12B v2 VL (Reasoning)NVIDIA | 8.80 | - | 0.20 | 0.60 | 137 tok/s |
| NVIDIA Nemotron Nano 9B V2 (Non-reasoning)NVIDIA | 7.20 | - | 0.05 | 0.20 | 168 tok/s |
| NVIDIA Nemotron Nano 9B V2 (Reasoning)NVIDIA | 8.70 | - | 0.04 | 0.16 | 173 tok/s |
| OLMo 2 32BAllen Institute for AI | 4.70 | - | - | - | - |
| OLMo 2 7BAllen Institute for AI | 3.50 | - | - | - | - |
| Olmo 3 32B ThinkAllen Institute for AI | 6.10 | - | - | - | - |
| Olmo 3 7B InstructAllen Institute for AI | 2.40 | - | 0.10 | 0.20 | - |
| Olmo 3 7B ThinkAllen Institute for AI | 3.60 | - | - | - | - |
| Olmo 3.1 32B InstructAllen Institute for AI | 6.20 | - | - | - | - |
| Olmo 3.1 32B ThinkAllen Institute for AI | 7.90 | - | 0.00 | 0.00 | - |
| OpenChat 3.5 (1210)OpenChat | 2.60 | - | - | - | - |
| Phi-3 Mini Instruct 3.8BMicrosoft | 4.30 | - | - | - | - |
| Phi-4Microsoft | 4.60 | - | 0.13 | 0.50 | 23 tok/s |
| Phi-4 Mini InstructMicrosoft | 5.70 | - | 0.00 | 0.00 | 44 tok/s |
| Phi-4 Multimodal InstructMicrosoft | 4.20 | - | 0.00 | 0.00 | 18 tok/s |
| Pixtral LargeMistral | 8.00 | - | - | - | - |
| Qwen Chat 14BAlibaba | 1.70 | - | - | - | - |
| Qwen Chat 72BAlibaba | 3.00 | - | - | - | - |
| Qwen1.5 Chat 110BAlibaba | 3.70 | - | - | - | - |
| Qwen2 Instruct 72BAlibaba | 5.70 | - | - | - | - |
| Qwen2.5 Coder Instruct 32BAlibaba | 6.90 | - | - | - | - |
| Qwen2.5 Coder Instruct 7B Alibaba | 4.10 | - | - | - | - |
| Qwen2.5 Instruct 32BAlibaba | 7.20 | - | - | - | - |
| Qwen2.5 Instruct 72BAlibaba | 9.40 | - | 0.47 | 0.49 | - |
| Qwen3 0.6B (Non-reasoning)Alibaba | 1.00 | - | - | - | - |
| Qwen3 0.6B (Reasoning)Alibaba | 1.00 | - | - | - | - |
| Qwen3 1.7B (Non-reasoning)Alibaba | 1.10 | - | - | - | - |
| Qwen3 1.7B (Reasoning)Alibaba | 2.20 | - | - | - | - |
| Qwen3 14B (Non-reasoning)Alibaba | 6.80 | - | 0.35 | 1.40 | 64 tok/s |
| Qwen3 14B (Reasoning)Alibaba | 10.40 | - | 0.35 | 4.20 | 61 tok/s |
| Qwen3 235B A22B (Non-reasoning)Alibaba | 10.80 | - | 0.70 | 2.80 | 62 tok/s |
| Qwen3 235B A22B (Reasoning)Alibaba | 13.50 | - | 0.70 | 8.40 | 59 tok/s |
| Qwen3 235B A22B 2507 (Reasoning)Alibaba | 19.90 | $610 | 0.70 | 8.40 | 65 tok/s |
| Qwen3 235B A22B 2507 InstructAlibaba | 18.40 | - | 0.70 | 2.80 | 61 tok/s |
| Qwen3 30B A3B (Non-reasoning)Alibaba | 6.60 | - | 0.20 | 0.80 | 107 tok/s |
| Qwen3 30B A3B (Reasoning)Alibaba | 9.20 | - | 0.20 | 2.40 | 106 tok/s |
| Qwen3 30B A3B 2507 (Reasoning)Alibaba | 14.60 | $152 | 0.20 | 2.40 | 148 tok/s |
| Qwen3 30B A3B 2507 InstructAlibaba | 8.90 | - | 0.20 | 0.80 | 141 tok/s |
| Qwen3 32B (Non-reasoning)Alibaba | 8.50 | - | 0.70 | 2.80 | 107 tok/s |
| Qwen3 32B (Reasoning)Alibaba | 11.40 | - | 0.70 | 8.40 | 104 tok/s |
| Qwen3 4B (Non-reasoning)Alibaba | 6.50 | - | - | - | - |
| Qwen3 4B (Reasoning)Alibaba | 8.20 | - | - | - | - |
| Qwen3 4B 2507 (Reasoning)Alibaba | 11.90 | - | - | - | - |
| Qwen3 4B 2507 InstructAlibaba | 6.90 | - | - | - | - |
| Qwen3 8B (Non-reasoning)Alibaba | 4.80 | - | 0.18 | 0.70 | 40 tok/s |
| Qwen3 8B (Reasoning)Alibaba | 8.30 | - | 0.18 | 2.10 | 38 tok/s |
| Qwen3 Coder 30B A3B InstructAlibaba | 13.60 | - | 0.45 | 2.25 | 95 tok/s |
| Qwen3 Coder 480B A35B InstructAlibaba | 18.20 | - | 1.50 | 7.50 | 73 tok/s |
| Qwen3 Coder NextAlibaba | 21.30 | $250 | 0.35 | 1.20 | 151 tok/s |
| Qwen3 Next 80B A3B (Reasoning)Alibaba | 16.90 | $400 | 0.50 | 6.00 | 199 tok/s |
| Qwen3 Next 80B A3B InstructAlibaba | 13.80 | - | 0.50 | 2.00 | 191 tok/s |
| Qwen3 Omni 30B A3B (Reasoning)Alibaba | 9.50 | - | 0.25 | 0.97 | 99 tok/s |
| Qwen3 Omni 30B A3B InstructAlibaba | 4.80 | - | 0.25 | 0.97 | 93 tok/s |
| Qwen3 VL 235B A22B (Reasoning)Alibaba | 20.90 | - | 0.70 | 8.40 | 55 tok/s |
| Qwen3 VL 235B A22B InstructAlibaba | 14.40 | - | 0.70 | 2.80 | 50 tok/s |
| Qwen3 VL 30B A3B (Reasoning)Alibaba | 13.40 | - | 0.20 | 2.40 | 112 tok/s |
| Qwen3 VL 30B A3B InstructAlibaba | 9.90 | - | 0.20 | 0.80 | 112 tok/s |
| Qwen3 VL 32B (Reasoning)Alibaba | 18.10 | - | 0.70 | 8.40 | 90 tok/s |
| Qwen3 VL 32B InstructAlibaba | 11.00 | - | 0.70 | 2.80 | 66 tok/s |
| Qwen3 VL 4B (Reasoning)Alibaba | 7.70 | - | - | - | - |
| Qwen3 VL 4B InstructAlibaba | 3.70 | - | - | - | - |
| Qwen3 VL 8B (Reasoning)Alibaba | 10.50 | - | 0.18 | 2.10 | 112 tok/s |
| Qwen3 VL 8B InstructAlibaba | 8.20 | - | 0.18 | 0.70 | 119 tok/s |
| Qwen3.5 0.8B (Non-reasoning)Alibaba | 2.90 | - | - | - | - |
| Qwen3.5 0.8B (Reasoning)Alibaba | 5.20 | - | - | - | - |
| Qwen3.5 122B A10B (Non-reasoning)Alibaba | 28.20 | $221 | 0.40 | 3.20 | 148 tok/s |
| Qwen3.5 122B A10B (Reasoning)Alibaba | 32.80 | $444 | 0.40 | 3.20 | 136 tok/s |
| Qwen3.5 27B (Non-reasoning)Alibaba | 30.00 | - | 0.30 | 2.40 | 83 tok/s |
| Qwen3.5 27B (Reasoning)Alibaba | 34.60 | - | 0.30 | 2.40 | 78 tok/s |
| Qwen3.5 2B (Non-reasoning)Alibaba | 5.30 | - | - | - | - |
| Qwen3.5 2B (Reasoning)Alibaba | 7.40 | - | - | - | - |
| Qwen3.5 35B A3B (Non-reasoning)Alibaba | 24.30 | $228 | 0.25 | 2.00 | 170 tok/s |
| Qwen3.5 35B A3B (Reasoning)Alibaba | 29.90 | - | 0.25 | 2.00 | 151 tok/s |
| Qwen3.5 397B A17B (Non-reasoning)Alibaba | 32.70 | - | 0.60 | 3.60 | 95 tok/s |
| Qwen3.5 397B A17B (Reasoning)Alibaba | 34.30 | $527 | 0.60 | 3.60 | 97 tok/s |
| Qwen3.5 4B (Non-reasoning)Alibaba | 16.10 | - | 0.03 | 0.15 | 52 tok/s |
| Qwen3.5 4B (Reasoning)Alibaba | 20.40 | - | 0.03 | 0.15 | 43 tok/s |
| Qwen3.5 9B (Non-reasoning)Alibaba | 20.60 | - | 0.17 | 0.25 | 89 tok/s |
| Qwen3.5 9B (Reasoning)Alibaba | 21.80 | $240 | 0.14 | 0.20 | 81 tok/s |
| Qwen3.6 27B (Non-reasoning)Alibaba | 31.30 | $359 | 0.60 | 3.60 | 58 tok/s |
| Qwen3.6 27B (Reasoning)Alibaba | 37.70 | $667 | 0.60 | 3.60 | 61 tok/s |
| Qwen3.6 35B A3B (Non-reasoning)Alibaba | 24.60 | $530 | 0.38 | 2.25 | 146 tok/s |
| Qwen3.6 35B A3B (Reasoning)Alibaba | 32.10 | $505 | 0.38 | 2.25 | 131 tok/s |
| Qwen3.8 2.4T A95BAlibaba | 57.70 | $1672 | 2.00 | 6.00 | 48 tok/s |
| QwQ 32BAlibaba | 13.40 | - | 0.66 | 1.00 | - |
| QwQ 32B-PreviewAlibaba | 9.10 | - | - | - | - |
| R1 1776Perplexity | 6.00 | - | - | - | - |
| Reka Flash 3Reka AI | 3.70 | - | 0.20 | 0.80 | - |
| Ring-1TInclusionAI | 16.30 | - | - | - | - |
| Ring-2.6-1TInclusionAI | 31.70 | $455 | 0.30 | 2.50 | - |
| Ring-flash-2.0InclusionAI | 8.00 | - | 0.14 | 0.57 | - |
| Sarvam 105B (high)Sarvam | 11.90 | - | 0.04 | 0.17 | - |
| Sarvam 30B (high)Sarvam | 6.40 | - | 0.03 | 0.11 | - |
| Sarvam M (Reasoning)Sarvam | 2.60 | - | 0.00 | 0.00 | - |
| Seed-OSS-36B-InstructByteDance Seed | 18.50 | - | 0.21 | 0.57 | 24 tok/s |
| Solar MiniUpstage | 6.00 | - | 0.15 | 0.15 | - |
| Solar Open 100B (Reasoning)Upstage | 15.20 | - | - | - | - |
| Solar Open2 250BUpstage | 37.40 | - | - | - | - |
| Step 3.5 FlashStepFun | 26.00 | - | 0.10 | 0.30 | 225 tok/s |
| Step 3.7 FlashStepFun | 30.90 | $320 | 0.20 | 1.15 | 150 tok/s |
| Step3 VL 10BStepFun | 9.30 | - | - | - | - |
| Tiny Aya GlobalCohere | 1.00 | - | 0.00 | 0.00 | - |
| Tri-21B-ThinkTrillion Labs | 12.30 | - | - | - | - |
| Tri-21B-think PreviewTrillion Labs | 13.60 | - | - | - | - |
| Trinity Large ThinkingArcee AI | 18.70 | $255 | 0.23 | 0.88 | 202 tok/s |
Guides
How we compare models
Intelligence uses the Artificial Analysis Intelligence Index. Benchmark cost is the total USD cost of running that test, including reasoning tokens; it is not a per-token API price. Rankings use the same dataset and calculations in every language. General benchmark scores do not measure performance in a particular language or task.