NVIDIA H200 vs NVIDIA RTX PRO 6000 Blackwell Workstation Edition, AI & Machine Learning Comparison
NVIDIA H200 wins 85 of 146 benchmarks, averaging 6.3% faster.
Both cards were measured first-party on our bench, same suite, same test rig.
What the numbers say
The gap is widest in Swin2SR 4x Upscaler, where NVIDIA RTX PRO 6000 Blackwell Workstation Edition leads by 104% (25.85 vs 52.83 images/min); the closest fight is Qwen2.5-Coder-3B (0% apart).
Benchmark results head-to-head
| Benchmark | NVIDIA H200 | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | Difference |
|---|---|---|---|
| Qwen3 4B tok/s | 318.84 | 362.81 | -12% |
| Llama 3.1 8B tok/s | 268.31 | 258.37 | +4% |
| Qwen2.5-Coder 14B tok/s | 148.43 | 147.74 | 0% |
| Qwen3 32B tok/s | 76.58 | 70.13 | +9% |
| Llama 3.3 70B tok/s | 42.66 | 34.87 | +22% |
| Stable Diffusion XL images/min | 37.16 | 27.94 | +33% |
| Z-Image Turbo images/min | 23.175 | 15.6 | +49% |
| FLUX.1 dev images/min | 9.514 | 6.921 | +37% |
| FLUX.1 Kontext dev images/min | 4.393 | 3.086 | +42% |
| Qwen-Image-Edit images/min | 3.76 | 2.64 | +42% |
| LTX-Video (distilled) frames/s | 17.87 | 16.36 | +9% |
| DeepSeek-R1 Distill Llama 8B tok/s | 265.25 | 235.07 | +13% |
| DeepSeek-R1 Distill 1.5B tok/s | 542.95 | 635.1 | -15% |
| DeepSeek-R1 Distill 14B tok/s | 146.82 | 135.41 | +8% |
| DeepSeek-R1 Distill 7B tok/s | 267.1 | 256.04 | +4% |
| Gemma 3 12B tok/s | 153.26 | 138.09 | +11% |
| Gemma 3 4B tok/s | 291.76 | 297.73 | -2% |
| Gemma 4 12B tok/s | 151.05 | 137.73 | +10% |
| Llama 3.2 1B tok/s | 875.53 | 892.74 | -2% |
| Llama 3.2 3B tok/s | 424.61 | 435.63 | -3% |
| Mistral 7B v0.3 tok/s | 278.5 | 247.33 | +13% |
| Mistral Small 24B tok/s | 107.84 | 93.55 | +15% |
| Phi-4 14B tok/s | 168.2 | 142.68 | +18% |
| Phi-4 Mini 3.8B tok/s | 392.38 | 391.04 | 0% |
| Qwen2.5-Coder 7B tok/s | 266.36 | 256.11 | +4% |
| Qwen3 0.6B tok/s | 718.67 | 788.97 | -9% |
| Qwen3 1.7B tok/s | 563.52 | 575.77 | -2% |
| Qwen3 14B tok/s | 154.51 | 139.01 | +11% |
| Qwen3 30B A3B tok/s | 292.11 | 308.74 | -5% |
| Qwen3 8B tok/s | 247.98 | 225.95 | +10% |
| SmolLM3 3B tok/s | 402.24 | 406.45 | -1% |
| Codestral 22B tok/s | 111.34 | 92.7 | +20% |
| DeepSeek-R1 Distill 32B tok/s | 75.8 | 66.06 | +15% |
| Devstral Small 24B tok/s | 109.05 | 93.52 | +17% |
| Dolphin 2.9.1 Yi 1.5 34B tok/s | 76.7 | 63.74 | +20% |
| Dolphin Mistral 24B Venice tok/s | 109.14 | 93.67 | +17% |
| Dolphin X1 8B tok/s | 268.36 | 239.4 | +12% |
| Dolphin 3.0 Llama 3.1 8B tok/s | 267.84 | 239.28 | +12% |
| Dolphin 3.0 R1 Mistral 24B tok/s | 109.06 | 93.62 | +16% |
| Gemma 3 27B tok/s | 84.75 | 72.1 | +18% |
| Qwen2.5-Coder 32B tok/s | 75.77 | 66.07 | +15% |
| Qwen3-Coder 30B A3B tok/s | 297.9 | 317.68 | -6% |
| QwQ 32B tok/s | 75.77 | 66.07 | +15% |
| StarCoder2 15B tok/s | 136.29 | 122.09 | +12% |
| FLUX.1 Schnell images/min | 60.51 | 42.41 | +43% |
| Z-Image Turbo (1024px) images/min | 40.74 | 31.43 | +30% |
| Krea 2 Turbo images/min | 7.25 | 4.71 | +54% |
| BiRefNet images/min | 1457.73 | 1445.92 | +1% |
| Depth Anything V2 Large images/min | 1040.81 | 1328.11 | -22% |
| Depth Anything V2 Small images/min | 1198.58 | 1374.58 | -13% |
| SAM ViT-Base images/min | 1469.34 | 1079.89 | +36% |
| SAM ViT-Huge images/min | 325.19 | 193.47 | +68% |
| Swin2SR 4x Upscaler images/min | 25.85 | 52.83 | -51% |
| Qwen2.5 1.5B LoRA train tok/s | 14931.7 | 15753.9 | -5% |
| Qwen2.5 7B LoRA train tok/s | 8855.4 | 6041.8 | +47% |
| SmolLM2 1.7B LoRA train tok/s | 17650.4 | 16255.4 | +9% |
| TinyLlama 1.1B LoRA train tok/s | 16222.4 | 18556.4 | -13% |
| Qwen2.5 1.5B served serve tok/s | 7541.6 | 5786.7 | +30% |
| Qwen2.5 7B served serve tok/s | 4394.8 | 2282.8 | +93% |
| SmolLM2 1.7B served serve tok/s | 7107.8 | 5642 | +26% |
| TinyLlama 1.1B served serve tok/s | 9137.7 | 7678.7 | +19% |
| AI21-Jamba-Reasoning-3B tok/s | 370.66 | 400.02 | -7% |
| Olmo-3.1-32B-Think tok/s | 78.46 | 65.71 | +19% |
| Codestral 22B (Q3_K_M) tok/s | 88.03 | 107.67 | -18% |
| Dolphin-Mistral-24B-Venice-Edition tok/s | 109.2 | 93.71 | +17% |
| DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored tok/s | 267.82 | 239.45 | +12% |
| DeepSeek-Coder-V2-Lite tok/s | 312.1 | 352.52 | -11% |
| DeepSeek-R1-0528-Qwen3-8B tok/s | 250.61 | 226.85 | +10% |
| DeepSeek-R1-Distill-Llama-70B tok/s | 42.76 | 32.52 | +31% |
| DeepSeek-R1 Distill 14B (Q3_K_M) tok/s | 119.66 | 149.81 | -20% |
| DeepSeek-R1-Distill-Qwen-32B-abliterated tok/s | 75.71 | 66.03 | +15% |
| dolphin-2.9-llama3-8b tok/s | 267.96 | 239.29 | +12% |
| Dolphin X1 Trinity Nano 6B tok/s | 259.81 | 282.02 | -8% |
| EVA-Qwen2.5-14B-v0.2 tok/s | 148.74 | 135.83 | +10% |
| gemma-2-2b-it-abliterated tok/s | 397.43 | 416.68 | -5% |
| gemma-2-2b tok/s | 398.48 | 417.07 | -4% |
| gemma-2-9b tok/s | 180.47 | 156.29 | +15% |
| Gemma 3 12B (Q3_K_M) tok/s | 127.04 | 153.93 | -17% |
| gemma-3-1b tok/s | 513.58 | 567.1 | -9% |
| gemma-3-270m tok/s | 967.35 | 965 | 0% |
| GLM-4.7-Flash-REAP-23B-A3B tok/s | 171.45 | 199.14 | -14% |
| GLM-4.7-Flash tok/s | 188.57 | 215.61 | -13% |
| Josiefied-Qwen3-8B-abliterated-v1 tok/s | 250.88 | 227.15 | +10% |
| gpt-oss-20b tok/s | 354.23 | 375.09 | -6% |
| Hermes-3-Llama-3.2-3B tok/s | 430.79 | 439.65 | -2% |
| Hermes-4-70B tok/s | 42.77 | 32.51 | +32% |
| SmolLM3-3B tok/s | 404.27 | 409.73 | -1% |
| Qwen3-Coder-Next-abliterated tok/s | 197.14 | 210.47 | -6% |
| KAT-Coder-V2.5-Dev tok/s | 236.31 | 253.35 | -7% |
| L3-8B-Stheno-v3.2 tok/s | 267.92 | 239.84 | +12% |
| Laguna-XS-2.1 tok/s | 0 | 0 | n/a |
| LFM2.5-1.2B tok/s | 946.53 | 989.91 | -4% |
| LFM2.5-8B-A1B tok/s | 583.96 | 617.09 | -5% |
| Llama-2-7B tok/s | 290.81 | 263.84 | +10% |
| Llama-3.2-3B-Instruct-uncensored tok/s | 429.78 | 440.15 | -2% |
| Llama-3.3-70B-Instruct-abliterated tok/s | 42.75 | 32.53 | +31% |
| Meta-Llama-3.1-70B tok/s | 42.72 | 32.52 | +31% |
| Meta-Llama-3.1-8B tok/s | 262.93 | 237.69 | +11% |
| Phi-4-mini tok/s | 395.3 | 393.81 | 0% |
| Mistral-7B-Instruct-v0.1 tok/s | 282.64 | 252.55 | +12% |
| Mistral-7B-Instruct-v0.2 tok/s | 282.32 | 253.34 | +11% |
| Mistral-7B-Instruct-v0.3 tok/s | 282.39 | 253.2 | +12% |
| Mistral-Nemo-Instruct-2407 tok/s | 181.3 | 164.28 | +10% |
| Mistral Small 24B (Q3_K_M) tok/s | 85.1 | 108.88 | -22% |
| Nanbeige4.2-3B tok/s | 0 | 0 | n/a |
| NemoMix-Unleashed-12B tok/s | 181.53 | 164.21 | +11% |
| Nemotron-3-Nano-30B-A3B tok/s | 327.48 | 325.43 | +1% |
| Hermes-4-14B tok/s | 156.26 | 139.56 | +12% |
| Ornith-1.0-35B tok/s | 208.51 | 237.7 | -12% |
| Ornith-1.0-9B tok/s | 222.94 | 201.69 | +11% |
| phi-2 tok/s | 347.08 | 410.12 | -15% |
| Phi-3.5-mini tok/s | 348.14 | 362.79 | -4% |
| Phi-4 14B (Q3_K_M) tok/s | 139.97 | 165.43 | -15% |
| Qwen-AgentWorld-35B-A3B tok/s | 225.31 | 234.82 | -4% |
| Qwen3-0.6B tok/s | 724.67 | 806.77 | -10% |
| Qwen3-1.7B tok/s | 568.85 | 593.5 | -4% |
| Qwen3-14B tok/s | 156.3 | 139.45 | +12% |
| Qwen3-30B-A3B tok/s | 293.47 | 311.76 | -6% |
| Qwen3-4B-Instruct-2507 tok/s | 318.67 | 333.54 | -4% |
| Qwen3-8B tok/s | 251.04 | 226.88 | +11% |
| Qwen3-Coder-Next tok/s | 195.21 | 205.69 | -5% |
| Qwen3-Next-80B-A3B-Thinking tok/s | 194.82 | 203.29 | -4% |
| Qwen1.5-0.5B tok/s | 855.22 | 1025.58 | -17% |
| Qwen2-1.5B tok/s | 546.47 | 648.49 | -16% |
| Qwen2.5-0.5B tok/s | 914.58 | 905.27 | +1% |
| Qwen2.5-1.5B tok/s | 549.36 | 636.39 | -14% |
| Uncensored tok/s | 148.7 | 135.68 | +10% |
| Qwen2.5-14B tok/s | 148.76 | 135.66 | +10% |
| Qwen2.5-32B tok/s | 75.76 | 66 | +15% |
| Qwen2.5-3B tok/s | 400.48 | 398.72 | 0% |
| Qwen2.5-72B tok/s | 43.4 | 29.65 | +46% |
| Qwen2.5-7B tok/s | 265.15 | 256.63 | +3% |
| Qwen2.5-Coder-0.5B tok/s | 920.36 | 910.13 | +1% |
| Qwen2.5-Coder-1.5B tok/s | 545.54 | 650.4 | -16% |
| Qwen2.5-Coder-14B-Instruct-abliterated tok/s | 148.48 | 135.88 | +9% |
| Qwen2.5-Coder 32B (Q3_K_M) tok/s | 58.87 | 75.78 | -22% |
| Qwen2.5-Coder-3B tok/s | 401.11 | 401.24 | -0% |
| Qwen2.5-Coder-7B-Instruct-abliterated tok/s | 270.92 | 257.07 | +5% |
| Qwen3 30B A3B (Q3_K_M) tok/s | 246.35 | 309.61 | -20% |
| Qwen3-4B-Instruct-2507 tok/s | 318.27 | 334.71 | -5% |
| Qwen3-4B-Thinking-2507 tok/s | 318.94 | 334.65 | -5% |
| Qwen3-Coder-Next tok/s | 196.65 | 211.5 | -7% |
| Qwen3-Next-80B-A3B-Thinking tok/s | 201.12 | 214.04 | -6% |
| Qwen3-Next-80B-A3B tok/s | 192.52 | 210.17 | -8% |
| SmolLM2-135M tok/s | 905.38 | 1252.77 | -28% |
| Cydonia-24B-v4.3 tok/s | 109.2 | 93.76 | +16% |
Whole-job comparison
How long each card takes to finish a complete pipeline, not just one model. NVIDIA H200 is faster on 10 of 13; NVIDIA RTX PRO 6000 Blackwell Workstation Edition on 3.
| Workflow | NVIDIA H200 | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | Difference |
|---|---|---|---|
| 50-image depth pass | 6 s | 4 s | NVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.49x faster |
| 500-image masking run | 1.7 min | 2.6 min | NVIDIA H200 1.57x faster |
| 6-panel comic page | 3.2 min | 5.1 min | NVIDIA H200 1.58x faster |
| 60-second AI short film | 3.9 min | 4.5 min | NVIDIA H200 1.16x faster |
| Character sheet, 12 poses | 3.9 min | 6.1 min | NVIDIA H200 1.57x faster |
| 24-frame storyboard | 3.9 min | 3.6 min | NVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.07x faster |
| Full codebase review | 6.7 min | 6.8 min | NVIDIA H200 1.00x faster |
| 200-product catalogue cutout | 8 min | 4 min | NVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.99x faster |
| 20 long-form articles | 10.9 min | 13.4 min | NVIDIA H200 1.22x faster |
| 40-product photo shoot | 11.2 min | 16.7 min | NVIDIA H200 1.49x faster |
| 40-product shoot, start to finish | 12.9 min | 17.6 min | NVIDIA H200 1.36x faster |
| 100-photo restoration batch | 23.3 min | 33.4 min | NVIDIA H200 1.43x faster |
| 100-photo restore and enlarge | 27.2 min | 35.3 min | NVIDIA H200 1.30x faster |
Specifications compared
| NVIDIA H200 | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | |
|---|---|---|
| VRAM | 141GB | 96GB |
| Architecture | Hopper | Blackwell |
| Memory bandwidth | 4800 GB/s | 1792 GB/s |
| Boost clock | 1,980 MHz | 2,617 MHz |
| TDP | 700 W | 600 W |
| Launch MSRP | $31,000 | $8,565 |
| Release | 2024-03-18 | 2025-03-18 |
FAQ
- Which is better for ai & machine learning: NVIDIA H200 or NVIDIA RTX PRO 6000 Blackwell Workstation Edition?
- NVIDIA H200 performs better for ai & machine learning, winning 85 of 146 benchmarks in our suite with an average 6.3% advantage.
- What are the main hardware differences between NVIDIA H200 and NVIDIA RTX PRO 6000 Blackwell Workstation Edition?
- NVIDIA H200 has 141GB VRAM and a 700W TDP, while NVIDIA RTX PRO 6000 Blackwell Workstation Edition has 96GB VRAM and a 600W TDP.
- Where is the biggest performance difference between NVIDIA H200 and NVIDIA RTX PRO 6000 Blackwell Workstation Edition?
- Swin2SR 4x Upscaler: NVIDIA RTX PRO 6000 Blackwell Workstation Edition leads by roughly 104% (25.85 vs 52.83 images/min) in our testing.
NVIDIA H200 full review · NVIDIA RTX PRO 6000 Blackwell Workstation Edition full review · All AI & Machine Learning rankings