NVIDIA H800 80GB, AI & Machine Learning Benchmarks & Specs

80GB · AI Score 62.6/100 · anchored estimate vs 51 measured cards

62.6 AI Score Includes estimates

We have not run NVIDIA H800 80GB on our bench. These figures are anchored estimates, interpolated per workload against the 51 GPUs we did measure (confidence: high (sibling silicon)). On Llama 3.1 8B (Q4_K_M) NVIDIA H800 80GB should deliver about 261.8 tokens/sec. Stepping up to Qwen3 32B it should hold roughly 74.1 tok/s. The full Llama 3.3 70B still runs, at about 41 tok/s. For image generation, SDXL should run near 17.29 it/s, and FLUX.1-dev at 4.23 it/s. All 12 workloads fit in 80GB. There is no model in our suite this card has to turn down.

AI & Machine Learning benchmark results

Text Generation tok/s 5

Qwen3 4B310.3
Llama 3.1 8B261.8
Qwen2.5-Coder 14B144.8
Qwen3 32B74.1
Llama 3.3 70B41
WorkloadResultTelemetryData
Qwen3 4B310.3 tok/sestimatedEst.
Llama 3.1 8B261.8 tok/sestimatedEst.
Qwen2.5-Coder 14B144.8 tok/sestimatedEst.
Qwen3 32B74.1 tok/sestimatedEst.
Llama 3.3 70B41 tok/sestimatedEst.

Image Generation images/min 3

Stable Diffusion XL34.58
Z-Image Turbo22.125
FLUX.1 dev9.064
WorkloadResultTelemetryData
Stable Diffusion XL34.58 images/minestimatedEst.
FLUX.1 dev9.06 images/minestimatedEst.
Z-Image Turbo22.13 images/minestimatedEst.

Image Editing images/min 2

WorkloadResultTelemetryData
FLUX.1 Kontext dev4.26 images/minestimatedEst.
Qwen-Image-Edit3.68 images/minestimatedEst.

Video Generation frames/s 2

WorkloadResultTelemetryData
LTX-Video (distilled)17.47 frames/sestimatedEst.
Wan 2.2 5B (720p)1.33 frames/sestimatedEst.
How this estimate is derived. This card hasn’t been through our bench yet, so its numbers are anchored estimates, interpolated from the 51 first-party measured cards (Sibling to measured H100 SXM: identical compute+bandwidth (export SKU, NVLink/FP64 cut, no single-GPU AI impact)). The VRAM “won’t fit” gates are exact, since they’re pure capacity limits. Confidence: high (sibling silicon). Estimates are replaced with measured data as more silicon goes through the bench. Full methodology →

NVIDIA H800 80GB specifications

ArchitectureHopper
CUDA cores16,896
VRAM80GB HBM3
Memory bus5120-bit
Memory bandwidth3350 GB/s
Boost clock1,980 MHz
TDP700 W
ProcessTSMC 4N
InterfaceSXM5
Release date2022-11-01
Launch MSRP$35,000

Verdict, NVIDIA H800 80GB on real AI workloads

NVIDIA H800 80GB scores 62.6/100, #7 of 102. It ran all 12 workloads. Figures are anchored estimates, not measurements, we flag that on every row.

Relative performance: where the NVIDIA H800 80GB lands

100% = this card, AI & Machine Learning headline metric (AI Score). #7 of 21 datacenter cards in this vertical.

GPURelative%AI Score
NVIDIA B100
107%67
NVIDIA GH200 Grace Hopper
105%65.6
NVIDIA H200
104%65
NVIDIA H100 80GB HBM3
100%62.6
NVIDIA H800 80GB
100%62.6
NVIDIA H100 NVL
93%58.1
NVIDIA RTX PRO 6000 Blackwell Server Edition
80%49.9
NVIDIA H100 PCIe
80%49.8
NVIDIA A100 80GB SXM4
53%33.1

← All AI & Machine Learning GPU rankings

The silicon

Transistors80,000 million
Die size814 mm²
Process node4 nm
Fabricated byTSMC
Transistor density98.3 million per mm²

Denser than 90% of the 746 cards we have silicon data for. Density is the clearest measure of what a process node bought: a card that gained it without growing the die got its speed from the fab rather than the architecture.

Silicon figures from Wikipedia (CC BY-SA 4.0). Benchmarks on this page are our own. Compare every chip.

What this card can build

Whole-job timings, composed from our measured per-model results on this card.

WorkflowTimeEnergyBasis
24-frame storyboard84 sn/aestimate, 0 of 2 stages measured
60-second AI short film2 minn/aestimate, 0 of 3 stages measured
6-panel comic page2.2 minn/aestimate, 0 of 3 stages measured
Character sheet, 12 poses2.9 minn/aestimate, 0 of 2 stages measured
Short social clips6.7 minn/aestimate, 0 of 3 stages measured
Full codebase review6.9 minn/aestimate, 0 of 1 stage measured
Product photo shoot10.5 minn/aestimate, 0 of 2 stages measured
Long-form article batch11.4 minn/aestimate, 0 of 1 stage measured
Photo restoration batch23.5 minn/aestimate, 0 of 1 stage measured