

NVIDIA L40 wins 11 of 12 benchmarks, averaging 82.6% faster.
NVIDIA L40's numbers are anchored estimates calibrated against our measured cards, pending first-party measurement. Treat small gaps as ties.
The gap is widest in Stable Diffusion XL, where NVIDIA L40 leads by 168% (4.18 vs 11.2 images/min); the closest fight is Llama 3.1 8B (37% apart); VRAM decides part of this one: NVIDIA L40 runs 11 of our 12 AI workloads while the other card runs 3, models that don't fit score zero.
| Benchmark | NVIDIA GeForce RTX 2080 Ti Founders Edition | NVIDIA L40 | Difference |
|---|---|---|---|
| Qwen3 4B tok/s | 148.46 | 211.33 | -30% |
| Llama 3.1 8B tok/s | 98.34 | 135.12 | -27% |
| Qwen2.5-Coder 14B tok/s | 0 | 74.27 | n/a |
| Qwen3 32B tok/s | 0 | 34.08 | n/a |
| Llama 3.3 70B tok/s | 0 | 0 | n/a |
| Stable Diffusion XL images/min | 4.18 | 11.2 | -63% |
| Z-Image Turbo images/min | 0 | 5.625 | n/a |
| FLUX.1 dev images/min | 0 | 2.464 | n/a |
| FLUX.1 Kontext dev images/min | 0 | 1.114 | n/a |
| Qwen-Image-Edit images/min | 0 | 0.48 | n/a |
| LTX-Video (distilled) frames/s | 0 | 2.61 | n/a |
| Wan 2.2 5B (720p) frames/s | 0 | 0.37 | n/a |
| NVIDIA GeForce RTX 2080 Ti Founders Edition | NVIDIA L40 | |
|---|---|---|
| VRAM | 11GB | 48GB |
| Architecture | Turing (TU102) | Ada Lovelace |
| Memory bandwidth | 616 GB/s | 864 GB/s |
| Boost clock | 1,545 MHz | 2,490 MHz |
| TDP | 250 W | 300 W |
| Launch MSRP | $1,199 | $7,000 |
| Release | 2018-09-20 | 2022-10-13 |
NVIDIA GeForce RTX 2080 Ti Founders Edition full review · NVIDIA L40 full review · All AI & Machine Learning rankings