NVIDIA A40, AI & Machine Learning Benchmarks & Specs

48GB · AI Score 17.7/100 · first-party measured on 12 AI workloads

17.7 AI Score Includes estimates

Every number on this page is first-party: NVIDIA A40 was run on our pinned 12-workload AI suite on 2026-07-11, with under 0.5% run-to-run variance. On Llama 3.1 8B (Q4_K_M) NVIDIA A40 delivers about 106.18 tokens/sec. Stepping up to Qwen3 32B it holds roughly 26.89 tok/s. Llama 3.3 70B does not fit. It needs roughly 42GB and this card has 48GB. For image generation, SDXL runs at 4.6 it/s, and FLUX.1-dev at 0.91 it/s. 1 of the 12 workloads won't fit on 48GB at the tested precision, Llama 3.3 70B. We publish those as hard gates rather than quietly dropping to a smaller quant. NVIDIA A40 isn't a retail purchase for most people. It's rented by the hour. You can run this exact card on RunPod.

AI & Machine Learning benchmark results

Text Generation tok/s 5

Qwen3 4B160.79
Llama 3.1 8B106.18
Qwen2.5-Coder 14B57.85
Qwen3 32B26.89
WorkloadResultTelemetryData
Qwen3 4B160.79 tok/s
3 GB peak165 W49°C0.97 tok/WQ4_K_M
✓ Measured
Llama 3.1 8B106.18 tok/s
4.9 GB peak182 W53°C0.59 tok/WQ4_K_M
✓ Measured
Qwen2.5-Coder 14B57.85 tok/s
8.7 GB peak188 W58°C0.31 tok/WQ4_K_M
✓ Measured
Qwen3 32B26.89 tok/s
18.7 GB peak170 W59°C0.16 tok/WQ4_K_M
✓ Measured
Llama 3.3 70Bn/a tok/sestimatedEst.

Image Generation images/min 3

Stable Diffusion XL9.2
Z-Image Turbo3.225
FLUX.1 dev1.95
WorkloadResultTelemetryData
Stable Diffusion XL9.2 images/min
15.8 GB peak295 W57°C6.5 s/img
✓ Measured
Z-Image Turbo3.23 images/min
44.3 GB peak298 W66°C18.5 s/img
✓ Measured
FLUX.1 dev1.95 images/min
44.4 GB peak297 W68°C30.7 s/img
✓ Measured

Video Generation frames/s 1

WorkloadResultTelemetryData
Wan 2.2 5B (720p)0.31 frames/s
44.4 GB peak294 W69°C159.7 s/clip
✓ Measured
How we measured this. Every result comes from our own pinned, reproducible AI suite, 12 workloads: the Qwen3-4B to Llama-70B LLM ladder (llama.cpp, Q4_K_M), SDXL / Z-Image / FLUX-dev generation, FLUX-Kontext / Qwen-Edit editing, and LTX / Wan video, run first-party on rented hardware with under 0.5% run-to-run variance. Peak VRAM, power draw, temperature and tokens-per-watt are captured per workload. “Won’t fit” rows are real data: where a model exceeds the card’s VRAM at the tested precision we record a hard gate rather than silently dropping to a smaller quant. Measured 2026-07-11 · harness 2.0.0-standalone.

NVIDIA A40 specifications

ArchitectureAmpere
CUDA cores10,752
VRAM48GB GDDR6
Memory bus384-bit
Memory bandwidth696 GB/s
Boost clock1,740 MHz
TDP300 W
ProcessSamsung 8nm
InterfacePCIe 4.0 x16
Release date2020-10-05
Launch MSRP$5,000

Verdict, capable, but 48GB sets the ceiling

NVIDIA A40 scores 17.7/100, #22 of 102. It ran 8 of 12; 1 exceeded its 48GB. Every figure here is our own measurement.

Relative performance: where the NVIDIA A40 lands

100% = this card, AI & Machine Learning headline metric (AI Score). #16 of 21 desktop cards in this vertical.

GPURelative%AI Score
NVIDIA A800 80GB
187%33.1
NVIDIA A100 80GB PCIe
179%31.7
NVIDIA L40S
156%27.7
NVIDIA L40
110%19.5
NVIDIA A40
100%17.7
NVIDIA A100 40GB SXM4
96%17
NVIDIA A100 40GB PCIe
94%16.7
NVIDIA A10G
36%6.4
NVIDIA L4
28%5

← All AI & Machine Learning GPU rankings

What this card can build

Whole-job timings, composed from our measured per-model results on this card.

WorkflowTimeEnergyBasis
24-frame storyboard10.2 min39.46 Whall 2 stages measured
Full codebase review17.3 min54.16 Whmeasured
10 short social clips33.4 min145.56 Whall 3 stages measured

Rent or buy?

This card is $5,000 to buy. The cheapest listed rate on RunPod is $0.350/hour, but that is the floor: we budget $0.420/hour, a 20% premium, because idle time, storage and unavailable cheap instances all land on the same bill. At that rate buying wins after 11,905 GPU-hours. Below it you are paying for idle silicon.

How you would use itGPU-hours a yearRental cost a yearTime to break even
2 hours a day, hobby730$30716.3 years
8 hours a day, working on it2,920$1,2264.1 years
24/7, always-on agent8,760$3,6791.4 years

At hobby usage this card is very unlikely to pay for itself before it is superseded. Rent it. Rental figures include a 20% premium over the cheapest listed rate. Ignores electricity, resale and the fact that a rented card can be a newer one tomorrow.

Rental price

$0.350/hr+0.0% since 2026-08-14low $0.350 · high $0.350

Cheapest of the RunPod and Vast on-demand rates we see, sampled daily. Spot and interruptible pricing runs lower.