Fastest GPU For Depth Estimation

Reading 3D structure out of a flat photo, a stage in most 3D and relighting pipelines.

Depth Anything V2 Large

Weights: depth-anything/Depth-Anything-V2-Large-hf

NVIDIA RTX PRO 6000 Blackwell Workstation Edition1328.11
NVIDIA B3001069.95
NVIDIA H2001040.81
NVIDIA B2001039.47
NVIDIA L40S959.33
NVIDIA H100 80GB HBM3918.71
NVIDIA A100 80GB SXM4876.29
NVIDIA L4770.37
NVIDIA A10G740.74
NVIDIA A100 40GB SXM4536.74
NVIDIA T4402.34

Measured in images/min. Longer is faster.

#GPUimages/min
1NVIDIA RTX PRO 6000 Blackwell Workstation Edition1328.11
2NVIDIA B3001069.95
3NVIDIA H2001040.81
4NVIDIA B2001039.47
5NVIDIA L40S959.33
6NVIDIA H100 80GB HBM3918.71
7NVIDIA A100 80GB SXM4876.29
8NVIDIA L4770.37
9NVIDIA A10G740.74
10NVIDIA A100 40GB SXM4536.74
11NVIDIA T4402.34

Depth Anything V2 Small

Weights: depth-anything/Depth-Anything-V2-Small-hf

NVIDIA B3001491.6
NVIDIA RTX PRO 6000 Blackwell Workstation Edition1374.58
NVIDIA H2001198.58
NVIDIA B2001137.49
NVIDIA H100 80GB HBM31081.54
NVIDIA L40S970.61
NVIDIA A10G941.18
NVIDIA A100 80GB SXM4925.15
NVIDIA L4916.66
NVIDIA A100 40GB SXM4613.42
NVIDIA T4612.25

Measured in images/min. Longer is faster.

#GPUimages/min
1NVIDIA B3001491.6
2NVIDIA RTX PRO 6000 Blackwell Workstation Edition1374.58
3NVIDIA H2001198.58
4NVIDIA B2001137.49
5NVIDIA H100 80GB HBM31081.54
6NVIDIA L40S970.61
7NVIDIA A10G941.18
8NVIDIA A100 80GB SXM4925.15
9NVIDIA L4916.66
10NVIDIA A100 40GB SXM4613.42
11NVIDIA T4612.25

Every number is a first-party run on our own bench. Cards missing from a board have not been measured on that model yet, or cannot fit it.