Fastest GPU For Segmentation

Isolating objects in an image, the groundwork for masking and compositing.

SAM ViT-Base

Weights: facebook/sam-vit-base

NVIDIA B3001719.59
NVIDIA B2001662.34
NVIDIA H2001469.34
NVIDIA H100 80GB HBM31431.27
NVIDIA RTX PRO 6000 Blackwell Workstation Edition1079.89
NVIDIA L40S998.79
NVIDIA A100 80GB SXM4744.79
NVIDIA A100 40GB SXM4696.77
NVIDIA A10G398.72
NVIDIA L4315.89
NVIDIA T4180.73

Measured in images/min. Longer is faster.

#GPUimages/min
1NVIDIA B3001719.59
2NVIDIA B2001662.34
3NVIDIA H2001469.34
4NVIDIA H100 80GB HBM31431.27
5NVIDIA RTX PRO 6000 Blackwell Workstation Edition1079.89
6NVIDIA L40S998.79
7NVIDIA A100 80GB SXM4744.79
8NVIDIA A100 40GB SXM4696.77
9NVIDIA A10G398.72
10NVIDIA L4315.89
11NVIDIA T4180.73

SAM ViT-Huge

Weights: facebook/sam-vit-huge

NVIDIA B300399.37
NVIDIA B200388.61
NVIDIA H200325.19
NVIDIA H100 80GB HBM3320.64
NVIDIA L40S238.08
NVIDIA RTX PRO 6000 Blackwell Workstation Edition193.47
NVIDIA A100 40GB SXM4146.81
NVIDIA A100 80GB SXM4145.7
NVIDIA A10G84.22
NVIDIA L470.46
NVIDIA T434.91

Measured in images/min. Longer is faster.

#GPUimages/min
1NVIDIA B300399.37
2NVIDIA B200388.61
3NVIDIA H200325.19
4NVIDIA H100 80GB HBM3320.64
5NVIDIA L40S238.08
6NVIDIA RTX PRO 6000 Blackwell Workstation Edition193.47
7NVIDIA A100 40GB SXM4146.81
8NVIDIA A100 80GB SXM4145.7
9NVIDIA A10G84.22
10NVIDIA L470.46
11NVIDIA T434.91

Every number is a first-party run on our own bench. Cards missing from a board have not been measured on that model yet, or cannot fit it.