Can You Run Florence-2 Large? Every GPU, Tested

A model that doesn't fit doesn't run slowly, it doesn't run. Here's every card from our bench, sorted by measured speed.

Weights: microsoft/Florence-2-large

GPUs that run Florence-2 Large (6)

GPUSpeedVRAMBasis
NVIDIA H100 80GB HBM3156.15 images/min80GB✓ Measured
NVIDIA A10G117.94 images/min24GB✓ Measured
NVIDIA L40S106.54 images/min48GB✓ Measured
NVIDIA L493.77 images/min24GB✓ Measured
NVIDIA T483.43 images/min16GB✓ Measured
NVIDIA A100 80GB SXM470.94 images/min80GB✓ Measured

Quick answers

What is the fastest GPU for Florence-2 Large?

NVIDIA H100 80GB HBM3 is the fastest card we've measured running Florence-2 Large, at 156.15 images/min.

What is the cheapest GPU that can run Florence-2 Large?

NVIDIA T4 ($2,299 MSRP) is the cheapest card on our bench that runs Florence-2 Large, at 83.43 images/min.

← All models · AI GPU rankings · How we benchmark