Can You Run Florence-2 Base? Every GPU, Tested

A model that doesn't fit doesn't run slowly, it doesn't run. Here's every card from our bench, sorted by measured speed.

Weights: microsoft/Florence-2-base

GPUs that run Florence-2 Base (6)

GPUSpeedVRAMBasis
NVIDIA H100 80GB HBM3249.62 images/min80GB✓ Measured
NVIDIA A10G210.79 images/min24GB✓ Measured
NVIDIA L40S184.2 images/min48GB✓ Measured
NVIDIA L4174.65 images/min24GB✓ Measured
NVIDIA T4148.61 images/min16GB✓ Measured
NVIDIA A100 80GB SXM4126.4 images/min80GB✓ Measured

Quick answers

What is the fastest GPU for Florence-2 Base?

NVIDIA H100 80GB HBM3 is the fastest card we've measured running Florence-2 Base, at 249.62 images/min.

What is the cheapest GPU that can run Florence-2 Base?

NVIDIA T4 ($2,299 MSRP) is the cheapest card on our bench that runs Florence-2 Base, at 148.61 images/min.

← All models · AI GPU rankings · How we benchmark