Can You Run Qwen2.5 1.5B + 0.5B draft? Every GPU, Tested

A model that doesn't fit doesn't run slowly, it doesn't run. Here's every card from our bench, sorted by measured speed.

GPUs that run Qwen2.5 1.5B + 0.5B draft (6)

GPUSpeedVRAMBasis
NVIDIA L40.97 x vs solo24GB✓ Measured
NVIDIA L40S0.95 x vs solo48GB✓ Measured
NVIDIA A10G0.92 x vs solo24GB✓ Measured
NVIDIA T40.9 x vs solo16GB✓ Measured
NVIDIA H100 80GB HBM30.73 x vs solo80GB✓ Measured
NVIDIA A100 40GB SXM40.69 x vs solo40GBEst.

Quick answers

What is the fastest GPU for Qwen2.5 1.5B + 0.5B draft?

NVIDIA L4 is the fastest card we've measured running Qwen2.5 1.5B + 0.5B draft, at 0.97 x vs solo.

What is the cheapest GPU that can run Qwen2.5 1.5B + 0.5B draft?

NVIDIA T4 ($2,299 MSRP) is the cheapest card on our bench that runs Qwen2.5 1.5B + 0.5B draft, at 0.9 x vs solo.

← All models · AI GPU rankings · How we benchmark