Can You Run Qwen2.5 7B + 0.5B draft? Every GPU, Tested

Qwen2.5 7B + 0.5B draft needs roughly 24GB of VRAM at our tested precision. A model that doesn't fit doesn't run slowly, it doesn't run. Here's every card from our bench, sorted by measured speed.

GPUs that run Qwen2.5 7B + 0.5B draft (0)

GPUs it won't fit on (1)

These cards' VRAM is below the requirement at tested precision, published as data, not hidden.

Quick answers

How much VRAM does Qwen2.5 7B + 0.5B draft need?

Qwen2.5 7B + 0.5B draft needs roughly 24GB of VRAM at our tested precision. 0 of the GPUs on our bench run it; 1 don't have the VRAM for it.

← All models · AI GPU rankings · How we benchmark