Can You Run DeepSeek-Coder-V2-Lite? Every GPU, Tested

A model that doesn't fit doesn't run slowly, it doesn't run. Here's every card from our bench, sorted by measured speed.

Weights: bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

GPUs that run DeepSeek-Coder-V2-Lite (11)

GPUSpeedVRAMBasis
NVIDIA RTX PRO 6000 Blackwell Workstation Edition352.52 tok/s96GB✓ Measured
NVIDIA B300340.53 tok/s288GB✓ Measured
NVIDIA B200325.85 tok/s192GB✓ Measured
NVIDIA H200312.1 tok/s141GB✓ Measured
NVIDIA H100 80GB HBM3309.14 tok/s80GB✓ Measured
NVIDIA L40S257.64 tok/s48GB✓ Measured
NVIDIA A100 80GB SXM4213.91 tok/s80GB✓ Measured
NVIDIA A100 40GB SXM4205.42 tok/s40GBEst.
NVIDIA A10G160.13 tok/s24GB✓ Measured
NVIDIA L4110.11 tok/s24GB✓ Measured
NVIDIA T483.49 tok/s16GB✓ Measured

Quick answers

What is the fastest GPU for DeepSeek-Coder-V2-Lite?

NVIDIA RTX PRO 6000 Blackwell Workstation Edition is the fastest card we've measured running DeepSeek-Coder-V2-Lite, at 352.52 tok/s.

What is the cheapest GPU that can run DeepSeek-Coder-V2-Lite?

NVIDIA T4 ($2,299 MSRP) is the cheapest card on our bench that runs DeepSeek-Coder-V2-Lite, at 83.49 tok/s.

← All models · AI GPU rankings · How we benchmark