Can You Run MusicGen Small? Every GPU, Tested

A model that doesn't fit doesn't run slowly, it doesn't run. Here's every card from our bench, sorted by measured speed.

Weights: facebook/musicgen-small

GPUs that run MusicGen Small (8)

GPUSpeedVRAMBasis
NVIDIA H100 80GB HBM32.47 x realtime80GB✓ Measured
NVIDIA L40S2.43 x realtime48GB✓ Measured
NVIDIA H2001.87 x realtime141GB✓ Measured
NVIDIA A10G1.2 x realtime24GB✓ Measured
NVIDIA A100 40GB SXM41.08 x realtime40GBEst.
NVIDIA L41.01 x realtime24GB✓ Measured
NVIDIA T40.92 x realtime16GB✓ Measured
NVIDIA A100 80GB SXM40.74 x realtime80GB✓ Measured

Quick answers

What is the fastest GPU for MusicGen Small?

NVIDIA H100 80GB HBM3 is the fastest card we've measured running MusicGen Small, at 2.47 x realtime.

What is the cheapest GPU that can run MusicGen Small?

NVIDIA T4 ($2,299 MSRP) is the cheapest card on our bench that runs MusicGen Small, at 0.92 x realtime.

← All models · AI GPU rankings · How we benchmark