Fastest GPU For Music Generation

Generating music from a prompt, measured against realtime.

Full guide: Best GPU for AI music and sound-effect generation, with what each card costs per job, which VRAM sizes fit, and our picks.

MusicGen Small

Weights: facebook/musicgen-small

NVIDIA H100 80GB HBM32.47
NVIDIA L40S2.43
NVIDIA H2001.87
NVIDIA A10G1.2
NVIDIA A100 40GB SXM41.08
NVIDIA L41.01
NVIDIA T40.92
NVIDIA A100 80GB SXM40.74

Measured in x realtime. Longer is faster.

#GPUx realtime
1NVIDIA H100 80GB HBM32.47
2NVIDIA L40S2.43
3NVIDIA H2001.87
4NVIDIA A10G1.2
5NVIDIA A100 40GB SXM41.08
6NVIDIA L41.01
7NVIDIA T40.92
8NVIDIA A100 80GB SXM40.74

ACE-Step 1.5

Weights: ACE-Step/Ace-Step1.5

NVIDIA H100 80GB HBM327.05
NVIDIA L40S20.44
NVIDIA A10G18.65
NVIDIA L412.84

Measured in x realtime. Longer is faster.

#GPUx realtime
1NVIDIA H100 80GB HBM327.05
2NVIDIA L40S20.44
3NVIDIA A10G18.65
4NVIDIA L412.84

ACE-Step v1 3.5B

Weights: ACE-Step/ACE-Step-v1-3.5B

NVIDIA H100 80GB HBM314.83
NVIDIA L40S13.78
NVIDIA L48.26

Measured in x realtime. Longer is faster.

#GPUx realtime
1NVIDIA H100 80GB HBM314.83
2NVIDIA L40S13.78
3NVIDIA L48.26

DiffRhythm 2

Weights: ASLP-lab/DiffRhythm2

#GPUx realtime
1NVIDIA H100 80GB HBM35.63
2NVIDIA L40S5.43

Every number is a first-party run on our own bench. Cards missing from a board have not been measured on that model yet, or cannot fit it.