Fastest GPU For Music Generation

Generating music from a prompt, measured against realtime.

MusicGen Small

Weights: facebook/musicgen-small

NVIDIA H100 80GB HBM32.47
NVIDIA L40S2.43
NVIDIA H2001.87
NVIDIA A10G1.2
NVIDIA A100 40GB SXM41.08
NVIDIA L41.01
NVIDIA T40.92
NVIDIA A100 80GB SXM40.74

Measured in x realtime. Longer is faster.

#GPUx realtime
1NVIDIA H100 80GB HBM32.47
2NVIDIA L40S2.43
3NVIDIA H2001.87
4NVIDIA A10G1.2
5NVIDIA A100 40GB SXM41.08
6NVIDIA L41.01
7NVIDIA T40.92
8NVIDIA A100 80GB SXM40.74

Every number is a first-party run on our own bench. Cards missing from a board have not been measured on that model yet, or cannot fit it.