8GB · AI Score 1.9/100 · first-party measured on 12 AI workloads
1.9 AI Score ✓ Measured
Every number on this page is first-party: GeForce RTX 4060 was run on our pinned 12-workload AI suite on 2026-07-11, with under 0.5% run-to-run variance. On Llama 3.1 8B (Q4_K_M) GeForce RTX 4060 delivers about 52.4 tokens/sec. Llama 3.3 70B does not fit. It needs roughly 42GB and this card has 8GB. For image generation, SDXL runs at 1.39 it/s, while FLUX.1-dev won't fit at BF16 (needs ~26GB). 9 of the 12 workloads won't fit on 8GB at the tested precision, Qwen2.5-Coder 14B, Qwen3 32B, Llama 3.3 70B, Z-Image Turbo and others. We publish those as hard gates rather than quietly dropping to a smaller quant.
Short version: 8GB gated 9 of my 12 workloads. If AI is any part of why you're buying, don't buy 8GB, the model that doesn't fit doesn't run slow, it doesn't run. Quick note on the setup: all my AI benchmarking was done on rented cloud GPUs, I used all three of Vast.ai, RunPod and Modal depending on which had the card, and they all have their pros and cons. Same pinned harness on every run, and everything here got double-checked before it went up.
| Workload | Result | Telemetry | Data |
|---|---|---|---|
| Qwen3 4B | 86.38 tok/s | Q4_K_M | ✓ Measured |
| Llama 3.1 8B | 52.4 tok/s | Q4_K_M | ✓ Measured |
| Qwen2.5-Coder 14B | ✕ Won't fit needs ~11.5 GB | VRAM-gated at this precision | ✓ Measured |
| Qwen3 32B | ✕ Won't fit needs ~23 GB | VRAM-gated at this precision | ✓ Measured |
| Llama 3.3 70B | ✕ Won't fit needs ~46 GB | VRAM-gated at this precision | ✓ Measured |
| Workload | Result | Telemetry | Data |
|---|---|---|---|
| Stable Diffusion XL | 2.78 images/min | 5.6 GB peak21.5 s/img | ✓ Measured |
| Z-Image Turbo | ✕ Won't fit needs ~13 GB | VRAM-gated at this precision | ✓ Measured |
| FLUX.1 dev | ✕ Won't fit needs ~26 GB | VRAM-gated at this precision | ✓ Measured |
| Workload | Result | Telemetry | Data |
|---|---|---|---|
| FLUX.1 Kontext dev | ✕ Won't fit needs ~26 GB | VRAM-gated at this precision | ✓ Measured |
| Qwen-Image-Edit | ✕ Won't fit needs ~42 GB | VRAM-gated at this precision | ✓ Measured |
| Workload | Result | Telemetry | Data |
|---|---|---|---|
| LTX-Video (distilled) | ✕ Won't fit needs ~14 GB | VRAM-gated at this precision | ✓ Measured |
| Wan 2.2 5B (720p) | ✕ Won't fit needs ~18 GB | VRAM-gated at this precision | ✓ Measured |
| Architecture | Ada Lovelace |
| CUDA cores | 3,072 |
| VRAM | 8GB GDDR6 |
| Memory bus | 128-bit |
| Memory bandwidth | 272 GB/s |
| Boost clock | 2,475 MHz |
| TDP | 115 W |
| Process | 4nm |
| Interface | PCIe 4.0 x16 |
| Release date | 2023-05-24 |
| Launch MSRP | $299 |
GeForce RTX 4060 scores 1.9/100, #92 of 102. It ran 3 of 12; 9 exceeded its 8GB. Every figure here is our own measurement.
100% = this card, AI & Machine Learning headline metric (AI Score). #52 of 61 desktop cards in this vertical.
| GPU | Relative | % | AI Score |
|---|---|---|---|
| Intel Arc B580 | 105% | 2 | |
| NVIDIA GeForce RTX 2060 Super | 100% | 1.9 | |
| NVIDIA GeForce RTX 2070 | 100% | 1.9 | |
| NVIDIA GeForce RTX 3050 | 100% | 1.9 | |
| GeForce RTX 4060 | 100% | 1.9 | |
| NVIDIA GeForce RTX 5050 | 100% | 1.9 | |
| Intel Arc A750 | 100% | 1.9 | |
| AMD Radeon RX 7600 | 95% | 1.8 | |
| NVIDIA GeForce GTX 1080 | 95% | 1.8 |
Same card, other workloads: GeForce RTX 4060 Gaming benchmarks
← All AI & Machine Learning GPU rankings
| Transistors | 18,900 million |
| Die size | 158.7 mm² |
| Process node | 4 nm |
| Fabricated by | TSMC |
| Transistor density | 119.1 million per mm² |
Denser than 76% of the 76 cards we have silicon data for. Density is the clearest measure of what a process node bought: a card that gained it without growing the die got its speed from the fab rather than the architecture.
Silicon figures from Wikipedia (CC BY-SA 4.0). Benchmarks on this page are our own. Compare every chip.
Whole-job timings, composed from our measured per-model results on this card.
Can't run: 60-second AI short film (needs Qwen3 32B), 60-second AI short film, narrated (needs Qwen3 32B), 10 short social clips (needs Qwen3 32B), 40-product photo shoot (needs FLUX.1 Kontext dev), 6-panel comic page (needs Qwen3 32B), 20 long-form articles (needs Llama 3.3 70B), Full codebase review (needs Qwen2.5-Coder 14B), Character sheet, 12 poses (needs FLUX.1 dev), 100-photo restoration batch (needs FLUX.1 Kontext dev), 24-frame storyboard (needs Qwen3 32B), 100-photo restore and enlarge (needs FLUX.1 Kontext dev).