Hardware

DeviceMemoryBandwidth
NVIDIA GeForce RTX 509032 GB VRAM1792 GB/s
NVIDIA GeForce RTX 409024 GB VRAM1008 GB/s
NVIDIA GeForce RTX 309024 GB VRAM936 GB/s
NVIDIA GeForce RTX 3090 Ti24 GB VRAM1008 GB/s
NVIDIA GeForce RTX 508016 GB VRAM960 GB/s
NVIDIA GeForce RTX 5070 Ti16 GB VRAM896 GB/s
NVIDIA GeForce RTX 507012 GB VRAM672 GB/s
NVIDIA GeForce RTX 5060 Ti 16GB16 GB VRAM448 GB/s
NVIDIA GeForce RTX 4080 SUPER16 GB VRAM736 GB/s
NVIDIA GeForce RTX 4070 Ti SUPER16 GB VRAM672 GB/s
NVIDIA GeForce RTX 4060 Ti 8GB8 GB VRAM288 GB/s
NVIDIA GeForce RTX 3060 12GB12 GB VRAM360 GB/s
NVIDIA GeForce RTX 3080 10GB10 GB VRAM760 GB/s
AMD Radeon RX 7900 XTX24 GB VRAM960 GB/s
NVIDIA DGX Spark128 GB VRAM273 GB/s
Apple M4 (10-core GPU, 24GB)24 GB unified120 GB/s
Apple M4 Pro (20-core GPU, 48GB)48 GB unified273 GB/s
Apple M4 Max (40-core GPU, 128GB)128 GB unified546 GB/s
Apple M3 Max (40-core GPU, 64GB)64 GB unified400 GB/s
Apple M2 Ultra (76-core GPU, 192GB)192 GB unified800 GB/s
Apple M3 Ultra (80-core GPU, 512GB)512 GB unified800 GB/s
Apple M1 Max (32-core GPU, 64GB)64 GB unified400 GB/s
Apple M5 Max (40-core GPU, 128GB)128 GB unified614 GB/s
Apple M5 Pro (20-core GPU, 64GB)64 GB unified307 GB/s

No suitable GPU? Rent one by the hour on Vast.ai or RunPod (affiliate links).