AMD Radeon RX 7900 XTX × gpt-oss-120b (MoE)
Can the RX 7900 XTX run gpt-oss-120b (MoE)?
No
No. gpt-oss-120b (MoE) needs at least ~68.4 GB, but the RX 7900 XTX has ~22.8 GB usable. You would need CPU offloading (much slower) or more memory.
By quantization (8K context)
| Quant | Memory needed | Fits? | Est. tok/s |
|---|---|---|---|
| MXFP4 (native) | 68.4 GB | ❌ | — |
Fastest hardware for gpt-oss-120b (MoE)
- Apple M5 Max (40-core GPU, 128GB) — ~65.1 tok/s at MXFP4 (native)
- Apple M2 Ultra (76-core GPU, 192GB) — ~51.2 tok/s at MXFP4 (native)
- Apple M3 Ultra (80-core GPU, 512GB) — ~50.0 tok/s at MXFP4 (native)
- Apple M4 Max (40-core GPU, 128GB) — ~45.1 tok/s at MXFP4 (native)
- NVIDIA DGX Spark — ~31.0 tok/s at MXFP4 (native)
Rent a GPU instead
gpt-oss-120b (MoE) doesn't fit here? Rent a cloud GPU with enough VRAM by the hour and run it there.
Vast.ai — cheap marketplace GPUs · RunPod — on-demand GPU pods
Affiliate links: we may earn a commission at no extra cost to you.
Get new models & benchmarks in your inbox
No spam. Unsubscribe anytime by replying to any email.