gpt-oss-120b (MoE)
OpenAI · 117B parameters (MoE, 5.1B active per token) · 131,072 token max context · Model card
Memory needed
| Quant | Weights | Total @ 8K ctx |
|---|---|---|
| MXFP4 (native) | 65.0 GB | 68.4 GB |
Approximate GGUF sizes from bits-per-weight; totals include fp16 KV cache and ~0.8 GB overhead.
Can my hardware run it?
| Device | Verdict | Best quant | Est. tok/s (Q4) |
|---|---|---|---|
| Apple M5 Max (40-core GPU, 128GB) | Yes | MXFP4 (native) | ~65.1 |
| Apple M2 Ultra (76-core GPU, 192GB) | Yes | MXFP4 (native) | ~51.2 |
| Apple M3 Ultra (80-core GPU, 512GB) | Yes | MXFP4 (native) | ~50.0 |
| Apple M4 Max (40-core GPU, 128GB) | Yes | MXFP4 (native) | ~45.1 |
| NVIDIA DGX Spark | Yes | MXFP4 (native) | ~31.0 |
| NVIDIA GeForce RTX 5090 | No | — | — |
| NVIDIA GeForce RTX 4090 | No | — | — |
| NVIDIA GeForce RTX 3090 | No | — | — |
| NVIDIA GeForce RTX 3090 Ti | No | — | — |
| NVIDIA GeForce RTX 5080 | No | — | — |
| NVIDIA GeForce RTX 5070 Ti | No | — | — |
| NVIDIA GeForce RTX 5070 | No | — | — |
| NVIDIA GeForce RTX 5060 Ti 16GB | No | — | — |
| NVIDIA GeForce RTX 4080 SUPER | No | — | — |
| NVIDIA GeForce RTX 4070 Ti SUPER | No | — | — |
| NVIDIA GeForce RTX 4060 Ti 8GB | No | — | — |
| NVIDIA GeForce RTX 3060 12GB | No | — | — |
| NVIDIA GeForce RTX 3080 10GB | No | — | — |
| AMD Radeon RX 7900 XTX | No | — | — |
| Apple M4 (10-core GPU, 24GB) | No | — | — |
| Apple M4 Pro (20-core GPU, 48GB) | No | — | — |
| Apple M3 Max (40-core GPU, 64GB) | No | — | — |
| Apple M1 Max (32-core GPU, 64GB) | No | — | — |
| Apple M5 Pro (20-core GPU, 64GB) | No | — | — |
Speeds estimated from memory bandwidth (calibrated per device with a measured llama.cpp benchmark where available).