Apple M4 (10-core GPU, 24GB) × Qwen3 30B-A3B (MoE)

Can the Apple M4 (10-core GPU, 24GB) run Qwen3 30B-A3B (MoE)?

Yes

Yes. The Apple M4 (10-core GPU, 24GB) can run Qwen3 30B-A3B (MoE) at up to Q3_K_M (needs ~16.9 GB of 18.0 GB usable), at an estimated ~27.1 tokens/sec at Q3_K_M.

Speed is estimated from memory bandwidth calibrated with a measured 24.11 tok/s Llama 2 7B Q4_0 result (source). No direct public benchmark of this exact pair is recorded yet.

By quantization (8K context)

QuantMemory neededFits?Est. tok/s
Q3_K_M16.9 GB✅~27.1
Q4_K_M20.7 GB❌—
Q5_K_M24.0 GB❌—
Q6_K27.5 GB❌—
Q8_035.0 GB❌—
F1664.4 GB❌—

Fastest hardware for Qwen3 30B-A3B (MoE)

No suitable GPU? Rent one by the hour on Vast.ai or RunPod (affiliate links).

Get new models & benchmarks in your inbox

No spam. Unsubscribe anytime by replying to any email.