What hardware runs Qwen3 Coder 30B A3B?
Qwen3 Coder 30B A3B is a 30.53B-parameter mixture-of-experts model with 3.35B active parameters (apache-2.0 license). Purpose-built agentic coder. Best local fill-in-the-middle and tool-calling under 70B; useless at small talk.
All figures assume an f16 KV cache, a 0.6 GB display reserve on the GPU, and 64 GB of DDR5 system RAM for the offload tiers. Tune these in the calculator.
Minimum VRAM by quant and context
| Quant | File size | 8K | 16K | 32K | 64K | 128K |
|---|---|---|---|---|---|---|
| Q2_K * | 10.5 GB | 13.1 GB | 13.8 GB | 15.4 GB | 18.5 GB | 24.8 GB |
| Q3_K_M * | 13.7 GB | 16.3 GB | 17.1 GB | 18.6 GB | 21.8 GB | 28 GB |
| Q4_K_M | 17.3 GB | 19.9 GB | 20.6 GB | 22.2 GB | 25.3 GB | 31.6 GB |
| Q5_K_M | 20.2 GB | 22.8 GB | 23.6 GB | 25.2 GB | 28.3 GB | 34.5 GB |
| Q6_K | 23.4 GB | 26 GB | 26.7 GB | 28.3 GB | 31.4 GB | 37.7 GB |
| Q8_0 | 30.3 GB | 32.8 GB | 33.6 GB | 35.2 GB | 38.3 GB | 44.6 GB |
| IQ4_XS | 15.3 GB | 17.8 GB | 18.6 GB | 20.2 GB | 23.3 GB | 29.6 GB |
Full-GPU figures: weights + f16 KV cache + overhead. * below our recommended floor of Q4_K_M.
GPU compatibility
Fits on GPUExpert offloadPartial offloadCPU only
Quant guidance
Our floor for Qwen3 Coder 30B A3B is Q4_K_M — below that, quality degrades faster than the VRAM savings are worth. Prefer the highest quant that still lands "Fits on GPU" or “Expert offload” at your context length in the table above.
Recommended run command
Q4_K_M at 32K on a NVIDIA GeForce RTX 5060-class GPU (Expert offload):
llama-server -m Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf -c 32768 --flash-attn -ngl 99 --n-cpu-moe 48
Frequently asked questions
How much VRAM does Qwen3 Coder 30B A3B need?
At Q4_K_M and 32K context, Qwen3 Coder 30B A3B needs about 22.2 GB of VRAM to run fully on GPU (weights + KV cache + overhead). As a mixture-of-experts model it can also run with far less VRAM via expert offload, keeping experts in system RAM.
What is the smallest GPU that can run Qwen3 Coder 30B A3B?
The NVIDIA GeForce RTX 5060 (8 GB) is the smallest GPU in our set that runs Qwen3 Coder 30B A3B well at 32K context, using expert offload with 64 GB of system RAM.
What quantization should I use for Qwen3 Coder 30B A3B?
We recommend Q4_K_M or higher. Q4_K_M weighs 17.3 GB (4.86 bits/weight); going below Q4_K_M costs noticeable quality on a model this size.
How long a context can Qwen3 Coder 30B A3B handle?
Qwen3 Coder 30B A3B supports up to 256K tokens. KV cache grows linearly with context.
Can I run Qwen3 Coder 30B A3B without a GPU?
Yes, at reduced speed: on CPU with 64 GB of DDR5 it manages roughly 14 tokens/sec at 8K context (Q8_0).