dexiio

What hardware runs Qwen3.5 122B A10B?

Qwen3.5 122B A10B is a 122.11B-parameter mixture-of-experts model with 9.77B active parameters (apache-2.0 license). Arguably the best model a 128 GB Mac can run today. The unified-memory sweet spot the 397B can't reach.

All figures assume an f16 KV cache, a 0.6 GB display reserve on the GPU, and 64 GB of DDR5 system RAM for the offload tiers. Tune these in the calculator.

Minimum VRAM by quant and context

QuantFile size8K16K32K64K128K
Q3_K_M *52.5 GB55.1 GB55.9 GB57.5 GB60.6 GB66.8 GB
Q4_K_M71.3 GB73.9 GB74.6 GB76.2 GB79.3 GB85.6 GB
Q5_K_M85.2 GB87.8 GB88.6 GB90.2 GB93.3 GB99.5 GB
Q6_K94.1 GB96.7 GB97.4 GB99 GB102.1 GB108.4 GB
Q8_0121.0 GB123.5 GB124.3 GB125.9 GB129 GB135.3 GB

Full-GPU figures: weights + f16 KV cache + overhead. * below our recommended floor of Q4_K_M.

GPU compatibility

GPU8K16K32K64K128K
NVIDIA GeForce RTX 5090Q4_K_MQ4_K_MQ4_K_MQ4_K_MQ4_K_M
NVIDIA GeForce RTX 5080Q4_K_MQ4_K_M
NVIDIA GeForce RTX 5070 TiQ4_K_MQ4_K_M
NVIDIA GeForce RTX 5070
NVIDIA GeForce RTX 5060 Ti 16GBQ4_K_MQ4_K_M
NVIDIA GeForce RTX 5060
NVIDIA GeForce RTX 4090Q4_K_MQ4_K_MQ4_K_MQ4_K_M
NVIDIA GeForce RTX 4080 SUPERQ4_K_MQ4_K_M
NVIDIA GeForce RTX 4070 Ti SUPERQ4_K_MQ4_K_M
NVIDIA GeForce RTX 4070
NVIDIA GeForce RTX 4060 Ti 16GBQ4_K_MQ4_K_M
NVIDIA GeForce RTX 4060
NVIDIA GeForce RTX 3090Q4_K_MQ4_K_MQ4_K_MQ4_K_M
NVIDIA GeForce RTX 3080 10GB
NVIDIA GeForce RTX 3070
NVIDIA GeForce RTX 3060 Ti
NVIDIA GeForce RTX 3060 12GB
NVIDIA GeForce RTX 2080 Ti
NVIDIA GeForce GTX 1080 Ti
AMD Radeon RX 9070 XTQ4_K_MQ4_K_M
AMD Radeon RX 7900 XTXQ4_K_MQ4_K_MQ4_K_MQ4_K_M
AMD Radeon RX 7900 XTQ4_K_MQ4_K_MQ4_K_MQ4_K_M
AMD Radeon RX 7800 XTQ4_K_MQ4_K_M
AMD Radeon RX 7600 XTQ4_K_MQ4_K_M
AMD Radeon RX 6800 XTQ4_K_MQ4_K_M
AMD Radeon RX 6700 XT
Intel Arc B580
Intel Arc A770 16GBQ4_K_MQ4_K_M
Apple M2 (16GB)
Apple M2 Pro (32GB)Q4_K_MQ4_K_MQ4_K_MQ4_K_M
Apple M2 Max (64GB)Q4_K_MQ4_K_MQ4_K_MQ4_K_MQ4_K_M
Apple M2 Ultra (128GB)Q5_K_MQ5_K_MQ5_K_MQ5_K_MQ4_K_M
Apple M3 (16GB)
Apple M3 Pro (36GB)Q4_K_MQ4_K_MQ4_K_MQ4_K_MQ4_K_M
Apple M3 Max (64GB)Q4_K_MQ4_K_MQ4_K_MQ4_K_MQ4_K_M
Apple M3 Ultra (96GB)Q4_K_MQ4_K_MQ4_K_MQ4_K_MQ4_K_M
Apple M4 (16GB)
Apple M4 Pro (48GB)Q4_K_MQ4_K_MQ4_K_MQ4_K_MQ4_K_M
Apple M4 Max (64GB)Q4_K_MQ4_K_MQ4_K_MQ4_K_MQ4_K_M
CPU only / integrated graphics

Fits on GPUExpert offloadPartial offloadCPU only

Quant guidance

Our floor for Qwen3.5 122B A10B is Q4_K_M — below that, quality degrades faster than the VRAM savings are worth (large models tolerate low bpw better than small ones, which is why the floor is lower here). Prefer the highest quant that still lands "Fits on GPU" or “Expert offload” at your context length in the table above.

Recommended run command

Q4_K_M at 32K on a Apple M2 Ultra (128GB)-class GPU (Fits on GPU):

llama-server -m Qwen3.5-122B-A10B-Q4_K_M.gguf -c 32768 --flash-attn -ngl 99

Frequently asked questions

How much VRAM does Qwen3.5 122B A10B need?

At Q4_K_M and 32K context, Qwen3.5 122B A10B needs about 76.2 GB of VRAM to run fully on GPU (weights + KV cache + overhead). As a mixture-of-experts model it can also run with far less VRAM via expert offload, keeping experts in system RAM.

What is the smallest GPU that can run Qwen3.5 122B A10B?

The Apple M2 Ultra (128GB) (96 GB) is the smallest GPU in our set that runs Qwen3.5 122B A10B well at 32K context, using expert offload with 64 GB of system RAM.

What quantization should I use for Qwen3.5 122B A10B?

We recommend Q4_K_M or higher. Q4_K_M weighs 71.3 GB (5.01 bits/weight); going below Q4_K_M costs noticeable quality on a model this size.

How long a context can Qwen3.5 122B A10B handle?

Qwen3.5 122B A10B supports up to 256K tokens. KV cache grows linearly with context.

Can I run Qwen3.5 122B A10B without a GPU?

Not realistically — even at 8K context the weights don't fit in 64 GB of system RAM.

Related guides