dexiio

What hardware runs GPT OSS 20B?

GPT OSS 20B is a 20.91B-parameter mixture-of-experts model with 4.19B active parameters (apache-2.0 license). OpenAI's small MoE: 4B active means it flies on modest cards. Heavily filtered — keep it on work tasks.

All figures assume an f16 KV cache, a 0.6 GB display reserve on the GPU, and 64 GB of DDR5 system RAM for the offload tiers. Tune these in the calculator.

Minimum VRAM by quant and context

QuantFile size8K16K32K64K128K
Q2_K *10.7 GB12.9 GB13.3 GB14.1 GB15.7 GB19 GB
Q3_K_M *10.7 GB12.9 GB13.3 GB14.1 GB15.8 GB19 GB
Q4_K_M10.8 GB13 GB13.4 GB14.3 GB15.9 GB19.1 GB
Q5_K_M10.9 GB13.1 GB13.5 GB14.3 GB16 GB19.2 GB
Q6_K11.2 GB13.4 GB13.8 GB14.6 GB16.3 GB19.5 GB
Q8_011.3 GB13.5 GB13.9 GB14.7 GB16.3 GB19.6 GB

Full-GPU figures: weights + f16 KV cache + overhead. * below our recommended floor of Q4_K_M.

GPU compatibility

GPU8K16K32K64K128K
NVIDIA GeForce RTX 5090Q8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 5080Q8_0Q8_0Q8_0Q5_K_MQ8_0
NVIDIA GeForce RTX 5070 TiQ8_0Q8_0Q8_0Q5_K_MQ8_0
NVIDIA GeForce RTX 5070Q8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 5060 Ti 16GBQ8_0Q8_0Q8_0Q5_K_MQ8_0
NVIDIA GeForce RTX 5060Q8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 4090Q8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 4080 SUPERQ8_0Q8_0Q8_0Q5_K_MQ8_0
NVIDIA GeForce RTX 4070 Ti SUPERQ8_0Q8_0Q8_0Q5_K_MQ8_0
NVIDIA GeForce RTX 4070Q8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 4060 Ti 16GBQ8_0Q8_0Q8_0Q5_K_MQ8_0
NVIDIA GeForce RTX 4060Q8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 3090Q8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 3080 10GBQ8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 3070Q8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 3060 TiQ8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 3060 12GBQ8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce RTX 2080 TiQ8_0Q8_0Q8_0Q8_0Q8_0
NVIDIA GeForce GTX 1080 TiQ8_0Q8_0Q8_0Q8_0Q8_0
AMD Radeon RX 9070 XTQ8_0Q8_0Q8_0Q5_K_MQ8_0
AMD Radeon RX 7900 XTXQ8_0Q8_0Q8_0Q8_0Q8_0
AMD Radeon RX 7900 XTQ8_0Q8_0Q8_0Q8_0Q8_0
AMD Radeon RX 7800 XTQ8_0Q8_0Q8_0Q5_K_MQ8_0
AMD Radeon RX 7600 XTQ8_0Q8_0Q8_0Q5_K_MQ8_0
AMD Radeon RX 6800 XTQ8_0Q8_0Q8_0Q5_K_MQ8_0
AMD Radeon RX 6700 XTQ8_0Q8_0Q8_0Q8_0Q8_0
Intel Arc B580Q8_0Q8_0Q8_0Q8_0Q8_0
Intel Arc A770 16GBQ8_0Q8_0Q8_0Q5_K_MQ8_0
Apple M2 (16GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M2 Pro (32GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M2 Max (64GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M2 Ultra (128GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M3 (16GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M3 Pro (36GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M3 Max (64GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M3 Ultra (96GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M4 (16GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M4 Pro (48GB)Q8_0Q8_0Q8_0Q8_0Q8_0
Apple M4 Max (64GB)Q8_0Q8_0Q8_0Q8_0Q8_0
CPU only / integrated graphicsQ8_0Q8_0Q8_0Q8_0Q8_0

Fits on GPUExpert offloadPartial offloadCPU only

Quant guidance

Our floor for GPT OSS 20B is Q4_K_M — below that, quality degrades faster than the VRAM savings are worth. Prefer the highest quant that still lands "Fits on GPU" or “Expert offload” at your context length in the table above.

Recommended run command

Q4_K_M at 32K on a NVIDIA GeForce RTX 5060-class GPU (Expert offload):

llama-server -m gpt-oss-20b-Q4_K_M.gguf -c 32768 --flash-attn -ngl 99 --n-cpu-moe 24

Frequently asked questions

How much VRAM does GPT OSS 20B need?

At Q4_K_M and 32K context, GPT OSS 20B needs about 14.3 GB of VRAM to run fully on GPU (weights + KV cache + overhead). As a mixture-of-experts model it can also run with far less VRAM via expert offload, keeping experts in system RAM.

What is the smallest GPU that can run GPT OSS 20B?

The NVIDIA GeForce RTX 5060 (8 GB) is the smallest GPU in our set that runs GPT OSS 20B well at 32K context, using expert offload with 64 GB of system RAM.

What quantization should I use for GPT OSS 20B?

We recommend Q4_K_M or higher. Q4_K_M weighs 10.8 GB (4.45 bits/weight); going below Q4_K_M costs noticeable quality on a model this size.

How long a context can GPT OSS 20B handle?

GPT OSS 20B supports up to 128K tokens. KV cache grows linearly with context.

Can I run GPT OSS 20B without a GPU?

Yes, at reduced speed: on CPU with 64 GB of DDR5 it manages roughly 20 tokens/sec at 8K context (Q8_0).

Related guides