What hardware runs DeepSeek R1?
DeepSeek R1 is a 671.03B-parameter mixture-of-experts model with 37.55B active parameters (mit license). The open reasoning heavyweight, with famously vivid prose as a side effect. MLA keeps its KV cache absurdly small.
All figures assume an f16 KV cache, a 0.6 GB display reserve on the GPU, and 64 GB of DDR5 system RAM for the offload tiers. Tune these in the calculator.
Minimum VRAM by quant and context
| Quant | File size | 8K | 16K | 32K | 64K | 128K |
|---|---|---|---|---|---|---|
| Q2_K * | 227.3 GB | 231.1 GB | 231.9 GB | 233 GB | 235.1 GB | 239.4 GB |
| Q3_K_M | 297.3 GB | 301.1 GB | 301.9 GB | 303 GB | 305.1 GB | 309.4 GB |
| Q4_K_M | 376.7 GB | 380.5 GB | 381.3 GB | 382.3 GB | 384.5 GB | 388.8 GB |
| Q5_K_M | 442.7 GB | 446.6 GB | 447.4 GB | 448.4 GB | 450.6 GB | 454.9 GB |
| Q6_K | 513.0 GB | 516.8 GB | 517.6 GB | 518.7 GB | 520.8 GB | 525.1 GB |
| Q8_0 | 664.3 GB | 668.1 GB | 668.9 GB | 670 GB | 672.1 GB | 676.4 GB |
Full-GPU figures: weights + f16 KV cache + overhead. * below our recommended floor of Q3_K_M.
GPU compatibility
Fits on GPUExpert offloadPartial offloadCPU only
Quant guidance
Our floor for DeepSeek R1 is Q3_K_M — below that, quality degrades faster than the VRAM savings are worth (large models tolerate low bpw better than small ones, which is why the floor is lower here). Prefer the highest quant that still lands "Fits on GPU" or “Expert offload” at your context length in the table above.
Frequently asked questions
How much VRAM does DeepSeek R1 need?
At Q3_K_M and 32K context, DeepSeek R1 needs about 303 GB of VRAM to run fully on GPU (weights + KV cache + overhead). As a mixture-of-experts model it can also run with far less VRAM via expert offload, keeping experts in system RAM.
What is the smallest GPU that can run DeepSeek R1?
No single consumer GPU in our set runs DeepSeek R1 well — it's a cloud-rental or multi-GPU model.
What quantization should I use for DeepSeek R1?
We recommend Q3_K_M or higher. Q4_K_M weighs 376.7 GB (4.82 bits/weight); going below Q3_K_M costs noticeable quality on a model this size.
How long a context can DeepSeek R1 handle?
DeepSeek R1 supports up to 160K tokens. KV cache grows linearly with context, though its MLA attention compresses the KV cache dramatically.
Can I run DeepSeek R1 without a GPU?
Not realistically — even at 8K context the weights don't fit in 64 GB of system RAM.