Best local LLM for roleplay & writing on a CPU only / integrated graphics (2026)
All figures assume an f16 KV cache, a 0.6 GB display reserve on the GPU, and 64 GB of DDR5 system RAM for the offload tiers. Tune these in the calculator.
The verdict
Rocinante 12B Q8_0
CPU only at 16K · Roleplay & writing score 9/10 · ≈ 4 tok/s · needs 19 GB system RAM
The budget roleplay king. Lowest slop-per-token of anything under 24 GB; the community keeps it alive for a reason.
llama-server -m Rocinante-12B-v1.1-Q8_0.gguf -c 16384 --flash-attn -ngl 0
Worthy alternates
Cydonia 24B Q8_0
CPU only · ≈ 2 tok/s · Roleplay & writing 9/10
Rocinante's bigger sibling on a Mistral Small base. The default serious-RP pick for 24 GB cards.
Anubis 70B Q4_K_M
CPU only · ≈ 1 tok/s · Roleplay & writing 9/10
The 70B-class roleplay tune with current GGUFs. Llama 3.3 prose depth, none of the corporate manners.
Tune this for your exact RAM and settings in the calculator → · All models on the CPU only / integrated graphics
Frequently asked questions
What is the best local LLM for roleplay & writing on a CPU only / integrated graphics?
Rocinante 12B at Q8_0 — it scores 9/10 for roleplay & writing and runs as "CPU only" at 16K context on the CPU only / integrated graphics.
How much context do I need for roleplay & writing?
We recommend 16K tokens for roleplay & writing (minimum 8K). These picks are computed at 16K.
How fast will it run on a CPU only / integrated graphics?
Roughly 4 tokens/sec for Rocinante 12B — usable for interactive use.
Do I need more than 0 GB of VRAM for roleplay & writing?
No — the pick above needs 0 GB of VRAM plus 19 GB of system RAM at 16K.
What settings should I use?
Start with our command: llama-server -m Rocinante-12B-v1.1-Q8_0.gguf -c 16384 --flash-attn -ngl 0 — then tune context and KV quant in the fit calculator.