Best local LLM for roleplay & writing on a NVIDIA GeForce RTX 5060 (2026)
All figures assume an f16 KV cache, a 0.6 GB display reserve on the GPU, and 64 GB of DDR5 system RAM for the offload tiers. Tune these in the calculator.
The verdict
Qwen3.5 35B A3B Q8_0
Expert offload at 16K · Roleplay & writing score 6/10 · ≈ 13 tok/s · needs 36 GB system RAM
The meta pick, full stop. Near-dense-30B quality at 3B-active speed, and expert offload puts it on 8 GB cards.
llama-server -m Qwen3.5-35B-A3B-Q8_0.gguf -c 16384 --flash-attn -ngl 99 --n-cpu-moe 40
Worthy alternates
Gemma 4 26B A4B Q6_K
Expert offload · ≈ 14 tok/s · Roleplay & writing 6/10
Google's fast MoE with native audio in. Nearly all of its weight sits in routed experts, so expert offload runs it comfortably on 12 GB cards.
Rocinante 12B IQ4_XS
Partial offload · Roleplay & writing 9/10
The budget roleplay king. Lowest slop-per-token of anything under 24 GB; the community keeps it alive for a reason.
Tune this for your exact RAM and settings in the calculator → · All models on the NVIDIA GeForce RTX 5060
Frequently asked questions
What is the best local LLM for roleplay & writing on a NVIDIA GeForce RTX 5060?
Qwen3.5 35B A3B at Q8_0 — it scores 6/10 for roleplay & writing and runs as "Expert offload" at 16K context on the NVIDIA GeForce RTX 5060.
How much context do I need for roleplay & writing?
We recommend 16K tokens for roleplay & writing (minimum 8K). These picks are computed at 16K.
How fast will it run on a NVIDIA GeForce RTX 5060?
Roughly 13 tokens/sec for Qwen3.5 35B A3B — usable for interactive use.
Do I need more than 8 GB of VRAM for roleplay & writing?
No — the pick above needs 5.5 GB of VRAM plus 36 GB of system RAM at 16K.
What settings should I use?
Start with our command: llama-server -m Qwen3.5-35B-A3B-Q8_0.gguf -c 16384 --flash-attn -ngl 99 --n-cpu-moe 40 — then tune context and KV quant in the fit calculator.