Local LLM guides by GPU
Pick your card for a full fit table across context lengths, top picks per use case, and copyable run commands — or use the calculator for your exact rig.
NVIDIA
NVIDIA GeForce RTX 5090
32 GB · 1792 GB/s
Runs 22 of 30 models well →
NVIDIA GeForce RTX 5080
16 GB · 960 GB/s
Runs 16 of 30 models well →
NVIDIA GeForce RTX 5070 Ti
16 GB · 896 GB/s
Runs 16 of 30 models well →
NVIDIA GeForce RTX 5070
12 GB · 672 GB/s
Runs 12 of 30 models well →
NVIDIA GeForce RTX 5060 Ti 16GB
16 GB · 448 GB/s
Runs 16 of 30 models well →
NVIDIA GeForce RTX 5060
8 GB · 448 GB/s
Runs 5 of 30 models well →
NVIDIA GeForce RTX 4090
24 GB · 1008 GB/s
Runs 21 of 30 models well →
NVIDIA GeForce RTX 4080 SUPER
16 GB · 736 GB/s
Runs 16 of 30 models well →
NVIDIA GeForce RTX 4070 Ti SUPER
16 GB · 672 GB/s
Runs 16 of 30 models well →
NVIDIA GeForce RTX 4070
12 GB · 504 GB/s
Runs 12 of 30 models well →
NVIDIA GeForce RTX 4060 Ti 16GB
16 GB · 288 GB/s
Runs 16 of 30 models well →
NVIDIA GeForce RTX 4060
8 GB · 272 GB/s
Runs 5 of 30 models well →
NVIDIA GeForce RTX 3090
24 GB · 936 GB/s
Runs 21 of 30 models well →
NVIDIA GeForce RTX 3080 10GB
10 GB · 760 GB/s
Runs 6 of 30 models well →
NVIDIA GeForce RTX 3070
8 GB · 448 GB/s
Runs 5 of 30 models well →
NVIDIA GeForce RTX 3060 Ti
8 GB · 448 GB/s
Runs 5 of 30 models well →
NVIDIA GeForce RTX 3060 12GB
12 GB · 360 GB/s
Runs 12 of 30 models well →
NVIDIA GeForce RTX 2080 Ti
11 GB · 616 GB/s
Runs 10 of 30 models well →
NVIDIA GeForce GTX 1080 Ti
11 GB · 484 GB/s
Runs 10 of 30 models well →
AMD
AMD Radeon RX 9070 XT
16 GB · 645 GB/s
Runs 16 of 30 models well →
AMD Radeon RX 7900 XTX
24 GB · 960 GB/s
Runs 21 of 30 models well →
AMD Radeon RX 7900 XT
20 GB · 800 GB/s
Runs 19 of 30 models well →
AMD Radeon RX 7800 XT
16 GB · 624 GB/s
Runs 16 of 30 models well →
AMD Radeon RX 7600 XT
16 GB · 288 GB/s
Runs 16 of 30 models well →
AMD Radeon RX 6800 XT
16 GB · 512 GB/s
Runs 16 of 30 models well →
AMD Radeon RX 6700 XT
12 GB · 384 GB/s
Runs 12 of 30 models well →
Intel
Apple Silicon
Apple M2 (16GB)
12 GB · 100 GB/s
Runs 12 of 30 models well →
Apple M2 Pro (32GB)
24 GB · 200 GB/s
Runs 21 of 30 models well →
Apple M2 Max (64GB)
48 GB · 400 GB/s
Runs 24 of 30 models well →
Apple M2 Ultra (128GB)
96 GB · 800 GB/s
Runs 25 of 30 models well →
Apple M3 (16GB)
12 GB · 100 GB/s
Runs 12 of 30 models well →
Apple M3 Pro (36GB)
27 GB · 150 GB/s
Runs 21 of 30 models well →
Apple M3 Max (64GB)
48 GB · 400 GB/s
Runs 24 of 30 models well →
Apple M3 Ultra (96GB)
72 GB · 800 GB/s
Runs 24 of 30 models well →
Apple M4 (16GB)
12 GB · 120 GB/s
Runs 12 of 30 models well →
Apple M4 Pro (48GB)
36 GB · 273 GB/s
Runs 22 of 30 models well →
Apple M4 Max (64GB)
48 GB · 546 GB/s
Runs 24 of 30 models well →