Local AI Capacity First
Your answers favor memory headroom for open models: buy VRAM (or usable unified memory) before chasing peak raster scores.
- Best for:
- Builders running mid-to-large open models locally, People who already know CUDA or MLX tooling, Buyers who will regret undersized VRAM more than lower frame rates
- Watch out:
- A 70B Q4 model is a ~42.5GB Q4_K_M file (~48GB with a modest context) — 24GB and 32GB discrete cards do not host it, and 48GB discrete or 64GB unified memory is a tight fit. Prefer 72GB+ discrete or 96GB+ unified memory for comfortable headroom; street prices in September 2026 run far above launch MSRP, so verify them and power/cooling before you buy.
Shortlist examples: RTX PRO 6000 Blackwell, GeForce RTX 5090, GeForce RTX 4090