Comfortable Local Fit
Your answers favor hardware with headroom after weights load — not the minimum card that barely clears the arithmetic.
Best for: Builders who will regret OOM errors more than paying for VRAM, Agent loops and longer context windows, 70B Q4 on 96GB workstation cards; 48GB discrete and 64GB Macs are tight, not comfortable
Watch out: These are planning estimates, not runtime benchmarks. Quantisation format, backend, and context length still change real usage. Verify on the /gpus capacity tables before you buy.
Shortlist examples: RTX PRO 6000 Blackwell, Apple M4 Max (64GB), GeForce RTX 4090