Device: Nvidia GeForce RTX 5090 (32GB)
Category: nvidia
Memory: 32 GB (vram), usable for models: 31 GB
Memory bandwidth: 1792 GB/s
MSRP (USD): 1999
TDP: 575 W
Best runtime: vLLM (Linux) / Ollama (CUDA)
Notes: 32GB GDDR7 on 512-bit bus (~1792 GB/s). ~1GB reserved = ~31GB usable. Blackwell architecture. Fits 34B Q8 and pushes toward 70B Q4_K_M (~35–38GB, tight). Best single-GPU consumer option as of 2026.