Device: Nvidia GeForce RTX 4090 (24GB)
Category: nvidia
Memory: 24 GB (vram), usable for models: 23 GB
Memory bandwidth: 1008 GB/s
MSRP (USD): 1599
TDP: 450 W
Best runtime: vLLM (Linux) / Ollama (CUDA)
Notes: 24GB GDDR6X on 384-bit bus (~1008 GB/s). ~1GB reserved = ~23GB usable. Flagship Ada Lovelace. Fits 34B Q4_K_M (19GB); 70B requires offloading or very low quant. Best single-GPU consumer option for throughput.