Device: Nvidia GeForce RTX 4080 (16GB)
Category: nvidia
Memory: 16 GB (vram), usable for models: 15 GB
Memory bandwidth: 716.8 GB/s
MSRP (USD): 1199
TDP: 320 W
Best runtime: vLLM (Linux) / Ollama (CUDA)
Notes: 16GB GDDR6X on 256-bit bus (~716 GB/s). ~1GB reserved = ~15GB usable. Good bandwidth for 13B models; 34B models require offloading. Strong for inference throughput.