Device: Nvidia GeForce RTX 4070 (12GB)
Category: nvidia
Memory: 12 GB (vram), usable for models: 11 GB
Memory bandwidth: 504 GB/s
MSRP (USD): 599
TDP: 200 W
Best runtime: Ollama (CUDA) / vLLM (Linux)
Notes: 12GB GDDR6X on 192-bit bus (~504 GB/s). ~1GB reserved = ~11GB usable. Better bandwidth than 4060 Ti 16GB despite less VRAM. Fits 7B comfortably, 13B Q4 squeezed.