Device: Nvidia GeForce RTX 4060 Ti (16GB)
Category: nvidia
Memory: 16 GB (vram), usable for models: 15 GB
Memory bandwidth: 288 GB/s
MSRP (USD): 499
TDP: 165 W
Best runtime: Ollama (CUDA) / llama.cpp CUDA
Notes: 16GB GDDR6 on 128-bit bus (narrow bandwidth: 288 GB/s). ~1GB reserved = ~15GB usable. Bandwidth bottleneck limits throughput vs wider-bus alternatives. Fits 13B Q4_K_M easily; 34B at low quant.