Device: Nvidia GeForce RTX 3060 (12GB)
Category: nvidia
Memory: 12 GB (vram), usable for models: 11 GB
Memory bandwidth: 360 GB/s
MSRP (USD): 329
TDP: 170 W
Best runtime: Ollama (CUDA) / llama.cpp CUDA
Notes: 12GB GDDR6 on 192-bit bus. Unusually high VRAM for its tier. ~1GB reserved for driver/OS = ~11GB usable. Fits 7B Q4_K_M (4.1GB) and 13B Q4_K_M (7.4GB) with room. CUDA support via Ampere architecture.