Device: Nvidia GeForce RTX 3090 (24GB)
Category: nvidia
Memory: 24 GB (vram), usable for models: 23 GB
Memory bandwidth: 936 GB/s
MSRP (USD): 1499
TDP: 350 W
Best runtime: vLLM (Linux) / Ollama (CUDA)
Notes: 24GB GDDR6X on 384-bit bus (~936 GB/s). ~1GB reserved = ~23GB usable. Ampere architecture. Excellent value-per-GB for LLM inference; same VRAM ceiling as RTX 4090 at lower bandwidth. Fits 34B Q4_K_M.