Device: AMD Radeon RX 7900 XTX (24GB)
Category: amd
Memory: 24 GB (vram), usable for models: 23 GB
Memory bandwidth: 960 GB/s
MSRP (USD): 999
TDP: 355 W
Best runtime: Ollama (ROCm) / llama.cpp ROCm (Linux)
Notes: 24GB GDDR6 on 384-bit bus (~960 GB/s). ~1GB reserved = ~23GB usable. RDNA 3 architecture. ROCm support on Linux; ROCm on Windows is experimental/limited. LLM inference quality behind CUDA in software maturity. Fits 34B Q4_K_M. Windows users typically prefer llama.cpp with ROCm or DirectML backend.