Device: Samsung Galaxy S24 Ultra
Category: android
Memory: 12 GB (ram), usable for models: 8.5 GB
Memory bandwidth: 76.8 GB/s
MSRP (USD): 1299
TDP: 8 W
Best runtime: llama.cpp (PocketPal) or MLC-LLM (Adreno GPU path)
Notes: 12GB LPDDR5X at 4800MHz confirmed via GSMArena review page (explicitly states RAM type and speed). All S24 Ultra configs are 12GB (no 16GB tier unlike S25 Ultra). Snapdragon 8 Gen 3 (US). Android OS overhead ~3-4GB; usable ~8-8.5GB (community estimate). Practical ceiling: 7B Q4_K_M (~7GB runtime) fits; 13B Q4_K_M (~11.7GB) will OOM. MLC-LLM uses Adreno 750 GPU for faster inference. Samsung Galaxy AI on-device features use 1B-3B class models.