Device: Generic Android Phone (8GB RAM)
Category: android
Memory: 8 GB (ram), usable for models: 4.5 GB
Best runtime: llama.cpp (PocketPal or SmolChat)
Notes: Representative of mid-range Android devices (e.g., Pixel 8a, OnePlus 12R, Samsung A55). RAM type varies (LPDDR4X on lower-end, LPDDR5 on higher-end). Android OS overhead ~3-4GB; usable ~4-4.5GB (community estimate). Practical ceiling: 1B-3B Q4_K_M only. Llama 3.2 1B Q4_K_M (~1.2GB runtime) fits well. Phi-3 Mini 3.8B Q4_K_M (~3.6GB runtime) fits with minimal headroom. 7B+ models will reliably OOM. PocketPal (llama.cpp backend) is the recommended consumer app for CPU inference on Android.