Device: iPhone 16 Pro
Category: iphone
Memory: 8 GB (unified), usable for models: 4.5 GB
Memory bandwidth: 60 GB/s
MSRP (USD): 999
TDP: 12 W
Best runtime: llama.cpp + Metal (via PocketPal or Off Grid app)
Notes: 8GB unified memory confirmed (same MacRumors source as iPhone 16, all 4 iPhone 16 models have 8GB). A18 Pro chip with 6-core GPU gives higher inference throughput vs A16/A17 but same memory envelope. iOS overhead ~3-4GB; usable ~4.5GB (community estimate). Practical ceiling 1B-4B Q4_K_M. Off Grid app (llama.cpp+Metal) and PocketPal are primary consumer runtimes. Apple Intelligence 3B on-device model fits comfortably.