Card: int8 on iOS as an entitlement setting; OpenCL node counts per signature

#4
LiteRT Community (FKA TFLite) org

Two sentences I wrote in this card have since been checked more carefully, so this brings the card and the manifest in line with the facts.

The int8 iOS note read as a hard limit. The 2.33 GB main section is above what a default-entitlement app maps in one piece, and the com.apple.developer.kernel.increased-memory-limit entitlement lifts that limit; the same wording is now in the OpenBMB cookbook (OpenBMB/MiniCPM#375). Not re-checked with this file, and the note says so.

The OpenCL node count is per signature, from the Galaxy S26 logs of both files: 1873/1873 on the 1024- to 4-token prefills, 1664/1664 on the 1-token prefill, 1692/1692 on decode. The card said 1873/1873 everywhere.

If this does not fit the card, close it and I will carry it elsewhere. Thanks.

Yoursmiling changed pull request status to merged

Sign up or log in to comment