Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
mitkox 
posted an update 13 days ago
Post
2315
I've spent some time checking the promises vs reality of on-device AI between Apple Intelligence and Microsoft Copilot+. Reading the marketing documentation is good, but not enough. Hands-on tests are the best, unfortunately, both are not there yet.

Both are looking to lock developers behind local API to the SLM inferencing engine and SDK mix of open source and proprietary code. Both can not work air-gapped and offline for meaningful workflows, only some basic ones and both require the hybrid AI local/remote plane calling back either APIs on Azure or the Apple Private Cloud Compute.

Some of the Copilot+ functionally is available in Windows App SDK 1.6 exp2. It's focused on the old-school enterprise developers and not sure if they will be the early adaptors of GenAI-backed apps... I still have the Recall on my dev-PC as they have removed it.

Apple Intelligence is hard to get beyond the vague description and the State of the Union video. Even the current beta of macOS 15 and xcode don't have any "A.I." in them. At the moment it is all promises and a lack of technical documentation and code.

Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

I partially agree... AI on device is today what the first home computers were in the 80s. Cool but not ready. Expensive and not worth it.
Both Microsoft, Google and Apple will be using 1B-3B models with a 14 quantization and a finetune on their company products. Perhaps useful for answering a message or summarizing something but not much more.
About cloud A.I. while I agree that copilot is way to censored and "aligned with microsoft", I think gemini flash is very good. I haven't tried gemini pro extensively but I did with gemini flash and it was suprising.

Fully agree, great post