Get the latest tech news
Apple's AI Strategy in a Nutshell
The sleeping giant finally reveals its hand..
But let’s quickly recap how Apple classifies its AI workloads, which are grouped into three buckets: on-device, private cloud compute, and 3rd party model inference (explained below). Note, it’s Apple’s OS that automatically decides whether to run AI locally or remotely, unless it’s for ChatGPT which requires the user to explicitly opt-in. on-edge LLM inference: a small, low latency AI model (3bn params) will be included in future iOS versions, and it will be able to understand user commands, the current screen, and take actions on apps.
Or read this on Hacker News