Get the latest tech news

Apple’s upgraded AI models underwhelm on performance


Apple has announced updates to the AI models that power its suite of Apple Intelligence features across iOS, macOS, and more. But according to the company's own benchmarks, the models underperform older models from rival tech firms including OpenAI.

On a number of tests, Llama 4 Scout performs worse than leading models from AI labs like Google, Anthropic, and OpenAI. Some customers have sued Apple, accusing the firm of marketing AI features for its products that it hasn’t yet delivered. That’s thanks in part to an expanded training dataset that includes image data, PDFs, documents, manuscripts, infographics, tables, and charts.

Get the Android app

Or read this on TechCrunch

Read more on:

Photo of Apple

Apple

Photo of Performance

Performance

Related news:

News photo

At WWDC 2025, Apple sang developers’ praises amid AI letdowns and App Store battles

News photo

Warning: Apple Says macOS 27 Won't Support AirPort Time Capsule Backups

News photo

Apple's latest entry-level iPad is back on sale for $299