Get the latest tech news

The Illusion of “The Illusion of Thinking”


Very recently (early June 2025), Apple released a paper called The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the…

Very recently (early June 2025), Apple released a paper called The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity. If you’re worried that math and coding benchmarks suffer from contamination, why would you pick well-known puzzles for which we know the solutions exist in the training data? The key insight here is that past a certain complexity threshold, the model decides that there’s too many steps to reason through and starts hunting for clever shortcuts.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of illusion

illusion

Related news:

News photo

The Illusion of Thinking: Strengths and Limitations of Reasoning Models

News photo

The Illusion of Thinking: Understanding the Limitations of Reasoning LLMs [pdf]

News photo

The Illusion of Causality in Charts