Get the latest tech news

Study Done By Apple AI Scientists Proves LLMs Have No Ability to Reason


Slashdot reader Rick Schumann shared this report from the blog AppleInsider: A new paper from Apple's artificial intelligence scientists has found that engines based on large language models, such as those from Meta and OpenAI, still lack basic reasoning skills. The group has proposed a new ben...

Slashdot reader Rick Schumann shared this report from the blog AppleInsider: A new paper from Apple's artificial intelligence scientists has found that engines based on large language models, such as those from Meta and OpenAI, still lack basic reasoning skills. The study found that adding even a single sentence that appears to offer relevant information to a given math question can reduce the accuracy of the final answer by up to 65 percent. The behavior of LLMS "is better explained by sophisticated pattern matching" which the study found to be "so fragile, in fact, that [simply] changing names can alter results."

Get the Android app

Or read this on Slashdot

Read more on:

Photo of Apple

Apple

Photo of Scientists

Scientists

Photo of Study

Study

Related news:

News photo

LLMs can’t outperform a technique from the 70s, but they’re still worth using — here’s why

News photo

Columbus was a Sephardic Jew from Western Europe, study finds

News photo

Apple might release a $2,000 Vision headset next year