Get the latest tech news
Apple Study Reveals Critical Flaws in AI's Logical Reasoning Abilities
Apple's AI research team has uncovered significant weaknesses in the reasoning abilities of large language models, according to a newly published study. MacRumors: The study, published on arXiv [PDF], outlines Apple's evaluation of a range of leading language models, including those from OpenAI, Met...
Apple's AI research team has uncovered significant weaknesses in the reasoning abilities of large language models, according to a newly published study. The findings reveal that even slight changes in the phrasing of questions can cause major discrepancies in model performance that can undermine their reliability in scenarios requiring logical consistency. In several tests, the researchers demonstrated that adding irrelevant information to a question -- details that should not affect the mathematical outcome -- can lead to vastly different answers from the models.
Or read this on Slashdot