OpenAI Releases Findings on 377 Math Problems, Further Roiling Field

Irrelevant facts about cats added to math problems increase LLM errors by 300%

Microsoft’s new rStar-Math technique upgrades small models to outperform OpenAI’s o1-preview at math problems

Researchers question AI’s ‘reasoning’ ability as models stumble on math problems with trivial changes