Apple researchers conduct study on AI’s reasoning ability in mathematics: What they found

Apple researchers conducted a study on LLMs to evaluate their mathematical reasoning abilities and found that these models rely on probabilistic pattern-matching, not formal reasoning. They recorded significant performance declines when numerical values changed or questions became more complex, highlighting their limitations in logical reasoning. Researcher says that LLms attempt to replicate the reasoning steps observed in their training data.