Get the latest tech news

LLMs excel at inductive reasoning but struggle with deductive tasks, new research shows


LLMs are known for reasoning powers. But new research from MIT and UCLA shows LLMs differ widely between inductive and deductive reasoning.

SolverLearner first prompts the LLM to generate a function that maps input data points to their corresponding output values based solely on a set of input-output examples. The results showed that both LLMs consistently exhibited remarkable inductive reasoning capabilities, achieving near-perfect accuracy on tasks that required them to learn from examples and infer the underlying mapping function. This study is a sobering reminder that we have yet a lot to learn about the abilities of these black boxes that are becoming part of a growing number of applications.

Get the Android app

Or read this on Venture Beat

Read more on:

Photo of LLMs

LLMs

Photo of New research

New research

Photo of deductive tasks

deductive tasks

Related news:

News photo

New research on why Cahokia Mounds civilization left

News photo

Betting on DSPy for Systems of LLMs

News photo

Show HN: LLM-aided OCR – Correcting Tesseract OCR errors with LLMs