Get the latest tech news

OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems


OpenAI researchers have admitted that even the most advanced AI models can't really solve the coding problems put in front of them.

OpenAI researchers have admitted that even the most advanced AI models still are no match for human coders — even though CEO Sam Altman insists they will be able to beat " low-level" software engineers by the end of this year. Though all three LLMs were often able to operate "far faster than a human would," the paper notes, they also failed to grasp how widespread bugs were or to understand their context, "leading to solutions that are incorrect or insufficiently comprehensive." Though these LLMs have advanced rapidly over the past few years and will likely continue to do so, they're not skilled enough at software engineering to replace real-life people quite yet — not that that's stopping CEOs from firing their human coders in favor of immature AI models.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of openai researchers

openai researchers

Photo of coding problems

coding problems

Related news:

News photo

OpenAI researchers develop new model that speeds up media generation by 50X

News photo

AlphaCodium outperforms direct prompting of OpenAI's o1 on coding problems

News photo

Former OpenAI researchers warn of 'catastrophic harm' after the company opposes AI safety bill