Get the latest tech news
A Man Out to Prove How Dumb AI Still Is
François Chollet has constructed the ultimate test for the bots.
For years, he has contributed major research to the field of deep learning, including at Google, where he worked as a software engineer from 2015 until this past November; he wants generative AI to be revolutionary, but worries that the industry has strayed. Drawing from cognitive science, Chollet described such intelligence as the ability to quickly acquire skills and solve unfamiliar problems from first principles, rather than just memorizing enormous amounts of training data and regurgitating information. To hit 87 percent on the original ARC-AGI test, o3 spent roughly 14 minutes per puzzle and, by my calculations, may have required hundreds of thousands of dollars in computing and electricity; the bot came up with more than 1,000 possible answers per grid before selecting a final submission.
Or read this on Hacker News
