Get the latest tech news
Game over for pure LLMs. Even Rich Sutton has gotten off the bus
One by one, all the big names have turned around. What should we do next?
Rich Sutton, recent winner of Turing Award, is well-known for his 2019 unpublished essay called The Bitter Lesson that arguably foresaw the rise of extra-large language models. It is a truly great essay (which as it happens I reread earlier this week) in the sense of having a lot of smart ideas packed into a mere page and half. The first lays out Sutton’s basic ideas (and yes on the left you can see in miniature form the entire manifesto; better for your eyes though that you should read it here).
Or read this on Hacker News