Get the latest tech news
Sweatshop Data Is Over
Mechanize is a software company that builds RL environments and sells them to the leading AI labs.
Unlike static datasets, interactive environments offer ongoing, interesting challenges that remain valuable as models improve, much like how games continue to engage players across a wide range of skill levels. Current methods will get us to the point where AIs can prove theorems and solve hard puzzles, but it won’t be enough to get models to deal with the open-ended nature of reality, where the quality of our actions cannot be so easily “verified” as either correct or incorrect. A simple scoring script can’t determine whether an AI would make an effective lawyer: that requires evaluating its ability to construct cogent arguments, properly contextualize information, and ultimately prevail in court.
Or read this on Hacker News