Get the latest tech news

I trained a small transformer in 1.5hrs and it beats many LLMs


rained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRM This is an upgrade to my previous model Faster, better, cheaper and still open source. Also gets 7% on ARC-2 Discussion on Twitter, Code on github This is the 3rd blog in a series of works on ARC-AGI.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Cents

Cents

Photo of ARC-AGI-1

ARC-AGI-1

Related news:

News photo

Kingston's NV3 1TB PCIe 4.0 SSD drops to $156.99 at Newegg — 27% off brings it down to just 15.7 cents per GB

News photo

A bug in AWS has caused some customers' bills to spike from a few cents to billions of dollars

News photo

Apple Boosts AppleCare+ Monthly Prices by 50 Cents in Latest Increase