Get the latest tech news

Compression is prediction


Compression and LLMs are trying to solve the exact same problem: predicting what comes next. Learn the fundamentals of compression and how better prediction leads to better shrinkage.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of prediction

prediction

Photo of Compression

Compression

Related news:

News photo

The original URL for this prediction will no longer be available in 11 years (2011)

News photo

"The original URL for this prediction will no longer be available in 11 years." (2011)

News photo

The gap between open weights LLMs and closed source LLMs