Get the latest tech news

An LLM is a lossy encyclopedia


Since I love collecting questionable analogies for LLMs, here's a new one I just came up with: an LLM is a lossy encyclopedia. They have a huge array of facts …

Since I love collecting questionable analogies for LLMs, here's a new one I just came up with: an LLM is a lossy encyclopedia. The key thing is to develop an intuition for questions it can usefully answer vs questions that are at a level of detail where the lossiness matters. This thought sparked by a comment on Hacker News asking why an LLM couldn't "Create a boilerplate Zephyr project skeleton, for Pi Pico with st7789 spi display drivers configured".

Get the Android app

Or read this on Hacker News

Read more on:

Photo of LLM

LLM

Photo of lossy encyclopedia

lossy encyclopedia

Related news:

News photo

Adaptive LLM routing under budget constraints

News photo

I trapped an LLM into a Raspberry Pi and it spiraled into an existential crisis

News photo

The Delusion Machine – What happened when I fed my soul into an LLM