Get the latest tech news
Local LLMs versus offline Wikipedia
How do the sizes of local LLMs compare to the size of offline Wikipedia downloads?
“‘It’s like having a weird, condensed, faulty version of Wikipedia, so I can help reboot society with the help of my little USB stick,’ [Simon Willison] says.” I chose models that could be run on some consumer-grade hardware, and Wikipedia bundles that didn’t have images for a better comparison. Or that Wikipedia can be smaller than the smallest LLM, and larger than the largest ones—at least in an offline scenario on consumer hardware.
Or read this on Hacker News