Get the latest tech news
Entropy of a Large Language Model output
created: 2025-01-06 updated: 2025-01-06 Large language models like ChatGPT & Claude have become ubiquitous in today’s world. I visited a friend for the New years eve and was impressed by how ChatGPT was being extensively used within the family.
The friend’s little kid is going to grow up in a world, where turning to large language models (LLM) for quick answers is going to be the norm rather than the exception. I would particularly recommend playing around with the animation by Jonas Parnow & Mark Belan in that post to get an intuitive understanding of what the measure of disorder actually means. While no substantial conclusions can be made from this little experiment, it is of paramount importance that we pay heed to the Thirukkural couplet above and discern the truth regardless of who (or what) speaks it!
Or read this on Hacker News
