Get the latest tech news
The Emperor's New LLM
The perils of AI Yes Men
Fine tuned for “helpfulness”, they nod along to our every hunch, buff our pet theories, hand us flawless prose proving whatever we already hoped was true. Ask if your idea is smart, and the model returns footnotes, citations, praise (real or fabricated) that make it sound like everyone already agrees with you. Complex answers, whether medical, financial or political, should include alternative perspectives and we should invent useful ways in which models can surface their confidence intervals to users.
Or read this on Hacker News