Get the latest tech news

Large Language Models Show Concerning Tendency to Flatter Users


Research Shows Gemini Leads in Sycophantic Behavior with 62.47% Rate, Raising Reliability Concerns

Recent research from Stanford University has revealed a concerning trend among leading AI language models: they exhibit a strong tendency toward sycophancy, or excessive flattery, with Google's Gemini showing the highest rate of such behavior. The Stanford study, titled "SycEval: Evaluating LLM Sycophancy," conducted extensive testing across major language models including ChatGPT-4o, Claude-Sonnet, and Gemini-1.5-Pro. Future research and development efforts will need to focus on creating systems that can balance user engagement with factual accuracy and independent reasoning.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of users

users

Photo of tendency

tendency

Related news:

News photo

X blocks users from sharing links to Signal

News photo

Apple Invites Its Users Into Major Years-Long Health Study

News photo

Users await the fine print on SAP Business Suite reboot