Get the latest tech news

A weird phrase is plaguing scientific papers


Once errors creep into the AI knowledge base, they can be very hard to get out.

This phrase, which sounds technical but is actually nonsense, has become a “digital fossil” – an error preserved and reinforced in artificial intelligence (AI) systems that is nearly impossible to remove from our knowledge repositories. The large language models behind modern AI chatbots such as ChatGPT are “trained” on huge amounts of text to predict the likely next word in a sequence. For instance, observers have noted the rise of “ tortured phrases ” used to evade automated integrity software, such as “counterfeit consciousness” instead of “artificial intelligence”.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of scientific papers

scientific papers

Photo of weird phrase

weird phrase

Related news:

News photo

AI Could Be Making Scientists Less Creative | A new study examining 68 million scientific papers shows using AI boosts researchers' careers, but narrows the questions they ask.

News photo

In some scientific papers, words expressing uncertainty have decreased (2023)