Get the latest tech news

The telltale words that could identify generative AI text


New paper counts "excess words" that started appearing more often in the post-LLM era.

To measure these vocabulary changes, the researchers analyzed 14 million paper abstracts published on PubMed between 2010 and 2024, tracking the relative frequency of each word as it appeared across each year. Take this example abstract line called out by the researchers, with the marker words highlighted: "A comprehensive grasp of the intricate interplay between [...] and [...] is pivotal for effective therapeutic strategies." The researchers found that papers authored in countries like China, South Korea, and Taiwan showed LLM marker words 15 percent of the time, suggesting "LLMs might... help non-natives with editing English texts, which could justify their extensive use."

Get the Android app

Or read this on r/technology

Read more on:

Photo of telltale words

telltale words

Photo of generative AI text

generative AI text

Related news:

News photo

The Telltale Words That Could Identify Generative AI Text