Get the latest tech news

'Model collapse'? An expert explains the rumours about an impending AI doom


Generative AI needs tons of data to learn. It also generates new data. So, what happens when AI starts training on AI-made content?

Discussed in 2023, but popularised more recently, “model collapse” refers to a hypothetical scenario where future AI systems get progressively dumber due to the increase of AI-generated data on the internet. To source this data, big tech companies such as OpenAI, Google, Meta and Nvidia continually scour the internet, scooping up terabytes of content to feed the machines. A flood of synthetic content might not pose an existential threat to the progress of AI development, but it does threaten the digital public good of the (human) internet.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Expert

Expert

Photo of rumours

rumours

Photo of model collapse

model collapse

Related news:

News photo

Why AI Researchers Are Worried About ‘Model Collapse’

News photo

Beware of AI 'model collapse': How training on synthetic data pollutes the next generation

News photo

Children should be allowed to get bored (2013)