Get the latest tech news

AI produces gibberish when trained on too much AI-generated data


Generative-AI models collapse when trained recursively.

Generative AI models are now widely accessible, enabling everyone to create their own machine-made something. But these models can collapse if their training data sets contain too much AI-generated content. Thompson, B., Dhaliwal, M. P., Frisch, P., Domhan, T. & Federico, M. Preprint at arXiv https://doi.org/10.48550/arXiv.2401.05749(2024).

Get the Android app

Or read this on r/technology

Read more on:

Photo of generated data

generated data

Related news:

News photo

AI models fed AI-generated data quickly spew nonsense

News photo

AI models collapse when trained on recursively generated data

News photo

Will We Run Out of Data? Limits of LLM Scaling Based on Human-Generated Data