Get the latest tech news
AI feedback loop will spell death for future generative models
In the grim dark future of the internet when the global network will be filled with AI-generated data, LLMs will essentially be unable to progress further. Instead,...
Instead, they'll go back to their original state, forgetting previously acquired, human-made content and throwing out only garbled piles of bits for maximum unreliability and minimal credibility. A team of researchers from UK and Canada tried to speculate what the future might hold for LLMs and the internet as a whole, imagining that much of the publicly available content (text, graphics) will eventually be contributed almost exclusively by generative AI services and algorithms. Effectively training new LLMs or improved versions of existing models (like GPT-7 or 8) will become increasingly harder, giving a substantial advantage to companies which already scraped the web before, or can control access to "human interfaces at scale."
Or read this on r/technology
