Model collapse occurs when new generative models train on AI-generated content and gradually degenerate as a result. In this scenario, models start to forget the true underlying data distribution, even if the distribution does not change.
Follow
@johnverdon
very important revelation. thanks. hilarious too🤣
"important because generative AI is poised to bring about significant change in digital content. online communications are being generated using AI tools.
this phenomenon has the potential to create data pollution on a large scale.
Although creating large quantities of text is more efficient than ever, model collapse states that
NONE IF THIS DATA will be valuable to train the next generation of AI models.”