Study finds AI-generated web text can harm or help AI training depending on data volume
Research from Pangram Labs and the University of Massachusetts Amherst shows AI-generated text now comprises nearly 31% of web content. A new study demonstrates that training AI models on this 'wild' AI text has complex effects on performance. For models trained on minimal human data, AI-generated content initially improves basic language skills. However, for models already trained on substantial human text, exceeding a certain threshold of AI data degrades performance. The findings challenge existing scaling laws and introduce a new framework where token value changes from beneficial to harmful.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in