It's kind of sort of already happening. Emdashes are fragments of it, a token saving strategy introduced by already trained on old books in their data sources. Model collapse is inevitable.
uairhahs
joined 2 years ago
Exclusively Cocaine Steve Ballmer
Yes exactly the point being made in the link. AI picks up unintended behaviours already, it's not too hard to imagine that the general direction is towards model collapse.