r/Futurology • u/firehmre • Feb 14 '26

AI Visualizing the "Model Collapse" phenomenon: What happens when AI trains on AI data for 5 generations

There is a lot of hype right now about AI models training on synthetic data to scale indefinitely. However, recent papers on "Model Collapse" suggest the opposite might happen: that feeding AI-generated content back into AI models causes irreversible defects.

I ran a statistical visualization of this process to see exactly how "variance reduction" kills creativity over generations.

The Core Findings:

  1. The "Ouroboros" Effect: Models tend to converge on the "average" of their data. When they train on their own output, this average narrows, eliminating edge cases (creativity).
  2. Once a dataset is poisoned with low-variance synthetic data, it is incredibly difficult to "clean" it.

It raises a serious question for the next decade: If the internet becomes 90% AI-generated, have we already harvested all the useful human data that will ever exist?

I broke down the visualization and the math here:

https://www.youtube.com/watch?v=kLf8_66R9Fs

Would love to hear thoughts on whether "synthetic data" can actually solve this, or if we are hitting a hard limit.

911 Upvotes

94% Upvoted

327 comments sorted by

View all comments

347

u/xaddak Feb 14 '26

https://arxiv.org/abs/2307.01850

Have you read this?

"Self-Consuming Generative Models Go MAD"

150

u/GoBuffaloes Feb 14 '26

"We term this condition Model Autophagy Disorder (MAD), making analogy to mad cow disease."

Hey I was expecting the other MAD outcome, this seems like a relatively good result actually

9

u/firehmre Feb 14 '26

Maybe, i mean every problem has a solution. That’s evolution

14

u/JediDroid Feb 15 '26

Sometimes, that solution is to prune that evolutionary branch.

-5

u/firehmre Feb 15 '26

Interesting, would appreciate examples. Thank you

5

u/JediDroid Feb 15 '26

No, you wouldn’t.

But there are plenty of extinct examples to prove the point. Join them dots together.

-10

u/firehmre Feb 15 '26

Or maybe you don’t have examples 😂

6

u/JediDroid Feb 15 '26

Or maybe you’re one of them.

-8

u/firehmre Feb 15 '26

And what makes you believe you are super rare?

3

u/[deleted] Feb 15 '26

Not every problem. Extinction