Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verification — mentioned by konmok

Sun, 13 Sep 2026 03:54:44 GMT

> The latest studies demonstrate model collapse is not a given Which studies? [edit: I'll assume you mean these two given by @dorolow: https://arxiv.org/abs/2404.01413 https://arxiv.org/abs/2406.07515] > It can't be used as the -only- data source of course, but that's not how it is being used Right, so human data creation would also have to scale up exponentially, and that's not gonna happen. > because there's no difference between synthetic data and the data people can create I mean, that's obviously false, otherwise model collapse wouldn't exist. The difference is statistical, but it's…

Paper and discussion history. A mention is not an endorsement.

Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verification — mentioned by dorolow

Sun, 13 Sep 2026 03:52:33 GMT

We use large amounts of synthetic data for training at work and have not observed any sort of model collapse when done properly. Edit: https://arxiv.org/abs/2404.01413 https://arxiv.org/abs/2406.07515

Paper and discussion history. A mention is not an endorsement.

Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verification · HackerPapers discussions

Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verification — mentioned by konmok

Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verification — mentioned by dorolow