One Epoch Is All You Need — mentioned by kouteiheika

Thu, 12 Jun 2025 03:32:50 GMT

In general this is of course an active area of research, but yes, you can do something that and people have done it successfully[1] by adding extra layers to an existing model and then continuing to train it. You have to be careful about the "same data" part though; ideally you want to train once on unique data[2] as excessive duplication can harm the performance of the model[3], although if you have limited data a couple of training epochs might be safe and actually improve the performance of the model[4]. [1] -- https://arxiv.org/abs/2312.15166 [2] -- https://arxiv.org/abs/1906.06669 [3]…

Paper and discussion history. A mention is not an endorsement.

One Epoch Is All You Need · HackerPapers discussions

One Epoch Is All You Need — mentioned by kouteiheika