Continual Learning: Applications and the Road Forward — mentioned by chriskanan

Sat, 15 Mar 2025 12:36:00 GMT

As a leader in the field of continual learning, I somewhat agree, but I'd say that catastrophic forgetting is largely resolved. The problem is that the continual learning community largely has become insular and is mostly focusing on toy problems that don't matter, where they will even avoid good solutions for nonsensical reasons. For example, reactivation / replay / rehearsal works well for mitigating catastrophic forgetting almost entirely, but a lot of the continual learning community mostly dislikes it because it is very effective. A lot of the work is focusing on toy problems and they…

Paper and discussion history. A mention is not an endorsement.

Continual Learning: Applications and the Road Forward · HackerPapers discussions

Continual Learning: Applications and the Road Forward — mentioned by chriskanan