Learning Sparse Neural Networks through $L_0$ Regularization — mentioned by dpkingma

Mon, 05 Aug 2024 13:54:23 GMT

There seems to be some relevant prior work that is not referenced by this paper, such as our work on training sparse neural networks: https://arxiv.org/abs/1712.01312 Abstract: "We propose a practical method for L0 norm regularization for neural networks: pruning the network during training by encouraging weights to become exactly zero. Such regularization is interesting since (1) it can greatly speed up training and inference, and (2) it can improve generalization. [...]"

Paper and discussion history. A mention is not an endorsement.

Learning Sparse Neural Networks through $L_0$ Regularization · HackerPapers discussions

Learning Sparse Neural Networks through $L_0$ Regularization — mentioned by dpkingma