Large Batch Training of Convolutional Networks — mentioned by samsamoa

Fri, 14 Dec 2018 20:25:50 GMT

Author here— Yes, this is a great question! I think there's a lot more interesting work to be done here. It would be great if we could understand e.g. why layer-wise learning rates help with large-batch training of ImageNet (https://arxiv.org/abs/1708.03888), and maybe the per-component noise scale has something to do with it.

Paper and discussion history. A mention is not an endorsement.

Large Batch Training of Convolutional Networks · HackerPapers discussions

Large Batch Training of Convolutional Networks — mentioned by samsamoa