Dynamics of Deep Neural Networks and Neural Tangent Hierarchy — mentioned by fgabriel

Thu, 28 Nov 2019 06:30:28 GMT

For trained wide neural networks, you can have a look at "Neural Tangent Kernel: Convergence and Generalization in Neural Networks" (https://arxiv.org/abs/1806.07572) where we explain the training of very wide ANN. This sparked a numerous amount of research and in the few last results about training wide ANN you can have a look at: https://arxiv.org/abs/1909.08156 and https://arxiv.org/abs/1904.11955

Paper and discussion history. A mention is not an endorsement.

Dynamics of Deep Neural Networks and Neural Tangent Hierarchy · HackerPapers discussions

Dynamics of Deep Neural Networks and Neural Tangent Hierarchy — mentioned by fgabriel