Highway Networks · HackerPapers discussions

Highway Networks — mentioned by orbifold

Wed, 27 Mar 2019 14:14:03 GMT

Ironically Schmidhuber's lab also came up with a more general version of bypassing http://arxiv.org/abs/1505.00387 to train deep networks (with similar performance), of which the popular ResNet is a special case.

Paper and discussion history. A mention is not an endorsement.

Highway Networks — mentioned by PeterisP

Mon, 06 Jun 2016 11:35:30 GMT

Highway layers http://arxiv.org/abs/1505.00387 help with this propagation.

Paper and discussion history. A mention is not an endorsement.

Highway Networks — mentioned by walrus

Wed, 13 Apr 2016 05:38:14 GMT

I'm not qualified to answer this, but I will anyway. To "operate" neural networks (as opposed to writing a framework for them), you need to know the building blocks. There are basic blocks like fully connected layers, convolutions, and nonlinear activations. Beyond those, there are higher level building blocks like LSTMs[1], gated recurrent units[2], highway layers[3], batch normalization[4], and residual blocks[5] that are made up of simpler blocks. Learning what these do and when it's appropriate to use them requires following current literature. Operating neural networks requires some…

Paper and discussion history. A mention is not an endorsement.

Highway Networks — mentioned by 336f5

Tue, 25 Aug 2015 17:58:43 GMT

http://arxiv.org/abs/1505.00387 Very deep NNs, which try to bypass the training difficulties in propagating error all the way from the bottom to the top by adding some special shortcuts between nodes in distant layers.

Paper and discussion history. A mention is not an endorsement.

Highway Networks — HN submission

Sat, 09 May 2015 15:57:55 GMT

Highway Networks

24 points; 2 discussion replies on HN. Paper and source history. A submission is not an endorsement.