On the Properties of Neural Machine Translation: Encoder-Decoder Approaches — mentioned by walrus

Wed, 13 Apr 2016 05:38:14 GMT

I'm not qualified to answer this, but I will anyway. To "operate" neural networks (as opposed to writing a framework for them), you need to know the building blocks. There are basic blocks like fully connected layers, convolutions, and nonlinear activations. Beyond those, there are higher level building blocks like LSTMs[1], gated recurrent units[2], highway layers[3], batch normalization[4], and residual blocks[5] that are made up of simpler blocks. Learning what these do and when it's appropriate to use them requires following current literature. Operating neural networks requires some…

Paper and discussion history. A mention is not an endorsement.

On the Properties of Neural Machine Translation: Encoder-Decoder Approaches · HackerPapers discussions

On the Properties of Neural Machine Translation: Encoder-Decoder Approaches — mentioned by walrus