Convolutional Sequence to Sequence Learning — mentioned by jgehring

Wed, 10 May 2017 09:54:40 GMT

Yes, there have been a couple of attempts to use CNNs for translation already, but none of them outperformed big and well-tuned LSTM systems. We propose an architecture that is fast to run, easy to optimize and can scale to big networks, and could thus be used as a base architecture for future research. There are a couple of contributions in the paper (https://arxiv.org/abs/1705.03122) apart from demonstrating the feasibility of CNNs for translation, e.g. the multi-hop attention in combination with a CNN language model, the wiring of the CNN encoder[1], or an initialization scheme for GLUs…

Paper and discussion history. A mention is not an endorsement.

Convolutional Sequence to Sequence Learning · HackerPapers discussions

Convolutional Sequence to Sequence Learning — mentioned by jgehring