Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation · HackerPapers discussions

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — mentioned by YeGoblynQueenne

Sun, 04 Feb 2018 00:46:52 GMT

Yes, I know about GT's "interlingua". I've chosen my "swallow" example specifically to show that it's basically just a model of English. Which makes a lot of sense when you realise that all the languages in the language pairs that GT's interlingua covers will have many, many more texts going to and from English, than to and from any other language. Attempting to derive a many-to-many language model from an English-dominated corpus is very likely to lead to an intermediary model that is basically English-to-many. In fact, if you read the relevant paper [1] the dominance of English in tables…

Paper and discussion history. A mention is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — mentioned by iraphael

Thu, 27 Jul 2017 19:48:26 GMT

[FLAGGED] This very misguided article seems to be a complete misunderstanding of two papers: https://arxiv.org/abs/1706.05125 and https://arxiv.org/abs/1611.04558 None of the dramatic claims have any basis in real science, or real world events (e.g.: "it prompted concerns we could lose control of AI"? I'm 100% certain this came from the author's imagination). This kind of AI apocalyptic alarmism with no real basis is the same kind that created the first AI winter, and the complete misinterpretation of research in popular culture. Unless there's a very deep layer of irony I'm not seeing, this…

Paper and discussion history. A mention is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — mentioned by aspenmayer

Fri, 17 Mar 2017 20:17:40 GMT

I admittedly understand very little about ML and how Google is using it in Translate, but this seems relevant. In “Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation”, we address this challenge by extending our previous GNMT system, allowing for a single system to translate between multiple languages. Our proposed architecture requires no change in the base GNMT system, but instead uses an additional “token” at the beginning of the input sentence to specify the required target language to translate to. In addition to improving translation quality, our…

Paper and discussion history. A mention is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — HN submission

Fri, 24 Feb 2017 23:50:56 GMT

Google's Zero-Shot Multilingual Neural Machine Translation System

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — mentioned by nl

Mon, 02 Jan 2017 23:00:21 GMT

Why do you say German is notoriously bad? I don't speak German, but that linked page reads fine to me, and their neural translation system has state-of-the-art performance for both English->German and German->English at least[1]. I would have thought that the well-structured nature of German makes it reasonably easy to translate, assuming you have a NN architecture with sufficient memory range. [1] https://arxiv.org/abs/1611.04558

Paper and discussion history. A mention is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — mentioned by ma2rten

Mon, 02 Jan 2017 20:28:32 GMT

No offense, but this person has no idea what they are talking about. Google published a paper that explains exactly what they are doing and provides metrics as well [1,2]. It's true that neural networks can not be easily applied to natural languages, but there are less obvious ways of applying them (namely Embeddings, LSTMs, Attention) and provided you have enough data and computational resources they give so much better results than any other method that it doesn't even help anymore to combine them. [1] https://arxiv.org/abs/1609.08144 [2] https://arxiv.org/abs/1611.04558 EDIT: I also don't…

Paper and discussion history. A mention is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — mentioned by vonnik

Mon, 02 Jan 2017 18:38:06 GMT

He makes a good point about continuous functions. But actually neural nets are quite good at handling discrete elements like words, likes, atoms in a molecule, etc. Deep learning is part of enormous advances in NLP[0], just as it has set records to accuracy in almost every field of machine perception, from vision to audio. Neural word embeddings like those produced by word2vec[1] make for very useful feature vectors when fed into other neural nets. The headline of this post should be that NLP is harder than, say, image processing. In fact, for non-specialists, none of it is easy, because…

Paper and discussion history. A mention is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — HN submission

Thu, 24 Nov 2016 21:52:03 GMT

Multilingual Neural Machine Translation

5 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — mentioned by Smerity

Sat, 19 Nov 2016 06:02:22 GMT

Hey HN, I'm author of the article. If there's anything confusing, I'd be happy to help :) The GNMT architecture is likely to keep popping up in Google's papers due to the amount of engineering that's been dedicated to make it scale well. Other than chewing up massive machine translation datasets, from single to multiple language pairs, it's also been trained over the entirety of Reddit for a conversational model system. Just this week a new paper[1] was released using the GNMT architecture which teaches a machine translation system how to translate between language pairs it has never been…

Paper and discussion history. A mention is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — HN submission

Tue, 15 Nov 2016 18:31:59 GMT

Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation — HN submission

Tue, 15 Nov 2016 05:38:06 GMT

Zero shot translation learning

15 points; 2 discussion replies on HN. Paper and source history. A submission is not an endorsement.