Language-agnostic BERT Sentence Embedding — mentioned by richdougherty

Wed, 19 Aug 2020 02:03:45 GMT

Paper: https://arxiv.org/abs/2007.01852 "We adapt multilingual BERT to produce language-agnostic sentence embeddings for 109 languages. %The state-of-the-art for numerous monolingual and multilingual NLP tasks is masked language model (MLM) pretraining followed by task specific fine-tuning. While English sentence embeddings have been obtained by fine-tuning a pretrained BERT model, such models have not been applied to multilingual sentence embeddings. Our model combines masked language model (MLM) and translation language model (TLM) pretraining with a translation ranking task using…

Paper and discussion history. A mention is not an endorsement.

Language-agnostic BERT Sentence Embedding · HackerPapers discussions

Language-agnostic BERT Sentence Embedding — mentioned by richdougherty