ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators — HN submission

Tue, 16 Jul 2024 00:18:20 GMT

Electra: Pre-Training Text Encoders as Discriminators Rather Than Generators (2020)

65 points; 9 discussion replies on HN. Paper and source history. A submission is not an endorsement.

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators — mentioned by qayxc

Sat, 28 Nov 2020 13:42:03 GMT

In this particular case it's excusable as English is the Lingua Franca of science today. Used to be Latin, then French and German, now it's English. No big deal IMO. In fact I kind of like the way this is going since it represents a fantastic opportunity for NL researchers to stand out simply by publishing research and corpora focused exclusively on low-resource languages and non-English/Mandarin in general. It is also important to note that most of the ML research in the field is pretty much language agnostic and is concerned with general concept such as efficient en-/decoding [1], training…

Paper and discussion history. A mention is not an endorsement.

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators · HackerPapers discussions

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators — HN submission

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators — mentioned by qayxc