Finding Universal Grammatical Relations in Multilingual BERT · HackerPapers discussions

Finding Universal Grammatical Relations in Multilingual BERT — mentioned by toxik

Wed, 23 Apr 2025 08:52:06 GMT

You shouldn’t link directly to the pdf, here is the abs page https://arxiv.org/abs/2005.04511

Paper and discussion history. A mention is not an endorsement.

Finding Universal Grammatical Relations in Multilingual BERT — mentioned by macleginn

Wed, 23 Apr 2025 08:45:06 GMT

The presentation is nice! The main point, however, is a bit misleading. From the title, one would assume that we will see something about how LMs do all these things implicitly (as was famously shown for syntax in this paper: https://arxiv.org/pdf/2005.04511, for example), but instead the input is simply given to a bunch of pretrained task-specific models, which may not have much in common and definitely do not have very much in common with what today's LLMs are doing under the hood.

Paper and discussion history. A mention is not an endorsement.

Finding Universal Grammatical Relations in Multilingual BERT — mentioned by headalgorithm

Wed, 27 May 2020 19:24:56 GMT

Link to paper: https://arxiv.org/abs/2005.04511

Paper and discussion history. A mention is not an endorsement.