What Does BERT Look At? An Analysis of BERT's Attention · HackerPapers discussions

What Does BERT Look At? An Analysis of BERT's Attention — mentioned by Xmd5a

Wed, 23 Apr 2025 06:05:13 GMT

https://arxiv.org/abs/1906.04341 https://arxiv.org/abs/1905.05950 https://en.wikiversity.org/wiki/Psycholinguistics/Models_of_...

Paper and discussion history. A mention is not an endorsement.

What Does BERT Look At? An Analysis of BERT's Attention — mentioned by KhoomeiK

Fri, 17 Feb 2023 00:37:26 GMT

Several papers have explored emergent linguistic structure in LMs. Here's some early introductory work in this space. Despite having explicit syntax parses etc as input, models seem to learn something like syntax. https://arxiv.org/abs/1905.05950 https://aclanthology.org/N19-1419/ https://arxiv.org/abs/1906.04341

Paper and discussion history. A mention is not an endorsement.

What Does BERT Look At? An Analysis of BERT's Attention — HN submission

Mon, 24 Jun 2019 23:07:32 GMT

What Does Bert Look At? An Analysis of BERT’s Attention

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

What Does BERT Look At? An Analysis of BERT's Attention — HN submission

Thu, 13 Jun 2019 04:12:03 GMT

What Does Bert Look At? An Analysis of BERT's Attention

4 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

What Does BERT Look At? An Analysis of BERT's Attention — HN submission

Wed, 12 Jun 2019 12:39:57 GMT

What Does Bert Look At? An Analysis of BERT's Attention

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.