oLMpics -- On what Language Model Pre-training Captures — mentioned by rmrfstar

Wed, 29 Apr 2020 13:08:54 GMT

> at some point admit that we want machine learning algorithms to be able to interface with symbolic rules rather than pretending that everything is a data issue That is a long way off. We find ourselves in a situation where we have models that do useful things, but are also horrendously biased. If you want improvement now, the quickest way to get it is recasting benchmarks. Most NLP research groups just hill climb on GLUE or whatever. What gets measured gets managed, and bias is not being systematically measured. Right now language models can't even compare ages that fall outside the 20-100…

Paper and discussion history. A mention is not an endorsement.

oLMpics -- On what Language Model Pre-training Captures · HackerPapers discussions

oLMpics -- On what Language Model Pre-training Captures — mentioned by rmrfstar