Dynamic Bernoulli Embeddings for Language Evolution — mentioned by prions

Thu, 04 Oct 2018 14:47:03 GMT

This is a great article. One big thing NLP lacks (soon enough, lacked) over computer vision is its own version of ImageNet and other similar off the shelf models that can be fit to different domains. Many NLP models are brittle due to the disparity between tasks and problem domains. My BiLSTM-CRF model for NER would require retraining on a completely different set of labels in order to run inference on other tasks. Elmo embeddings are especially interesting. Dynamic Bernoulli embeddings also deserve a mention. https://arxiv.org/pdf/1703.08052.pdf

Paper and discussion history. A mention is not an endorsement.

Dynamic Bernoulli Embeddings for Language Evolution · HackerPapers discussions

Dynamic Bernoulli Embeddings for Language Evolution — mentioned by prions