arXiv:1611.03305cs.IR
Getting Started with Neural Models for Semantic Matching in Web Search
Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.
Abstract
The vocabulary mismatch problem is a long-standing problem in information retrieval. Semantic matching holds the promise of solving the problem. Recent advances in language technology have given rise to unsupervised neural models for learning representations of words as well as bigger textual units. Such representations enable powerful semantic matching methods. This survey is meant as an introduction to the use of neural models for semantic matching. To remain focused we limit ourselves to web search. We detail the required background and terminology, a taxonomy grouping the rapidly growing body of work in the area, and then survey work on neural models for semantic matching in the context of three tasks: query suggestion, ad retrieval, and document retrieval. We include a section on resources and best practices that we believe will help readers who are new to the area. We conclude with an assessment of the state-of-the-art and suggestions for future work.
Things like topic recognition, entity and reference linking/disambiguation, synonym/paraphase are well researched tasks with purpose-made datasets for competitions like TREC. The most common approaches will be to choose a word embedding (one of the word2vec or Glove are good…
gtaniView on HNParent context