arXiv:1702.02540cs.CL
Automatic Rule Extraction from Long Short Term Memory Networks
Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.
Abstract
Although deep learning models have proven effective at solving problems in natural language processing, the mechanism by which they come to their conclusions is often unclear. As a result, these models are generally treated as black boxes, yielding no insight of the underlying learned patterns. In this paper we consider Long Short Term Memory networks (LSTMs) and demonstrate a new approach for tracking the importance of a given input to the LSTM for a given output. By identifying consistently important patterns of words, we are able to distill state of the art LSTMs on sentiment analysis and question answering into a set of representative phrases. This representation is then quantitatively validated by using the extracted phrases to construct a simple, rule-based classifier which approximates the output of the LSTM.
https://arxiv.org/abs/1711.09784 https://arxiv.org/abs/1708.01785 https://arxiv.org/abs/1710.00935 https://arxiv.org/abs/1702.04595 https://arxiv.org/abs/1801.01693 https://arxiv.org/abs/1503.02531 https://arxiv.org/abs/1712.03781 https://arxiv.org/abs/1710.07535…
sovok_xView on HNParent context