HackerPapers

arXiv:1408.5882cs.CL

Convolutional Neural Networks for Sentence Classification

Yoon Kim

Abstract

We report on a series of experiments with convolutional neural networks (CNN) trained on top of pre-trained word vectors for sentence-level classification tasks. We show that a simple CNN with little hyperparameter tuning and static vectors achieves excellent results on multiple benchmarks. Learning task-specific vectors through fine-tuning offers further gains in performance. We additionally propose a simple modification to the architecture to allow for the use of both task-specific and static vectors. The CNN models discussed herein improve upon the state of the art on 4 out of 7 tasks, which include sentiment analysis and question classification.

arXiv comments
To appear in EMNLP 2014
Journal reference
DOI
Subjects
cs.CLComputation and Language cs.NENeural and Evolutionary Computing

On Hacker News

Linked by 4 identifiable commenters in 4 comments across 3 threads, from Oct 2015 to Mar 2018.

Comments linking this paper, per year.

Discussed in comments3 threads

  1. Understanding word vectors 2 comments

    • A few remarks: In the "Doing bad digital humanities with color vectors", if you consider colors as 3D vectors, which they do, you'll see that summing enough uniformly sampled vectors always gives medium browns, because that's the color in the middle of the colorspace. Instead…

      ovi256View on HNParent context

    • Thanks for this, I'll have to take a look at FastText. I've been using word2vec before turning it into a matrix and running it through a CNN. I based it off of Yoon Kim's[0] work. I haven't had much luck though on my 92-class problem. Maybe Fast Text will work better, although I…

      bomb199View on HNParent context

  2. Ask HN: Anyone using NLP to tag sentences? 1 comment

    • Yes I have. Convolutional Nets work well for simpler cases. See [Yoon Kim 2014](https://arxiv.org/abs/1408.5882). FYI "Tagging" in NLP is more used for labelling individual words (verbs, nouns, pronouns, etc). "Classification" is a better keyword here.

      drraid0View on HNParent context

  3. Deep learning for NLP resources 1 comment

    • Surprising there is no mention of any CNN based methods for NLP. A different approach that seems to provide results on par with the state of the art in some NLP tasks [1]. [1] http://arxiv.org/abs/1408.5882

      bernatfpView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.