Issues in evaluating semantic spaces using word analogies — mentioned by stared

Sat, 07 Jan 2017 22:47:41 GMT

I address this point. For scalar product, well, these word vectors are defined such that their scalar product approximate the pointwise mutual information between a pair of words (or sometimes other quantity, depending on the actual algorithm). For differences - see this section: http://p.migdal.pl/2017/01/06/king-man-woman-queen-why.html#.... I mention also that multiplying a word by a factor (for PMI compression) results in a word of similar meaning, just being more characteristic (bear in mind that for other models in can be related e.g. to word frequency or other properties). But you are…

Paper and discussion history. A mention is not an endorsement.

Issues in evaluating semantic spaces using word analogies — mentioned by stared

Sat, 07 Jan 2017 22:33:15 GMT

I learned about them just a few days before publishing this post (and I link to the second one, in the "technicalities" section). Though, some statements about analogies should be taken with a grain of salt, see: Tal Linzen, Issues in evaluating semantic spaces using word analogies, https://arxiv.org/abs/1606.07736.

Paper and discussion history. A mention is not an endorsement.

Issues in evaluating semantic spaces using word analogies · HackerPapers discussions

Issues in evaluating semantic spaces using word analogies — mentioned by stared

Issues in evaluating semantic spaces using word analogies — mentioned by stared