HyperMinHash: MinHash in LogLog space — mentioned by seiflotfy

Wed, 14 Nov 2018 17:42:55 GMT

Author of the Library here: I can't fully agree that HyperLogLogs are good for intersections, that does not mean it can't be done, just there is always a high error rate. The easy way to do that is to maintain a separate MinHash sketch per HLL and use the Jaccard Index of several of those HLLs... an even more naive just use the Jaccard Index with the HLL registers but good luck getting good results out of that. This library is based on https://arxiv.org/pdf/1710.08436v4.pdf which has the benchmarks... Also I will be taking a stab at http://www.vldb.org/pvldb/vol11/p1097-nazi.pdf very soon :)

Paper and discussion history. A mention is not an endorsement.

HyperMinHash: MinHash in LogLog space — mentioned by yunwilliamyu

Tue, 09 Jan 2018 14:06:59 GMT

Thanks so much for producing a Golang implementation of our HyperMinHash paper (I'm the first author) [0] and pointing me to your Hackernews post! As an aside, we also have a prototype Python implementation [1], but your implementation looks more efficient than ours, and I may start pointing people to your Github repo too. [0]: https://arxiv.org/abs/1710.08436 [1]: https://github.com/yunwilliamyu/hyperminhash

Paper and discussion history. A mention is not an endorsement.

HyperMinHash: MinHash in LogLog space · HackerPapers discussions

HyperMinHash: MinHash in LogLog space — mentioned by seiflotfy

HyperMinHash: MinHash in LogLog space — mentioned by yunwilliamyu