HackerPapers

arXiv:2101.01719cs.DS

Split block Bloom filters

Jim Apple

Abstract

This short note describes a Bloom filter variant that takes advantage of modern SIMD instructions to increase speed by 30%-450%. This filter, the split block Bloom filter, is used by StarRocks, Apache Impala, Apache Kudu, Apache Parquet, Apache Arrow, Apache Drill, and Alibaba Cloud's Hologres.

arXiv comments
3 pages, 1 figure
Journal reference
DOI
Subjects
cs.DSData Structures and Algorithms

On Hacker News

Linked by 2 identifiable commenters in 2 comments across 2 threads, from May 2022 to Feb 2026.

Comments linking this paper, per year.

Discussed in comments2 threads

  1. Two Bits Are Better Than One: making bloom filters 2x more accurate 1 comment
  2. Use fast data algorithms (2021) 1 comment

    • This is a great list—to add two categories: If you need bloom filters, then use split block bloom filters [1] which use SIMD to increase speed from 30%-450%. If you need erasure coding, then use Cauchy Reed-Solomon instead of Reed-Solomon. Cauchy Reed-Solomon uses pure XOR so…

      _vvhwView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.