HackerPapers

arXiv:2001.06561cs.DS

Circllhist -- A Log-Linear Histogram Data Structure for IT Infrastructure Monitoring

Heinrich Hartmann, Theo Schlossnagle

Abstract

The circllhist histogram is a fast and memory efficient data structure for summarizing large numbers of latency measurements. It is particularly suited for applications in IT infrastructure monitoring, and provides nano-second data insertion, full mergeability, accurate approximation of quantiles with a-priori bounds on the relative error. Open-source implementations are available for C/lua/python/Go/Java/JavaScript.

arXiv comments
16 pages, 7 figures
Journal reference
DOI
Subjects
cs.DSData Structures and Algorithms

On Hacker News

Linked by 2 identifiable commenters in 3 comments across 3 threads, from Mar 2020 to Jul 2022. Found in 1 HN submission from Jan 2020 to Jan 2020. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments3 threads

    • In the same spirit there is also Circllhist from Circonus. https://arxiv.org/abs/2001.06561 There was a good discussion on approaches to store histogram here: https://news.ycombinator.com/item?id=31379383

      arunk-sView on HNParent context

    • Circonus Histograms solve that by using a universal bucketing scheme. Details are explained in this paper: https://arxiv.org/abs/2001.06561 Disclaimer: I am a co-author.

      heinrichhartmanView on HNParent context

    • Shameless plug. Just wrote a paper about this: https://arxiv.org/abs/2001.06561 Containing a survey of the most popular Latency Aggregation methods used in the industry (Prometheus Histograms, t-digest, HDR-Histogram, DD-sketch/histogram).

      heinrichhartmanView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.