HackerPapers

arXiv:2311.10533cs.PL

Parsing Millions of URLs per Second

Yagiz Nizipli, Daniel Lemire

Abstract

URLs are fundamental elements of web applications. By applying vector algorithms, we built a fast standard-compliant C++ implementation. Our parser uses three times fewer instructions than competing parsers following the WHATWG standard (e.g., Servo's rust-url) and up to eight times fewer instructions than the popular curl parser. The Node.js environment adopted our C++ library. In our tests on realistic data, a recent Node.js version (20.0) with our parser is four to five times faster than the last version with the legacy URL parser.

arXiv comments
Journal reference
Software: Practice and Experience 54 (5), 2024
DOI
doi:10.1002/spe.3296
Subjects
cs.PLProgramming Languages cs.DSData Structures and Algorithms

On Hacker News

Linked by 2 identifiable commenters in 2 comments across 2 threads, from Mar 2024 to Dec 2024.

Comments linking this paper, per year.

Discussed in comments2 threads

  1. Parsing URLs in Python 1 comment
    • Not in the sense of differential vulnerabilities, since the standard library refuses to match any sort of modern standard. It's also 1. not a solo dev 2. Daniel Lemire 3. a serious engineering and research effort: https://arxiv.org/pdf/2311.10533.pdf

      masklinnView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.