LumberChunker: Long-Form Narrative Document Segmentation — HN submission

Mon, 09 Jun 2025 16:09:03 GMT

Launch HN: Chonkie (YC X25) – Open-Source Library for Advanced Chunking

Hey HN! We're Shreyash and Bhavnick. We're building Chonkie (https://chonkie.ai), an open-source library for chunking and embedding data. Python: https://github.com/chonkie-inc/chonkie TypeScript: https://github.com/chonkie-inc/chonkie-ts Here's a video showing our code chunker: https://youtu.be/Xclkh6bU1P0. Bhavnick and I have been building personal projects with LLMs for a few years. For much of this time, we found ourselves writing our own chunking logic to support RAG applications. We often hesitated to use existing libraries because they either had only basic features or felt too bloated…

151 points; 42 discussion replies on HN. Paper and source history. A submission is not an endorsement.

LumberChunker: Long-Form Narrative Document Segmentation · HackerPapers discussions

LumberChunker: Long-Form Narrative Document Segmentation — HN submission