joaodsmarques/LumberChunker

🍱 Semantically create chunks from large document for passing to LLM workflows

Adaptive Chunking: automatically select the best chunking method per document for RAG. Accepted at LREC 2026.

🚀 The Fastest Chunker in the West 🇺🇸 Upto 1TB/s "semantic" chunking, quick and easy!

One library to split them all: Sentence, Code, Docs. Chunk smarter, not harder; built for LLMs, RAG pipelines, and beyond.

A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.

A library for semantically coherent text chunking

Open-source toolkit for reliable RAG pipelines: convert PDFs to Markdown, clean documents, inspect chunks, compare chunking strategies, and enrich metadata for LLM applications.