ekimetrics/adaptive-chunking

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

The open-source RAG platform: built-in citations, deep research, 22+ file formats, partitions, MCP server, and more.

🔥 Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation 🔥. Our toolkit integrates 40 pre-retrieved benchmark datasets and supports 7+ retrieval techniques, 24+ state-of-the-art Reranking models, and multiple RAG methods.

RAG evaluation without the need for "golden answers"

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

Blockify: Agentic data optimization for enterprise RAG and agentic search. Blockify replaces naive chunking with deduplicated IdeaBlocks — ≈78X accuracy aggregate improvement, 2.29X vector search accuracy, 40X compression, 3.09X token efficiency. Integrates with LlamaIndex, LangChain, Obsidian, Milvus, Elastic, Supabase, Cloudflare.

🦛 CHONK your texts with Chonkie ✨ Type-friendly, light-weight, fast and super-simple chunking library

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG