datajuicer/data-juicer

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

LlamaIndex is the document processing platform for AI

Refine high-quality datasets and visual AI models

ModelScope: bring the notion of Model-as-a-Service to life.

Go ahead and axolotl questions

Label Studio is a multi-type data labeling and annotation tool with standardized output format