Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Websitebench
Websitebench
Bifrost
Bifrost
Busbar
Busbar
Omnigraph
Omnigraph

OpenDCAI/DataFlow

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

Visit GitHub
Python
8.6k
1.2k
50 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Websitebench

Can AI agents reverse-engineer real websites?

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Momentum

How fast OpenDCAI/DataFlow is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 16 – Nov 15, 2026

Stars +450 in 61 days

0102030
24

Forks +81 in 61 days

0246
6

Merged PRs 30 in 61 days

051015
11

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 16Sep 24Oct 2Oct 10Oct 18Oct 26Nov 3Nov 11
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Wed, Sep 16, 2026+1+30
Thu, Sep 17, 2026+1+50
Fri, Sep 18, 2026+2+40
Sat, Sep 19, 2026+3+20
Sun, Sep 20, 2026+2+60
Mon, Sep 21, 2026+4+50
Tue, Sep 22, 2026+1+40
Wed, Sep 23, 2026+5+60
Thu, Sep 24, 2026+9+50
Fri, Sep 25, 2026+0+40
Sat, Sep 26, 2026+1+60
Sun, Sep 27, 2026+1+40
Mon, Sep 28, 2026+1+31
Tue, Sep 29, 2026+2+20
Wed, Sep 30, 2026+3+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+2+00
Sat, Oct 3, 2026+2+10
Sun, Oct 4, 2026+1+00
Mon, Oct 5, 2026+2+00
Tue, Oct 6, 2026+1+00
Wed, Oct 7, 2026+3+00
Thu, Oct 8, 2026+2+10
Fri, Oct 9, 2026+4+10
Sat, Oct 10, 2026+4+00
Sun, Oct 11, 2026+0+21
Mon, Oct 12, 2026+1+03
Tue, Oct 13, 2026+0+12
Wed, Oct 14, 2026+9+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+3+00
Sat, Oct 17, 2026+9+10
Sun, Oct 18, 2026+4+10
Mon, Oct 19, 2026+14+26
Tue, Oct 20, 2026+11+10
Wed, Oct 21, 2026+6+10
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+6+20
Sat, Oct 24, 2026+8+10
Sun, Oct 25, 2026+12+10
Mon, Oct 26, 2026+20+00
Tue, Oct 27, 2026+15+00
Wed, Oct 28, 2026+13+02
Thu, Oct 29, 2026+24+10
Fri, Oct 30, 2026+24+11
Sat, Oct 31, 2026+13+02
Sun, Nov 1, 2026+12+111
Mon, Nov 2, 2026+22+00
Tue, Nov 3, 2026+12+10
Wed, Nov 4, 2026+9+00
Thu, Nov 5, 2026+21+00
Fri, Nov 6, 2026+15+00
Sat, Nov 7, 2026+10+00
Sun, Nov 8, 2026+12+00
Mon, Nov 9, 2026+16+10
Tue, Nov 10, 2026+14+00
Wed, Nov 11, 2026+17+00
Thu, Nov 12, 2026+13+10
Fri, Nov 13, 2026+13+01
Sat, Nov 14, 2026+11+00
Sun, Nov 15, 2026+4+00
Total+450+8130
  • 1#1 on the list
  • 7Rank that day
  • Not trending
6

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Python

    Dec 25, 2025 – Jul 27, 2026Best #6

    #1#5#10#15#20#25
    Top 10
    Jan 2026FebMarAprMayJunJul
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about OpenDCAI/DataFlow, and every badge it has earned
    1. Nov 41 post

      • Community contributions make open source better ✨ Pyromind Dynamics builds AutoRL products for continuously improving agents and is a DataFlow community user. Drawing on real projects, the team…

        Read full on X, posted by @PKU_DCAI

        @PKU_DCAI · x.com

    2. 1 month earlier
    3. Sep 301 post

      • From PDF Archives to a Trainable Model: A Practical Open-Source Workflow

        Read full on Reddit

        r/OpenSourceeAI

    4. 12 days earlier
    5. Sep 181 post

      • OSS: Data Preparation Before Pre-training

        Read full on Reddit

        r/LLMDevs

    6. 18 days earlier
    7. Aug 311 post

      • Validated open-source data pipelines for RAG and agent applications

        Read full on Reddit

        r/AI_Application

    8. 1 month earlier
    9. Jul 311 post2 posts

      • Open-source AI infrastructure matters because the ecosystem can keep improving

        Read full on Reddit

        r/LovingOpenSourceAI

      • Designing Text-to-SQL as a Data Pipeline, Not a Single Prompt

        Read full on Reddit

        r/ETL

    10. Jul 301 post

      • Designing Text-to-SQL as a Data Pipeline, Not a Single Prompt

        Read full on Reddit

        r/LLMDevs

    11. Jul 242 posts

      • 🇨🇳Peking University DCAI team open-sources DataFlow-Harness A grounded code-agent platform for constructing editable LLM data pipelines — ranked #2 on Hugging Face Daily Papers. Against vanilla…

        Read full on X, posted by @Chinazhidx

        @Chinazhidx · x.com

      • On a 12-task data engineering benchmark, DataFlow-Harness achieved a 93.3% observed end-to-end pass rate. Compared with Vanilla Claude Code, it reduced measured cost by 72.5% and generation latency…

        Read full on X, posted by @PKU_DCAI

        @PKU_DCAI · x.com

    12. 9 days earlier
    13. Jul 151 post

      • Better data is what makes AI agents actually useful

        Read full on Reddit

        r/Agentic_Marketing

    You might also like

    Repositories close to OpenDCAI/DataFlow
    FeaturedAdvertise to 180K+ monthly visitors
    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    Busbar

    Control what AI can do before it acts

    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    Websitebench

    Can AI agents reverse-engineer real websites?

    OpenDCAI/Data-Preparation-Bench

    Python

    A unified, downstream-grounded benchmark for LLM-driven training data construction, selection, and quality evaluation.

    24127

    NVIDIA-NeMo/Curator

    Python

    Scalable data pre processing and curation toolkit for LLMs

    1.9k378

    ConardLi/easy-dataset

    JavaScript

    A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

    15.1k1.7k

    datajuicer/data-juicer

    Python

    Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

    7.2k469

    data-prep-kit/data-prep-kit

    HTML

    Open source project for data preparation for GenAI applications

    969258

    datadreamer-dev/DataDreamer

    Python

    DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

    1.1k59

    argilla-io/distilabel

    Python

    Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

    3.5k266

    jackjusko/sftmill

    Python

    An easy to use off-policy synthetic data distillation engine for LLMs.

    22

    Red-Hat-AI-Innovation-Team/sdg_hub

    Python

    Synthetic Data Generation Toolkit for LLMs

    17165