Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost
Busbar
Busbar

hoangsonww/End-to-End-Data-Pipeline

📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transformation, storage, monitoring, and AI/ML serving with CI/CD automation using Terraform & GitHub Actions.

Visit GitHub
Python
143
62
2 contributors
MIT License
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast hoangsonww/End-to-End-Data-Pipeline is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 27 – Oct 21, 2026

Stars +7 in 56 days

012
2

Forks +0 in 56 days

01

Merged PRs 0 in 56 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 27Sep 3Sep 10Sep 17Sep 24Oct 1Oct 8Oct 15
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Thu, Aug 27, 2026+2+00
Fri, Aug 28, 2026+0+00
Sat, Aug 29, 2026+0+00
Sun, Aug 30, 2026+0+00
Mon, Aug 31, 2026+0+00
Tue, Sep 1, 2026+0+00
Wed, Sep 2, 2026+0+00
Thu, Sep 3, 2026+1+00
Fri, Sep 4, 2026+0+00
Sat, Sep 5, 2026+0+00
Sun, Sep 6, 2026+0+00
Mon, Sep 7, 2026+0+00
Tue, Sep 8, 2026+0+00
Wed, Sep 9, 2026+0+00
Thu, Sep 10, 2026+0+00
Fri, Sep 11, 2026+0+00
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+0+00
Tue, Sep 15, 2026+0+00
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+1+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+1+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+2+00
Total+7+00
  • 1#1 on the list
  • 7Rank that day
  • Not trending

You might also like

Repositories close to hoangsonww/End-to-End-Data-Pipeline
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

tensorflow/tfx

Python

TFX is an end-to-end platform for deploying production ML pipelines

2.2k716

datavane/tis

Java

Support agile Ontology DataOps Based on Flink, DataX and Flink-CDC with Web-UI

1.4k306

linkedin/Hoptimator

Java

Multi-hop declarative data pipelines

12816

ertis-research/kafka-ml

Python

Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow and PyTorch!)

20634

microsoft/data-accelerator

C#

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

31293

ploomber/ploomber

Python

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

3.6k243

airbytehq/airbyte-platform

Kotlin

The platform that powers Airbyte. Please file issues in https://github.com/airbytehq/airbyte

313379

smart-data-lake/smart-data-lake

Scala

Smart Automation Tool for building modern Data Lakes and Data Pipelines

13028

dagster-io/dagster

Python

An orchestration platform for the development, production, and observation of data assets.

16.3k2.4k