YotpoLtd/metorikku

The Universe of Data. All about data, data science, and data engineering

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.

Apache Spark - A unified analytics engine for large-scale data processing

⛔ [ARCHIVING ON 2026-11-01] One framework to develop, deploy and operate data workflows with Python and SQL.

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Data Pipeline Framework using the singer.io spec

A lightweight data processing framework built on DuckDB and 3FS.