delta-io/delta-sharing

Next-generation decentralized data lakehouse and a multi-party stream processing network

The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common framework, including data models and protocols, to enable direct transfer of data both into and out of participating online service providers.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Apache Iceberg

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

Perform data science on data that remains in someone else's server

Lightning fast data version control system for large repositories of data. Feels like git, pushes and pulls like oxen.

Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.