Delta Lake Community Meetup - April 21st, 2026

[newfront]

YouTube: Community Meetup Recording

Delta Lake Community Meetup

Tuesday, April 21 from 9:00-10:00 AM PST

---

Luma Event Registration

Join us for this first Delta Lake Community Meetup of 2026! 🚀

​We’re bringing the community together for a deep dive into the ecosystem, infrastructure enhancements, and the future project roadmap. Come get your technical questions answered live by the maintainers.

​What we'll cover: ​

​🔹 Latest Delta Lake updates and how the community is evolving

​🔹 A technical look at infrastructure enhancements ​

​🔹 The future of Delta Lake: Roadmap insights and a deep dive into Iceberg v4 compatible metadata ​

​🔹 Live Q&A with the community

---

We'll be posting the meeting notes and Q&A here. Feel free to also add to the discussion.

[newfront]

Delta Lake Community Meetup (April 21, 2026), outlining updates and addressing community questions.

Key Discussion Points:

Community Meetups

The meetup marks the first of 2026, with plans for regular monthly sessions going forward.

Governance & Infrastructure

Discussion included the response to a recent supply chain attack (Light LLM and Axios), which led to better coordination and security processes for the Delta Lake project.

Delta Rust/Python Release

A tentative release for new point versions is planned, with major API changes in the Rust crate due to dependency upgrades (Arrow 58, Object Store 13). The new Buoyant kernel dependency (a distribution of Delta kernel RS) was introduced to facilitate faster release cycles for Delta RS fixes.

Delta and Iceberg V4

Unification: Anoop presented a proposal to incorporate the Iceberg V4 Adaptive Merkle Tree structure for managing Delta's content metadata. The goal is to:
◦ Improve interoperability by eliminating the need for continuous metadata translation (as used in Uniform).
◦ Reduce write amplification by enabling incremental, rather than full, checkpoint creation.
◦ Enhance read performance through more frequent checkpoints and leveraging aggregate statistics for query pruning.
An RFC on this proposal will be shared soon.

Community Q&A

Topics included:
◦ The lack of standardization in commit metrics between Delta Spark and Delta RS. This should be better articulated and documented in the Delta protocol or engine spec.
◦ The need for the community to help prioritize long-standing bug fixes in Delta Spark.
◦ The status of write support for column mapping in Delta RS (a complex, but year-long goal).
◦ The shift to a Data Source V2 (DSv2) based connector using the Delta kernel for Spark, although the older DSv1 connector is still the most battle-tested.

[newfront]

Here is the protocol RFC Anoop talked about during the meeting today. It proposes implementing the Apache Iceberg v4 manifest tree as Delta's native content metadata format. Please read it over.

#6640