Check out the Delta Lake October Contribution Report including community issues, latest releases, community health, and more.
Description:
Delta Lake is an open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, Ruby, and Python.
Community issues:
We are currently working on the Delta Acceptance Testing (DAT) project to ensure that any protocol changes can be reflected across the different Delta APIs per Delta Lake Integrations. Join us at #DAT in the Delta Users Slack to collaborate!
We need to update the Delta Lake contribution guidelines to make it easier for developers to contribute to the project. We have started working building the scaffolding between delta-rs and delta-spark as part of DAT and will publish it for collaboration/review.
We need to update the Delta Lake documentation to make it easier for everyone to contribute; we have started this process in thedelta-docs Github repository.
Latest releases:
We released Delta Rust API python bindings v0.6.2 on October 11, 2022. Please see here. Credits for this release include QP Hou, Will Jones, Florian Valeye, and Robert Pack.
We released Delta Lake 2.1.1 on Apache Spark 3.3 on October 27, 2022. Similar to Apache Sparkā¢, we have released Maven artifacts for both Scala 2.12 and Scala 2.13. Please see here. Credits for this release include Adam Binford, Allison Portis, Chen Shuai, Felipe Pessoto, Lars Kroll, Scott Sandre, Shixiong Zhu, Venki Korukanti.
We released Delta Lake 2.0.1 on Apache Spark 3.2 on November 1, 2022. This release contains important bug fixes to 2.0.0 and it is recommended that users update to 2.0.1. Please see here. Credits for this release include Adam Binford, Allison Portis, Chen Shuai, Lars Kroll, Scott Sandre, Shixiong Zhu, Venki Korukanti
The community continues to have steady growth. Year to date, Delta Lake has 1,444 commits and 211 submitters. There has been a growth of 13.74% in the total commits during the last 3 months.
This email was sent by: Delta Lake
548 Market St, PMB 57274, San Francisco, CA 94104-5401, United States