Roadmap
Hudi community strives to deliver major releases every 3-4 months, while offering minor releases every other month! This page captures the forward-looking roadmap of ongoing & upcoming projects and when they are expected to land, broken down by areas on our stack.
Recent Release
0.15.0 (June 2024)
Future Releases
| Release | Timeline |
|---|---|
| 1.0.0-beta2 | July 2024 |
| 0.16.0 (Bridge release supporting reads of both 1.x and 0.x Hudi versions) | Q3, 2024 |
| 1.0.0 | Q3, 2024 |
Transactional Database Layer
| Feature | Target Release | Tracking |
|---|---|---|
| 1.x Storage format | 1.0.0 | HUDI-6242 |
| Writer performance improvements | 1.0.0 | HUDI-3249 |
| Non-blocking concurrency control | 1.0.0 | HUDI-3187, HUDI-1042, RFC-66 |
| General purpose support for multi-table transactions | 1.0.0 | |
| Secondary indexes to improve query performance | 1.0.0 | RFC-52, HUDI-3907 |
| Index Function for Optimizing Query Performance | 1.0.0 | RFC-63, HUDI-512 |
| Logical partitioning via indexing | 1.0.0 | HUDI-512 |
| Track schema in metadata table | 1.0.0 | HUDI-6778 |
| Storage partition stats index | 1.0.0 | HUDI-7144 |
| Support update during clustering | 1.0.0 | HUDI-1045 |
| Time Travel updates, deletes | 1.1.0 | |
| A more effective HoodieMergeHandler for COW table with parquet | 1.1.0 | RFC-68 |
| Streaming CDC/Incremental read improvement | 1.1.0 | HUDI-2749 |
| Supervised table service planning and execution | 1.1.0 | RFC-43, HUDI-4147 |
| Enable partial updates for CDC work payload | 1.1.0 | HUDI-7229 |
Programming APIs
| Feature | Target Release | Tracking |
|---|---|---|
| APIs/Abstractions, Record mergers | 1.0.0 | HUDI-6243, HUDI-3217 |
| New Hudi Table Format APIs for Query Integrations | 1.0.0 | RFC-64, HUDI-4141 |
| Snapshot view management | 1.1.0 | RFC-61, HUDI-4677 |
| Optimized storage layout for cloud object stores | 1.1.0 | RFC-60, HUDI-3625 |
| Support of verification with multiple event_time fields | 1.1.0 | RFC-59, HUDI-4569 |
Execution Engine Integration
| Feature | Target Release | Tracking |
|---|---|---|
| Presto/Trino queries with new format | 1.0.0 | HUDI-3210, HUDI-4394, HUDI-4552 |
| Table Valued Function to query Hudi timeline | 1.0.0 | HUDI-7243 |
| Default Java 17 support | 1.0.0 | HUDI-6506 |
| Spark 4 Support | 1.0.0 | HUDI-7915 |
| Materialized Views with incremental updates using Flink | 1.1.0 | |
| Spark datasource V2 read | 1.1.0 | HUDI-4449 |
| Replace Dataframe write path for Spark | 1.1.0 | HUDI-4857 |
Platform Services
| Feature | Target Release | Tracking |
|---|---|---|
| Hudi Reverse streamer | 1.1.0 | RFC-70 |
| Diagnostic Reporter | 1.1.0 | RFC-62 |
| Hudi integration with Snowflake | 1.1.0 | RFC-41, HUDI-2832 |
| Support for reliable, event based ingestion from cloud stores - GCS, Azure and the others | 1.1.0 | HUDI-1896 |
| Mutable, Transactional caching for Hudi Tables (could be accelerated based on community feedback) | 1.1.0 | Strawman design, HUDI-6489 |