Skip to main content
bg-image

Apache HudiTM brings

to data lakes
Get StartedRead Docs
hudi-logo

What is Hudi 

Apache Hudi is an open data lakehouse platform, built on a high-performance open table format to bring database functionality to your data lakes. Hudi reimagines slow old-school batch data processing with a powerful new incremental processing framework for low latency minute-level analytics.
Hudi Data LakeHudi Data Lake

Integrations 

Data Stream
Apache Kafka
Apache Kafka
Rocket MQ
Rocket MQ
Pulsar
Pulsar
Databases
Postgress
Postgress
Cassandra
Cassandra
MongoDB
MongoDB
MySQL
MySQL
Cloud Storage
Parquet
Parquet
Hudi
Hudi
Arvo
Arvo
JSON files
JSON files
CSV files
CSV files
Oracle Cloud
Oracle Cloud
Lakehouse Platform
Hadoop
Hadoop
S3
S3
Google Cloud Storage
Google Cloud Storage
Azure Data Lake
Azure Data Lake
Alibaba Cloud
Alibaba Cloud
Minio
Minio
Alluxio
Alluxio
Native Uploads
Native Uploads
Metastore
Glue
Glue
Hive
Hive
DataHub
DataHub
BI Analytics
Redshift
Redshift
BigQuery
BigQuery
Apache Doris
Apache Doris
Interactive Analytics
Trino
Trino
Athena
Athena
Presto
Presto
Batch Analyitics
Hive
Hive
Apache Spark
Apache Spark
Apache Impala
Apache Impala
Stream Analytics
Apache Spark
Apache Spark
StarRocks
StarRocks
Flink
Flink
Orchestration
dbt
dbt
Apache Airflow
Apache Airflow

Hudi Features 

Mutability support for all workload shapes & sizes

Quickly update & delete data with fast, pluggable indexing. This includes database CDC and high-scale streaming data, with best-in-class support for out-of-order records, bursty traffic & data deduplication.

Unlock 10x efficiency by incrementally processing new data

Replace old-school batch pipelines with incremental streaming on your data lake. Experience faster ingestion and lower processing times for your data pipelines.

ACID Transactional guarantees for your data lake

Atomic writes, with relational/streaming data consistency models, snapshot isolation and non-blocking concurrency controls tailored for longer-running lake transactions.

Analyze historical data with time travel

Query historical data with the ability to roll back to a table version; debug data versions to understand what changed over time; audit data changes by viewing the commit history.

Interoperable multi-cloud ecosystem support

Built on open data formats with extensive ecosystem support across cloud vendor ecosystem, with plug-and-play options for popular data sources & query engines.

Automatic table services for a high-performance lakehouse

Fully automated table services that continuously schedule & orchestrate clustering, compaction, cleaning, file sizing & indexing to ensure tables are always optimized.

Open Data Lakehouse platform to get you going faster

Effortlessly build your lakehouse with built-in tools for auto ingestion from services like Debezium and Kafka and auto catalog sync to major cloud engines & more.

Query acceleration through multi-modal indexes.

Experience faster write transactions on huge/wide tables & faster query performance with first-of-its kind multi-modal indexing subsystem.

Resilient Pipelines with schema evolution & enforcement

Easily change the current schema of a Hudi table to adapt to the data that is changing over time and ensure pipeline resilience by failing fast and avoiding data corruption.

Why Hudi 

The most innovative and completely open data lakehouse platform in the industry!

Trusted Platform

Battle tested and proven in production in some of the largest data lakes on the planet.

Open Source

Hudi is a thriving & growing community that is built with contributions from people around the globe.

High Performance

Hudi's storage format is purpose-built to continuously deliver performance as data scales.

Data streams

Take advantage of built-in CDC sources and tools for streaming ingestion.

Hudi Blogs 

View All

Join our Community 

Get technical help, influence the product roadmap & see what’s new with Hudi!

Youtube

Linkedin

GitHub

Slack

Mailing

X