AWS Glue Data Catalog

Hudi tables can sync to AWS Glue Data Catalog directly via AWS SDK. Piggyback on HiveSyncTool , org.apache.hudi.aws.sync.AwsGlueCatalogSyncTool makes use of all the configurations that are taken by HiveSyncTool and send them to AWS Glue.

Configurations

There is no additional configuration for using AwsGlueCatalogSyncTool; you just need to set it as one of the sync tool classes for HoodieDeltaStreamer and everything configured as shown in Sync to Hive Metastore will be passed along.

--sync-tool-classes org.apache.hudi.aws.sync.AwsGlueCatalogSyncTool