org.apache.hudi.hive

Class HiveSyncTool

java.lang.Object

org.apache.hudi.hive.HiveSyncTool

public class HiveSyncTool
extends Object

Tool to sync a hoodie HDFS dataset with a hive metastore table. Either use it as a api HiveSyncTool.syncHoodieTable(HiveSyncConfig) or as a command line java -cp hoodie-hive.jar HiveSyncTool [args]

This utility will get the schema from the latest commit and will sync hive table schema Also this will sync the partitions incrementally (all the partitions modified since the last commit)

Field Summary

Fields

Modifier and Type	Field and Description
static String	SUFFIX_REALTIME_TABLE

Constructor Summary

Constructors

Constructor and Description
HiveSyncTool(HiveSyncConfig cfg, org.apache.hadoop.hive.conf.HiveConf configuration, org.apache.hadoop.fs.FileSystem fs)

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
void	syncHoodieTable()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SUFFIX_REALTIME_TABLE

public static final String SUFFIX_REALTIME_TABLE

See Also:

Constant Field Values

Constructor Detail

HiveSyncTool

public HiveSyncTool(HiveSyncConfig cfg,
                    org.apache.hadoop.hive.conf.HiveConf configuration,
                    org.apache.hadoop.fs.FileSystem fs)

Method Detail

syncHoodieTable

public void syncHoodieTable()
                     throws ClassNotFoundException

Throws:

ClassNotFoundException

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception