org.apache.hudi.utilities

Class HiveIncrementalPuller

java.lang.Object

org.apache.hudi.utilities.HiveIncrementalPuller

public class HiveIncrementalPuller
extends Object

Utility to pull data after a given commit, based on the supplied HiveQL and save the delta as another hive temporary table.

Current Limitations:

- Only the source table can be incrementally pulled (usually the largest table) - The incrementally pulled table can't be referenced more than once.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HiveIncrementalPuller.Config

Field Summary

Fields

Modifier and Type	Field and Description
protected HiveIncrementalPuller.Config	config

Constructor Summary

Constructors

Constructor and Description
HiveIncrementalPuller(HiveIncrementalPuller.Config config)

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
void	saveDelta()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

config

protected final HiveIncrementalPuller.Config config

Constructor Detail

HiveIncrementalPuller

public HiveIncrementalPuller(HiveIncrementalPuller.Config config)
                      throws IOException

Throws:

IOException

Method Detail

saveDelta

public void saveDelta()
               throws IOException

Throws:

IOException

main

public static void main(String[] args)
                 throws IOException

Throws:

IOException