com.facebook.presto.hive.util

Class HudiRealtimeSplitConverter

java.lang.Object

com.facebook.presto.hive.util.HudiRealtimeSplitConverter

All Implemented Interfaces:

CustomSplitConverter

public class HudiRealtimeSplitConverter
extends Object
implements CustomSplitConverter

HoodieRealtimeFileSplit specific implementation of CustomSplitConverter. Extracts customSplitInfo from HoodieRealtimeFileSplit and reconstructs HoodieRealtimeFileSplit from Map.

Field Summary

Fields

Modifier and Type	Field and Description
static String	HUDI_BASEPATH_KEY
static String	HUDI_DELTA_FILEPATHS_KEY
static String	HUDI_MAX_COMMIT_TIME_KEY

Constructor Summary

Constructors

Constructor and Description
HudiRealtimeSplitConverter()

Method Summary

Modifier and Type	Method and Description
Optional<Map<String,String>>	extractCustomSplitInfo(org.apache.hadoop.mapred.FileSplit split) This method is expected to return optional.empty() if the FileSplit does not match the split converter.
Optional<org.apache.hadoop.mapred.FileSplit>	recreateFileSplitWithCustomInfo(org.apache.hadoop.mapred.FileSplit split, Map<String,String> customSplitInfo) This method is expected to merge the customSplitInfo with split to recreate the custom FileSplit.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HUDI_DELTA_FILEPATHS_KEY

public static final String HUDI_DELTA_FILEPATHS_KEY

See Also:

Constant Field Values

HUDI_BASEPATH_KEY

public static final String HUDI_BASEPATH_KEY

See Also:

Constant Field Values

HUDI_MAX_COMMIT_TIME_KEY

public static final String HUDI_MAX_COMMIT_TIME_KEY

See Also:

Constant Field Values

Constructor Detail

HudiRealtimeSplitConverter

public HudiRealtimeSplitConverter()

Method Detail

extractCustomSplitInfo

public Optional<Map<String,String>> extractCustomSplitInfo(org.apache.hadoop.mapred.FileSplit split)

Description copied from interface: CustomSplitConverter

This method is expected to return optional.empty() if the FileSplit does not match the split converter.

Specified by:

extractCustomSplitInfo in interface CustomSplitConverter

recreateFileSplitWithCustomInfo

public Optional<org.apache.hadoop.mapred.FileSplit> recreateFileSplitWithCustomInfo(org.apache.hadoop.mapred.FileSplit split,
                                                                                    Map<String,String> customSplitInfo)
                                                                             throws IOException

Description copied from interface: CustomSplitConverter

This method is expected to merge the customSplitInfo with split to recreate the custom FileSplit. It is expected to return optional.empty() if the customSplitInfo does not match the split converter.

Specified by:

recreateFileSplitWithCustomInfo in interface CustomSplitConverter

Throws:

IOException