com.facebook.presto.hive.util

Class HudiRealtimeBootstrapBaseFileSplitConverter

java.lang.Object

com.facebook.presto.hive.util.HudiRealtimeBootstrapBaseFileSplitConverter

All Implemented Interfaces:

CustomSplitConverter

public class HudiRealtimeBootstrapBaseFileSplitConverter
extends Object
implements CustomSplitConverter

Field Summary

Fields

Modifier and Type	Field and Description
static String	BASE_PATH_KEY
static String	BOOTSTRAP_FILE_SPLIT_LEN
static String	BOOTSTRAP_FILE_SPLIT_PATH
static String	BOOTSTRAP_FILE_SPLIT_START
static String	DELTA_FILE_PATHS_KEY
static String	MAX_COMMIT_TIME_KEY

Constructor Summary

Constructors

Constructor and Description
HudiRealtimeBootstrapBaseFileSplitConverter()

Method Summary

Modifier and Type	Method and Description
Optional<Map<String,String>>	extractCustomSplitInfo(org.apache.hadoop.mapred.FileSplit split) This method is expected to return optional.empty() if the FileSplit does not match the split converter.
Optional<org.apache.hadoop.mapred.FileSplit>	recreateFileSplitWithCustomInfo(org.apache.hadoop.mapred.FileSplit split, Map<String,String> customSplitInfo) This method is expected to merge the customSplitInfo with split to recreate the custom FileSplit.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DELTA_FILE_PATHS_KEY

public static final String DELTA_FILE_PATHS_KEY

See Also:

Constant Field Values

BASE_PATH_KEY

public static final String BASE_PATH_KEY

See Also:

Constant Field Values

MAX_COMMIT_TIME_KEY

public static final String MAX_COMMIT_TIME_KEY

See Also:

Constant Field Values

BOOTSTRAP_FILE_SPLIT_PATH

public static final String BOOTSTRAP_FILE_SPLIT_PATH

See Also:

Constant Field Values

BOOTSTRAP_FILE_SPLIT_START

public static final String BOOTSTRAP_FILE_SPLIT_START

See Also:

Constant Field Values

BOOTSTRAP_FILE_SPLIT_LEN

public static final String BOOTSTRAP_FILE_SPLIT_LEN

See Also:

Constant Field Values

Constructor Detail

HudiRealtimeBootstrapBaseFileSplitConverter

public HudiRealtimeBootstrapBaseFileSplitConverter()

Method Detail

extractCustomSplitInfo

public Optional<Map<String,String>> extractCustomSplitInfo(org.apache.hadoop.mapred.FileSplit split)

Description copied from interface: CustomSplitConverter

This method is expected to return optional.empty() if the FileSplit does not match the split converter.

Specified by:

extractCustomSplitInfo in interface CustomSplitConverter

recreateFileSplitWithCustomInfo

public Optional<org.apache.hadoop.mapred.FileSplit> recreateFileSplitWithCustomInfo(org.apache.hadoop.mapred.FileSplit split,
                                                                                    Map<String,String> customSplitInfo)
                                                                             throws IOException

Description copied from interface: CustomSplitConverter

This method is expected to merge the customSplitInfo with split to recreate the custom FileSplit. It is expected to return optional.empty() if the customSplitInfo does not match the split converter.

Specified by:

recreateFileSplitWithCustomInfo in interface CustomSplitConverter

Throws:

IOException