org.apache.hudi.hadoop.realtime

Interface RealtimeSplit

All Superinterfaces:

org.apache.hadoop.mapred.InputSplit, org.apache.hadoop.mapred.InputSplitWithLocationInfo, org.apache.hadoop.io.Writable

All Known Implementing Classes:

HoodieRealtimeBootstrapBaseFileSplit, HoodieRealtimeFileSplit

public interface RealtimeSplit
extends org.apache.hadoop.mapred.InputSplitWithLocationInfo

Realtime Input Split Interface.

Method Summary

Modifier and Type	Method and Description
String	getBasePath() Return Base Path of the dataset.
boolean	getBelongsToIncrementalQuery() Returns the flag whether this split belongs to an Incremental Query
List<HoodieLogFile>	getDeltaLogFiles()
default List<String>	getDeltaLogPaths() Return Log File Paths.
long	getLength() The number of bytes in the file to process.
String	getMaxCommitTime() Return Max Instant Time.
org.apache.hadoop.fs.Path	getPath() The file containing this split's data.
long	getStart() The position of the first byte in the file to process.
Option<HoodieVirtualKeyInfo>	getVirtualKeyInfo() Returns Virtual key info if meta fields are disabled.
default void	readFromInput(DataInput in)
void	setBasePath(String basePath) Set Base Path.
void	setBelongsToIncrementalQuery(boolean belongsToIncrementalQuery) Sets the flag whether this split belongs to an Incremental Query
void	setDeltaLogFiles(List<HoodieLogFile> deltaLogFiles)
void	setMaxCommitTime(String maxCommitTime) Update Maximum valid instant time.
void	setVirtualKeyInfo(Option<HoodieVirtualKeyInfo> virtualKeyInfo)
default void	writeToOutput(DataOutput out)

Methods inherited from interface org.apache.hadoop.mapred.InputSplitWithLocationInfo

getLocationInfo

Methods inherited from interface org.apache.hadoop.mapred.InputSplit

getLocations

Methods inherited from interface org.apache.hadoop.io.Writable

readFields, write

Method Detail

getDeltaLogPaths

default List<String> getDeltaLogPaths()

Return Log File Paths.

Returns:

getDeltaLogFiles

List<HoodieLogFile> getDeltaLogFiles()

setDeltaLogFiles

void setDeltaLogFiles(List<HoodieLogFile> deltaLogFiles)

getMaxCommitTime

String getMaxCommitTime()

Return Max Instant Time.

Returns:

getBasePath

String getBasePath()

Return Base Path of the dataset.

Returns:

getVirtualKeyInfo

Option<HoodieVirtualKeyInfo> getVirtualKeyInfo()

Returns Virtual key info if meta fields are disabled.

Returns:

getBelongsToIncrementalQuery

boolean getBelongsToIncrementalQuery()

Returns the flag whether this split belongs to an Incremental Query

setMaxCommitTime

void setMaxCommitTime(String maxCommitTime)

Update Maximum valid instant time.

Parameters:

maxCommitTime -

setBasePath

void setBasePath(String basePath)

Set Base Path.

Parameters:

basePath -

setBelongsToIncrementalQuery

void setBelongsToIncrementalQuery(boolean belongsToIncrementalQuery)

Sets the flag whether this split belongs to an Incremental Query

setVirtualKeyInfo

void setVirtualKeyInfo(Option<HoodieVirtualKeyInfo> virtualKeyInfo)

writeToOutput

default void writeToOutput(DataOutput out)
                    throws IOException

Throws:

IOException

readFromInput

default void readFromInput(DataInput in)
                    throws IOException

Throws:

IOException

getPath

org.apache.hadoop.fs.Path getPath()

The file containing this split's data.

getStart

long getStart()

The position of the first byte in the file to process.

getLength

long getLength()

The number of bytes in the file to process.

Specified by:

getLength in interface org.apache.hadoop.mapred.InputSplit