org.apache.hudi.hadoop.hive

Class HoodieCombineRealtimeFileSplit

java.lang.Object

org.apache.hadoop.mapreduce.InputSplit

org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

org.apache.hadoop.mapred.lib.CombineFileSplit

org.apache.hudi.hadoop.hive.HoodieCombineRealtimeFileSplit

All Implemented Interfaces:

org.apache.hadoop.io.Writable, org.apache.hadoop.mapred.InputSplit

public class HoodieCombineRealtimeFileSplit
extends org.apache.hadoop.mapred.lib.CombineFileSplit

Represents a CombineFileSplit for realtime tables.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HoodieCombineRealtimeFileSplit.Builder

Constructor Summary

Constructors

Constructor and Description
HoodieCombineRealtimeFileSplit()
HoodieCombineRealtimeFileSplit(org.apache.hadoop.mapred.JobConf jobConf, List<org.apache.hadoop.mapred.FileSplit> realtimeFileSplits)

Method Summary

Modifier and Type	Method and Description
long	getLength()
long	getLength(int i) Returns the length of the ith Path.
long[]	getLengths() Returns an array containing the lengths of the files in the split.
String[]	getLocations() Returns all the Paths where this input-split resides.
int	getNumPaths() Returns the number of Paths in the split.
long	getOffset(int i) Returns the start offset of the ith Path.
org.apache.hadoop.fs.Path	getPath(int i) Returns the ith Path.
org.apache.hadoop.fs.Path[]	getPaths() Returns all the Paths in the split.
List<org.apache.hadoop.mapred.FileSplit>	getRealtimeFileSplits()
long[]	getStartOffsets() Returns an array containing the start offsets of the files in the split.
void	readFields(DataInput in)
String	toString()
void	write(DataOutput out) Writable interface.

Methods inherited from class org.apache.hadoop.mapred.lib.CombineFileSplit

getJob

Methods inherited from class org.apache.hadoop.mapreduce.InputSplit

getLocationInfo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

HoodieCombineRealtimeFileSplit

public HoodieCombineRealtimeFileSplit()

HoodieCombineRealtimeFileSplit

public HoodieCombineRealtimeFileSplit(org.apache.hadoop.mapred.JobConf jobConf,
                                      List<org.apache.hadoop.mapred.FileSplit> realtimeFileSplits)

Method Detail

getRealtimeFileSplits

public List<org.apache.hadoop.mapred.FileSplit> getRealtimeFileSplits()

toString

public String toString()

Overrides:

toString in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

write

public void write(DataOutput out)
           throws IOException

Writable interface.

Specified by:

write in interface org.apache.hadoop.io.Writable

Overrides:

write in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

Throws:

IOException

readFields

public void readFields(DataInput in)
                throws IOException

Specified by:

readFields in interface org.apache.hadoop.io.Writable

Overrides:

readFields in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

Throws:

IOException

getLength

public long getLength()

Specified by:

getLength in interface org.apache.hadoop.mapred.InputSplit

Overrides:

getLength in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

getStartOffsets

public long[] getStartOffsets()

Returns an array containing the start offsets of the files in the split.

Overrides:

getStartOffsets in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

getLengths

public long[] getLengths()

Returns an array containing the lengths of the files in the split.

Overrides:

getLengths in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

getOffset

public long getOffset(int i)

Returns the start offset of the i^th Path.

Overrides:

getOffset in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

getLength

public long getLength(int i)

Returns the length of the i^th Path.

Overrides:

getLength in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

getNumPaths

public int getNumPaths()

Returns the number of Paths in the split.

Overrides:

getNumPaths in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

getPath

public org.apache.hadoop.fs.Path getPath(int i)

Returns the i^th Path.

Overrides:

getPath in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

getPaths

public org.apache.hadoop.fs.Path[] getPaths()

Returns all the Paths in the split.

Overrides:

getPaths in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

getLocations

public String[] getLocations()
                      throws IOException

Returns all the Paths where this input-split resides.

Specified by:

getLocations in interface org.apache.hadoop.mapred.InputSplit

Overrides:

getLocations in class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit

Throws:

IOException