Package oracle.kv.hadoop.hive.table

Class TableHiveInputSplit

java.lang.Object

org.apache.hadoop.mapreduce.InputSplit

org.apache.hadoop.mapred.FileSplit

oracle.kv.hadoop.hive.table.TableHiveInputSplit

All Implemented Interfaces:

Writable, InputSplit, InputSplitWithLocationInfo

public class TableHiveInputSplit
extends FileSplit

Concrete implementation of the InputSplit interface required by version 1 of MapReduce to support Hive queries. A RecordReader will take instances of this class, where each such instance corresponds to data stored in an Oracle NoSQL Database store via the Table API, and use those instances to retrieve that data when performing a given Hive query against the store's data.

Note that the Hive infrastructure requires that even though the data associated with instances of this class resides in a table in an Oracle NoSQL Database store rather than an HDFS file, this class still must subclass FileSplit. As a result, a Hadoop HDFS Path must be specified for this class.

Also note that although this InputSplit is based on version 1 of MapReduce (as requied by the Hive infrastructure), it wraps and delegates to a YARN based (MapReduce version 2) InputSplit. This is done because the InputSplit class Oracle NoSQL Database provides to support Hadoop integration is YARN based, and this class wishes to exploit and reuse the functionality already provided by the YARN based InputSplit class.

Constructor Summary

Constructors

Constructor	Description
TableHiveInputSplit()
TableHiveInputSplit(Path filePath, TableInputSplit v2Split)

Method Summary

Modifier and Type	Method	Description
boolean	equals(java.lang.Object obj)
java.lang.String[]	getKVHelperHosts()
java.lang.String	getKVStoreName()
long	getLength()	Get the size of the split, so that the input splits can be sorted by size.
java.lang.String[]	getLocations()	Get the list of nodes by name where the data for the split would be local.
Path	getPath()	Returns the HDFS Path associated with this split.
int	getQueryBy()
PasswordCredentials	getSecurityCredentials()
java.lang.String	getSecurityLogin()
java.lang.String	getSecurityTrust()
java.lang.String	getTableName()
java.lang.String	getWhereClause()
int	hashCode()
void	readFields(java.io.DataInput in)	Deserialize the fields of this object from in.
java.lang.String	toString()
void	write(java.io.DataOutput out)	Serialize the fields of this object to out.

Methods inherited from class org.apache.hadoop.mapred.FileSplit

getLocationInfo, getStart

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

TableHiveInputSplit

public TableHiveInputSplit()

TableHiveInputSplit

public TableHiveInputSplit(Path filePath,
                           TableInputSplit v2Split)

Method Detail

getPath

public Path getPath()

Returns the HDFS Path associated with this split.

Overrides:

getPath in class FileSplit

Returns:

the HDFS Path associated with this split

getLength

public long getLength()

Get the size of the split, so that the input splits can be sorted by size.

Specified by:

getLength in interface InputSplit

Overrides:

getLength in class FileSplit

Returns:

the number of bytes in the split

getLocations

public java.lang.String[] getLocations()
                                throws java.io.IOException

Get the list of nodes by name where the data for the split would be local. The locations do not need to be serialized.

Specified by:

getLocations in interface InputSplit

Overrides:

getLocations in class FileSplit

Returns:

a new array of the node nodes.

Throws:

java.io.IOException - if an I/O error occurs

write

public void write(java.io.DataOutput out)
           throws java.io.IOException

Serialize the fields of this object to out.

Specified by:

write in interface Writable

Overrides:

write in class FileSplit

Parameters:

out - DataOuput to serialize this object into.

Throws:

java.io.IOException - if an I/O error occurs

readFields

public void readFields(java.io.DataInput in)
                throws java.io.IOException

Deserialize the fields of this object from in.

For efficiency, implementations should attempt to re-use storage in the existing object where possible.

Specified by:

readFields in interface Writable

Overrides:

readFields in class FileSplit

Parameters:

in - DataInput to deseriablize this object from.

Throws:

java.io.IOException - if an I/O error occurs

equals

public boolean equals(java.lang.Object obj)

Overrides:

equals in class java.lang.Object

hashCode

public int hashCode()

Overrides:

hashCode in class java.lang.Object

toString

public java.lang.String toString()

Overrides:

toString in class FileSplit

getKVStoreName

public java.lang.String getKVStoreName()

getKVHelperHosts

public java.lang.String[] getKVHelperHosts()

getTableName

public java.lang.String getTableName()

getQueryBy

public int getQueryBy()

getWhereClause

public java.lang.String getWhereClause()

getSecurityLogin

public java.lang.String getSecurityLogin()

getSecurityCredentials

public PasswordCredentials getSecurityCredentials()

getSecurityTrust

public java.lang.String getSecurityTrust()