org.apache.hadoop.hive.ql.udf.generic

Class GenericUDTFGetSplits2

java.lang.Object

org.apache.hadoop.hive.ql.udf.generic.GenericUDTF

org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits

org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits2

public class GenericUDTFGetSplits2
extends GenericUDTFGetSplits

GenericUDTFGetSplits2 - Memory efficient version of GenericUDTFGetSplits. It separates out information like schema and planBytes[] which is common to all the splits. This produces output in following format.

type split ---------------------------------------------------- schema-split LlapInputSplit -- contains only schema plan-split LlapInputSplit -- contains only planBytes[] 0 LlapInputSplit -- actual split 1 1 LlapInputSplit -- actual split 2 ... ...

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits

GenericUDTFGetSplits.PlanFragment

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits

bos, dos, inputArgNumSplits, inputArgQuery, intOI, jc, schemaSplitOnly, stringOI

Constructor Summary

Constructors

Constructor and Description
GenericUDTFGetSplits2()

Method Summary

Modifier and Type	Method and Description
StructObjectInspector	initialize(ObjectInspector[] arguments) Initialize this GenericUDTF.
void	process(Object[] arguments) Give a set of arguments for the UDTF to process.

Methods inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits

close, getSplitResult, initArgs, validateInput

Methods inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDTF

configure, forward, initialize, setCollector

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GenericUDTFGetSplits2

public GenericUDTFGetSplits2()

Method Detail

initialize

public StructObjectInspector initialize(ObjectInspector[] arguments)
                                 throws UDFArgumentException

Description copied from class: GenericUDTF

Initialize this GenericUDTF. This will be called only once per instance.

Overrides:

initialize in class GenericUDTFGetSplits

Parameters:

arguments - An array of ObjectInspectors for the arguments

Returns:

A StructObjectInspector for output. The output struct represents a row of the table where the fields of the stuct are the columns. The field names are unimportant as they will be overridden by user supplied column aliases.

Throws:

UDFArgumentException

process

public void process(Object[] arguments)
             throws HiveException

Description copied from class: GenericUDTF

Give a set of arguments for the UDTF to process.

Overrides:

process in class GenericUDTFGetSplits

Parameters:

arguments - object array of arguments

Throws:

HiveException