org.apache.hadoop.hive.ql.exec.vector

Class VectorTopNKeyOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<TopNKeyDesc>

org.apache.hadoop.hive.ql.exec.vector.VectorTopNKeyOperator

All Implemented Interfaces:

Serializable, Cloneable, VectorizationOperator, Node

public class VectorTopNKeyOperator
extends Operator<TopNKeyDesc>
implements VectorizationOperator

VectorTopNKeyOperator passes rows that contains top N keys only.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.Counter, Operator.OperatorFunc, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, alias, asyncInitOperations, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, inputObjInspectors, LOG, numRows, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Constructor and Description
VectorTopNKeyOperator() Kryo ctor.
VectorTopNKeyOperator(CompilationOpContext ctx)
VectorTopNKeyOperator(CompilationOpContext ctx, OperatorDesc conf, VectorizationContext vContext, VectorDesc vectorDesc)

Method Summary

Modifier and Type	Method and Description
static void	checkTopNFilterEfficiency(Map<KeyWrapper,TopNKeyFilter> filters, Set<KeyWrapper> disabledPartitions, float efficiencyThreshold, org.slf4j.Logger log, long checkEfficiencyNumRows)
protected void	closeOp(boolean abort) Operator specific close routine.
boolean	columnNamesRowResolvedCanBeObtained()
VectorizationContext	getInputVectorizationContext()
String	getName()
OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
VectorDesc	getVectorDesc()
protected void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
void	process(Object data, int tag) Process the row.
void	setNextVectorBatchGroupStatus(boolean isLastGroupBatch)
boolean	supportAutomaticSortMergeJoin() Whether this operator supports automatic sort merge join.
boolean	supportSkewJoinOptimization()
boolean	supportUnionRemoveOptimization()

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, batchNeedsClone, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, flushRecursive, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOperatorName, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, replaceTabAlias, reset, setAlias, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setInputContext, setInputObjInspectors, setMarker, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, toString, toString, toString, vectorForward

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

VectorTopNKeyOperator

public VectorTopNKeyOperator(CompilationOpContext ctx,
                             OperatorDesc conf,
                             VectorizationContext vContext,
                             VectorDesc vectorDesc)

VectorTopNKeyOperator

public VectorTopNKeyOperator()

Kryo ctor.

VectorTopNKeyOperator

public VectorTopNKeyOperator(CompilationOpContext ctx)

Method Detail

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class Operator<TopNKeyDesc>

Throws:

HiveException

process

public void process(Object data,
                    int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

process in class Operator<TopNKeyDesc>

Parameters:

data - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

checkTopNFilterEfficiency

public static void checkTopNFilterEfficiency(Map<KeyWrapper,TopNKeyFilter> filters,
                                             Set<KeyWrapper> disabledPartitions,
                                             float efficiencyThreshold,
                                             org.slf4j.Logger log,
                                             long checkEfficiencyNumRows)

getInputVectorizationContext

public VectorizationContext getInputVectorizationContext()

Specified by:

getInputVectorizationContext in interface VectorizationOperator

getVectorDesc

public VectorDesc getVectorDesc()

Specified by:

getVectorDesc in interface VectorizationOperator

setNextVectorBatchGroupStatus

public void setNextVectorBatchGroupStatus(boolean isLastGroupBatch)
                                   throws HiveException

Overrides:

setNextVectorBatchGroupStatus in class Operator<TopNKeyDesc>

Throws:

HiveException

getName

public String getName()

Specified by:

getName in interface Node

Specified by:

getName in class Operator<TopNKeyDesc>

getType

public OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Specified by:

getType in class Operator<TopNKeyDesc>

Returns:

OperatorType.*

closeOp

protected void closeOp(boolean abort)
                throws HiveException

Description copied from class: Operator

Operator specific close routine. Operators which inherents this class should overwrite this funtion for their specific cleanup routine.

Overrides:

closeOp in class Operator<TopNKeyDesc>

Throws:

HiveException

supportSkewJoinOptimization

public boolean supportSkewJoinOptimization()

Overrides:

supportSkewJoinOptimization in class Operator<TopNKeyDesc>

columnNamesRowResolvedCanBeObtained

public boolean columnNamesRowResolvedCanBeObtained()

Overrides:

columnNamesRowResolvedCanBeObtained in class Operator<TopNKeyDesc>

supportAutomaticSortMergeJoin

public boolean supportAutomaticSortMergeJoin()

Description copied from class: Operator

Whether this operator supports automatic sort merge join. The stack is traversed, and this method is invoked for all the operators.

Overrides:

supportAutomaticSortMergeJoin in class Operator<TopNKeyDesc>

Returns:

TRUE if yes, FALSE otherwise.

supportUnionRemoveOptimization

public boolean supportUnionRemoveOptimization()

Overrides:

supportUnionRemoveOptimization in class Operator<TopNKeyDesc>