org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast

Class VectorMapJoinFastHashTable

java.lang.Object

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable

All Implemented Interfaces:

MemoryEstimate, VectorMapJoinHashTable

Direct Known Subclasses:

VectorMapJoinFastBytesHashTable, VectorMapJoinFastHashMultiSet, VectorMapJoinFastHashSet, VectorMapJoinFastLongHashTable

public abstract class VectorMapJoinFastHashTable
extends Object
implements VectorMapJoinHashTable

Field Summary

Fields

Modifier and Type	Field and Description
protected long	estimatedKeyCount
static int	FIRST_SIZE_UP
static int	HIGHEST_INT_POWER_OF_2
protected boolean	isFullOuter
protected int	keysAssigned
protected int	largestNumberOfSteps
protected float	loadFactor
static org.slf4j.Logger	LOG
protected int	logicalHashBucketCount
protected int	logicalHashBucketMask
protected int	metricExpands
protected int	metricPutConflict
static int	ONE_QUARTER_LIMIT
static int	ONE_SIXTH_LIMIT
protected int	resizeThreshold
protected int	writeBuffersSize

Constructor Summary

Constructors

Constructor and Description
VectorMapJoinFastHashTable(boolean isFullOuter, int initialCapacity, float loadFactor, int writeBuffersSize, long estimatedKeyCount)

Method Summary

Modifier and Type	Method and Description
protected boolean	checkResize()
MatchTracker	createMatchTracker()
VectorMapJoinNonMatchedIterator	createNonMatchedIterator(MatchTracker matchTracker)
long	getEstimatedMemorySize()
int	size() Get hash table size
int	spillPartitionId()
void	throwExpandError(int limit, String dataTypeName)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.ql.exec.vector.mapjoin.hashtable.VectorMapJoinHashTable

containsLongKey, putRow

Field Detail

LOG

public static final org.slf4j.Logger LOG

FIRST_SIZE_UP

public static final int FIRST_SIZE_UP

See Also:

Constant Field Values

isFullOuter

protected final boolean isFullOuter

logicalHashBucketCount

protected int logicalHashBucketCount

logicalHashBucketMask

protected int logicalHashBucketMask

loadFactor

protected final float loadFactor

writeBuffersSize

protected final int writeBuffersSize

estimatedKeyCount

protected long estimatedKeyCount

metricPutConflict

protected int metricPutConflict

largestNumberOfSteps

protected int largestNumberOfSteps

keysAssigned

protected int keysAssigned

resizeThreshold

protected int resizeThreshold

metricExpands

protected int metricExpands

HIGHEST_INT_POWER_OF_2

public static final int HIGHEST_INT_POWER_OF_2

See Also:

Constant Field Values

ONE_QUARTER_LIMIT

public static final int ONE_QUARTER_LIMIT

See Also:

Constant Field Values

ONE_SIXTH_LIMIT

public static final int ONE_SIXTH_LIMIT

See Also:

Constant Field Values

Constructor Detail

VectorMapJoinFastHashTable

public VectorMapJoinFastHashTable(boolean isFullOuter,
                                  int initialCapacity,
                                  float loadFactor,
                                  int writeBuffersSize,
                                  long estimatedKeyCount)

Method Detail

throwExpandError

public void throwExpandError(int limit,
                             String dataTypeName)

size

public int size()

Description copied from interface: VectorMapJoinHashTable

Get hash table size

Specified by:

size in interface VectorMapJoinHashTable

checkResize

protected final boolean checkResize()

getEstimatedMemorySize

public long getEstimatedMemorySize()

Specified by:

getEstimatedMemorySize in interface MemoryEstimate

createMatchTracker

public MatchTracker createMatchTracker()

Specified by:

createMatchTracker in interface VectorMapJoinHashTable

createNonMatchedIterator

public VectorMapJoinNonMatchedIterator createNonMatchedIterator(MatchTracker matchTracker)

Specified by:

createNonMatchedIterator in interface VectorMapJoinHashTable

spillPartitionId

public int spillPartitionId()

Specified by:

spillPartitionId in interface VectorMapJoinHashTable