org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast

Class VectorMapJoinFastBytesHashTable

java.lang.Object

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastBytesHashTable

All Implemented Interfaces:

MemoryEstimate, VectorMapJoinBytesHashTable, VectorMapJoinHashTable

Direct Known Subclasses:

VectorMapJoinFastBytesHashMap, VectorMapJoinFastBytesHashMultiSet, VectorMapJoinFastBytesHashSet

public abstract class VectorMapJoinFastBytesHashTable
extends VectorMapJoinFastHashTable
implements VectorMapJoinBytesHashTable

Field Summary

Fields

Modifier and Type	Field and Description
protected long[]	slots
protected org.apache.hadoop.io.BytesWritable	testKeyBytesWritable
protected WriteBuffers.Position	unsafeReadPos
protected WriteBuffers	writeBuffers

Fields inherited from class org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable

estimatedKeyCount, FIRST_SIZE_UP, HIGHEST_INT_POWER_OF_2, isFullOuter, keysAssigned, largestNumberOfSteps, loadFactor, logicalHashBucketCount, logicalHashBucketMask, metricExpands, metricPutConflict, ONE_QUARTER_LIMIT, ONE_SIXTH_LIMIT, resizeThreshold, writeBuffersSize

Constructor Summary

Constructors

Constructor and Description
VectorMapJoinFastBytesHashTable(boolean isFullOuter, int initialCapacity, float loadFactor, int writeBuffersSize, long estimatedKeyCount)

Method Summary

Modifier and Type	Method and Description
abstract void	add(byte[] keyBytes, int keyStart, int keyLength, org.apache.hadoop.io.BytesWritable currentValue, long hashCode)
boolean	containsLongKey(long currentKey)
protected void	expandAndRehash()
long	getEstimatedMemorySize()
void	putRow(long hashCode, org.apache.hadoop.io.BytesWritable currentKey, org.apache.hadoop.io.BytesWritable currentValue)

Methods inherited from class org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable

checkResize, createMatchTracker, createNonMatchedIterator, size, spillPartitionId, throwExpandError

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.ql.exec.vector.mapjoin.hashtable.VectorMapJoinHashTable

createMatchTracker, createNonMatchedIterator, size, spillPartitionId

Field Detail

writeBuffers

protected WriteBuffers writeBuffers

unsafeReadPos

protected WriteBuffers.Position unsafeReadPos

testKeyBytesWritable

protected org.apache.hadoop.io.BytesWritable testKeyBytesWritable

slots

protected long[] slots

Constructor Detail

VectorMapJoinFastBytesHashTable

public VectorMapJoinFastBytesHashTable(boolean isFullOuter,
                                       int initialCapacity,
                                       float loadFactor,
                                       int writeBuffersSize,
                                       long estimatedKeyCount)

Method Detail

putRow

public void putRow(long hashCode,
                   org.apache.hadoop.io.BytesWritable currentKey,
                   org.apache.hadoop.io.BytesWritable currentValue)
            throws HiveException,
                   IOException

Specified by:

putRow in interface VectorMapJoinHashTable

Parameters:

hashCode - current HashCode to avoid re-computation

currentKey - The current Key in bytes

currentValue - The current Value in bytes

Throws:

HiveException

IOException

containsLongKey

public boolean containsLongKey(long currentKey)

Specified by:

containsLongKey in interface VectorMapJoinHashTable

Parameters:

currentKey - The key to check for existence.

Returns:

true If HashTable contains the given key.

add

public abstract void add(byte[] keyBytes,
                         int keyStart,
                         int keyLength,
                         org.apache.hadoop.io.BytesWritable currentValue,
                         long hashCode)

expandAndRehash

protected void expandAndRehash()

getEstimatedMemorySize

public long getEstimatedMemorySize()

Specified by:

getEstimatedMemorySize in interface MemoryEstimate

Overrides:

getEstimatedMemorySize in class VectorMapJoinFastHashTable