org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast

Class VectorMapJoinFastLongHashMap

java.lang.Object

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastLongHashTable

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastLongHashMap

All Implemented Interfaces:

MemoryEstimate, VectorMapJoinHashMap, VectorMapJoinHashTable, VectorMapJoinLongHashMap, VectorMapJoinLongHashTable

public class VectorMapJoinFastLongHashMap
extends VectorMapJoinFastLongHashTable
implements VectorMapJoinLongHashMap, MemoryEstimate

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	VectorMapJoinFastLongHashMap.NonMatchedLongHashMapIterator

Field Summary

Fields

Modifier and Type	Field and Description
protected VectorMapJoinFastValueStore	valueStore

Fields inherited from class org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastLongHashTable

LOG, slotPairs

Fields inherited from class org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable

estimatedKeyCount, FIRST_SIZE_UP, HIGHEST_INT_POWER_OF_2, isFullOuter, keysAssigned, largestNumberOfSteps, loadFactor, logicalHashBucketCount, logicalHashBucketMask, metricExpands, metricPutConflict, ONE_QUARTER_LIMIT, ONE_SIXTH_LIMIT, resizeThreshold, writeBuffersSize

Constructor Summary

Constructors

Constructor and Description
VectorMapJoinFastLongHashMap(boolean isFullOuter, boolean minMaxEnabled, VectorMapJoinDesc.HashTableKeyType hashTableKeyType, int initialCapacity, float loadFactor, int writeBuffersSize, long estimatedKeyCount, TableDesc tableDesc)

Method Summary

Modifier and Type	Method and Description
void	addFullOuterNullKeyValue(org.apache.hadoop.io.BytesWritable currentValue)
void	assignSlot(int slot, long key, boolean isNewKey, org.apache.hadoop.io.BytesWritable currentValue)
boolean	containsLongKey(long currentKey)
VectorMapJoinHashMapResult	createHashMapResult()
VectorMapJoinNonMatchedIterator	createNonMatchedIterator(MatchTracker matchTracker)
long	getEstimatedMemorySize()
JoinUtil.JoinResult	lookup(long key, VectorMapJoinHashMapResult hashMapResult)
JoinUtil.JoinResult	lookup(long key, VectorMapJoinHashMapResult hashMapResult, MatchTracker matchTracker)
void	putRow(long hashCode, org.apache.hadoop.io.BytesWritable currentKey, org.apache.hadoop.io.BytesWritable currentValue)
void	testPutRow(long currentKey, byte[] currentValue)

Methods inherited from class org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastLongHashTable

adaptPutRow, add, containsKey, findReadSlot, max, min, useMinMax

Methods inherited from class org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable

checkResize, createMatchTracker, size, spillPartitionId, throwExpandError

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.ql.exec.vector.mapjoin.hashtable.VectorMapJoinLongHashTable

max, min, useMinMax

Methods inherited from interface org.apache.hadoop.hive.ql.exec.vector.mapjoin.hashtable.VectorMapJoinHashTable

createMatchTracker, size, spillPartitionId

Field Detail

valueStore

protected VectorMapJoinFastValueStore valueStore

Constructor Detail

VectorMapJoinFastLongHashMap

public VectorMapJoinFastLongHashMap(boolean isFullOuter,
                                    boolean minMaxEnabled,
                                    VectorMapJoinDesc.HashTableKeyType hashTableKeyType,
                                    int initialCapacity,
                                    float loadFactor,
                                    int writeBuffersSize,
                                    long estimatedKeyCount,
                                    TableDesc tableDesc)

Method Detail

createHashMapResult

public VectorMapJoinHashMapResult createHashMapResult()

Specified by:

createHashMapResult in interface VectorMapJoinHashMap

createNonMatchedIterator

public VectorMapJoinNonMatchedIterator createNonMatchedIterator(MatchTracker matchTracker)

Specified by:

createNonMatchedIterator in interface VectorMapJoinHashTable

Overrides:

createNonMatchedIterator in class VectorMapJoinFastHashTable

putRow

public void putRow(long hashCode,
                   org.apache.hadoop.io.BytesWritable currentKey,
                   org.apache.hadoop.io.BytesWritable currentValue)
            throws HiveException,
                   IOException

Specified by:

putRow in interface VectorMapJoinHashTable

Parameters:

hashCode - current HashCode to avoid re-computation

currentKey - The current Key in bytes

currentValue - The current Value in bytes

Throws:

HiveException

IOException

containsLongKey

public boolean containsLongKey(long currentKey)

Specified by:

containsLongKey in interface VectorMapJoinHashTable

Parameters:

currentKey - The key to check for existence.

Returns:

true If HashTable contains the given key.

testPutRow

public void testPutRow(long currentKey,
                       byte[] currentValue)
                throws HiveException,
                       IOException

Throws:

HiveException

IOException

assignSlot

public void assignSlot(int slot,
                       long key,
                       boolean isNewKey,
                       org.apache.hadoop.io.BytesWritable currentValue)

Specified by:

assignSlot in class VectorMapJoinFastLongHashTable

lookup

public JoinUtil.JoinResult lookup(long key,
                                  VectorMapJoinHashMapResult hashMapResult)

Specified by:

lookup in interface VectorMapJoinLongHashMap

lookup

public JoinUtil.JoinResult lookup(long key,
                                  VectorMapJoinHashMapResult hashMapResult,
                                  MatchTracker matchTracker)

Specified by:

lookup in interface VectorMapJoinLongHashMap

addFullOuterNullKeyValue

public void addFullOuterNullKeyValue(org.apache.hadoop.io.BytesWritable currentValue)

getEstimatedMemorySize

public long getEstimatedMemorySize()

Specified by:

getEstimatedMemorySize in interface MemoryEstimate

Overrides:

getEstimatedMemorySize in class VectorMapJoinFastLongHashTable