org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast

Class VectorMapJoinFastMultiKeyHashMapContainer

java.lang.Object

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTableContainerBase

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastMultiKeyHashMapContainer

All Implemented Interfaces:

MemoryEstimate, VectorMapJoinBytesHashMap, VectorMapJoinBytesHashTable, VectorMapJoinHashMap, VectorMapJoinHashTable

public class VectorMapJoinFastMultiKeyHashMapContainer
extends VectorMapJoinFastHashTableContainerBase
implements VectorMapJoinBytesHashMap

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	VectorMapJoinFastMultiKeyHashMapContainer.NonMatchedBytesHashMapParallelIterator

Constructor Summary

Constructors

Constructor and Description
VectorMapJoinFastMultiKeyHashMapContainer(boolean isFullOuter, int initialCapacity, float loadFactor, int writeBuffersSize, long estimatedKeyCount, int numHTs)

Method Summary

Modifier and Type	Method and Description
VectorMapJoinHashMapResult	createHashMapResult()
MatchTracker	createMatchTracker()
VectorMapJoinNonMatchedIterator	createNonMatchedIterator(MatchTracker matchTracker)
long	getEstimatedMemorySize()
long	getHashCode(org.apache.hadoop.io.BytesWritable currentKey)
JoinUtil.JoinResult	lookup(byte[] keyBytes, int keyStart, int keyLength, VectorMapJoinHashMapResult hashMapResult)
JoinUtil.JoinResult	lookup(byte[] keyBytes, int keyStart, int keyLength, VectorMapJoinHashMapResult hashMapResult, MatchTracker matchTracker)
void	putRow(long hashCode, org.apache.hadoop.io.BytesWritable currentKey, org.apache.hadoop.io.BytesWritable currentValue)
int	size() Get hash table size
int	spillPartitionId()

Methods inherited from class org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTableContainerBase

containsLongKey

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.ql.exec.vector.mapjoin.hashtable.VectorMapJoinHashTable

containsLongKey

Constructor Detail

VectorMapJoinFastMultiKeyHashMapContainer

public VectorMapJoinFastMultiKeyHashMapContainer(boolean isFullOuter,
                                                 int initialCapacity,
                                                 float loadFactor,
                                                 int writeBuffersSize,
                                                 long estimatedKeyCount,
                                                 int numHTs)

Method Detail

getHashCode

public long getHashCode(org.apache.hadoop.io.BytesWritable currentKey)
                 throws HiveException,
                        IOException

Specified by:

getHashCode in class VectorMapJoinFastHashTableContainerBase

Throws:

HiveException

IOException

putRow

public void putRow(long hashCode,
                   org.apache.hadoop.io.BytesWritable currentKey,
                   org.apache.hadoop.io.BytesWritable currentValue)
            throws HiveException,
                   IOException

Specified by:

putRow in interface VectorMapJoinHashTable

Specified by:

putRow in class VectorMapJoinFastHashTableContainerBase

Parameters:

hashCode - current HashCode to avoid re-computation

currentKey - The current Key in bytes

currentValue - The current Value in bytes

Throws:

HiveException

IOException

getEstimatedMemorySize

public long getEstimatedMemorySize()

Specified by:

getEstimatedMemorySize in interface MemoryEstimate

Specified by:

getEstimatedMemorySize in class VectorMapJoinFastHashTableContainerBase

size

public int size()

Description copied from interface: VectorMapJoinHashTable

Get hash table size

Specified by:

size in interface VectorMapJoinHashTable

Specified by:

size in class VectorMapJoinFastHashTableContainerBase

createMatchTracker

public MatchTracker createMatchTracker()

Specified by:

createMatchTracker in interface VectorMapJoinHashTable

createNonMatchedIterator

public VectorMapJoinNonMatchedIterator createNonMatchedIterator(MatchTracker matchTracker)

Specified by:

createNonMatchedIterator in interface VectorMapJoinHashTable

spillPartitionId

public int spillPartitionId()

Specified by:

spillPartitionId in interface VectorMapJoinHashTable

lookup

public JoinUtil.JoinResult lookup(byte[] keyBytes,
                                  int keyStart,
                                  int keyLength,
                                  VectorMapJoinHashMapResult hashMapResult)
                           throws IOException

Specified by:

lookup in interface VectorMapJoinBytesHashMap

Throws:

IOException

lookup

public JoinUtil.JoinResult lookup(byte[] keyBytes,
                                  int keyStart,
                                  int keyLength,
                                  VectorMapJoinHashMapResult hashMapResult,
                                  MatchTracker matchTracker)
                           throws IOException

Specified by:

lookup in interface VectorMapJoinBytesHashMap

Throws:

IOException

createHashMapResult

public VectorMapJoinHashMapResult createHashMapResult()

Specified by:

createHashMapResult in interface VectorMapJoinHashMap