org.apache.hadoop.hive.ql.exec.vector.mapjoin.optimized

Class VectorMapJoinOptimizedHashTable

java.lang.Object

org.apache.hadoop.hive.ql.exec.vector.mapjoin.optimized.VectorMapJoinOptimizedHashTable

All Implemented Interfaces:

MemoryEstimate, VectorMapJoinBytesHashTable, VectorMapJoinHashTable

Direct Known Subclasses:

VectorMapJoinOptimizedHashMap, VectorMapJoinOptimizedHashMultiSet, VectorMapJoinOptimizedHashSet

public abstract class VectorMapJoinOptimizedHashTable
extends Object
implements VectorMapJoinHashTable, VectorMapJoinBytesHashTable

Root interface for a vector map join hash table (which could be a hash map, hash multi-set, or hash set).

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	VectorMapJoinOptimizedHashTable.SerializedBytes

Field Summary

Fields

Modifier and Type	Field and Description
protected ReusableGetAdaptorDirectAccess	adapterDirectAccess
protected MapJoinTableContainerDirectAccess	containerDirectAccess
protected MapJoinTableContainer	originalTableContainer

Constructor Summary

Constructors

Constructor and Description
VectorMapJoinOptimizedHashTable(MapJoinTableContainer originalTableContainer, MapJoinTableContainer.ReusableGetAdaptor hashMapRowGetter)

Method Summary

Modifier and Type	Method and Description
boolean	containsLongKey(long currentKey)
MatchTracker	createMatchTracker()
VectorMapJoinNonMatchedIterator	createNonMatchedIterator(MatchTracker matchTracker)
JoinUtil.JoinResult	doLookup(byte[] keyBytes, int keyOffset, int keyLength, BytesBytesMultiHashMap.Result bytesBytesMultiHashMapResult, VectorMapJoinHashTableResult hashTableResult, MatchTracker matchTracker)
long	getEstimatedMemorySize()
void	putRow(long hashCode, org.apache.hadoop.io.BytesWritable currentKey, org.apache.hadoop.io.BytesWritable currentValue)
protected void	putRowInternal(org.apache.hadoop.io.BytesWritable key, org.apache.hadoop.io.BytesWritable value)
int	size() Get hash table size
int	spillPartitionId()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

originalTableContainer

protected final MapJoinTableContainer originalTableContainer

containerDirectAccess

protected final MapJoinTableContainerDirectAccess containerDirectAccess

adapterDirectAccess

protected final ReusableGetAdaptorDirectAccess adapterDirectAccess

Constructor Detail

VectorMapJoinOptimizedHashTable

public VectorMapJoinOptimizedHashTable(MapJoinTableContainer originalTableContainer,
                                       MapJoinTableContainer.ReusableGetAdaptor hashMapRowGetter)

Method Detail

createNonMatchedIterator

public VectorMapJoinNonMatchedIterator createNonMatchedIterator(MatchTracker matchTracker)

Specified by:

createNonMatchedIterator in interface VectorMapJoinHashTable

spillPartitionId

public int spillPartitionId()

Specified by:

spillPartitionId in interface VectorMapJoinHashTable

putRow

public void putRow(long hashCode,
                   org.apache.hadoop.io.BytesWritable currentKey,
                   org.apache.hadoop.io.BytesWritable currentValue)
            throws SerDeException,
                   HiveException,
                   IOException

Specified by:

putRow in interface VectorMapJoinHashTable

Parameters:

hashCode - current HashCode to avoid re-computation

currentKey - The current Key in bytes

currentValue - The current Value in bytes

Throws:

SerDeException

HiveException

IOException

containsLongKey

public boolean containsLongKey(long currentKey)

Specified by:

containsLongKey in interface VectorMapJoinHashTable

Parameters:

currentKey - The key to check for existence.

Returns:

true If HashTable contains the given key.

putRowInternal

protected void putRowInternal(org.apache.hadoop.io.BytesWritable key,
                              org.apache.hadoop.io.BytesWritable value)
                       throws SerDeException,
                              HiveException,
                              IOException

Throws:

SerDeException

HiveException

IOException

doLookup

public JoinUtil.JoinResult doLookup(byte[] keyBytes,
                                    int keyOffset,
                                    int keyLength,
                                    BytesBytesMultiHashMap.Result bytesBytesMultiHashMapResult,
                                    VectorMapJoinHashTableResult hashTableResult,
                                    MatchTracker matchTracker)

size

public int size()

Description copied from interface: VectorMapJoinHashTable

Get hash table size

Specified by:

size in interface VectorMapJoinHashTable

getEstimatedMemorySize

public long getEstimatedMemorySize()

Specified by:

getEstimatedMemorySize in interface MemoryEstimate

createMatchTracker

public MatchTracker createMatchTracker()

Specified by:

createMatchTracker in interface VectorMapJoinHashTable