org.gridgain.grid.kernal.processors.hadoop.shuffle.collections

Class GridHadoopConcurrentHashMultimap

java.lang.Object

org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopMultimapBase

org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopHashMultimapBase

org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopConcurrentHashMultimap

All Implemented Interfaces:

AutoCloseable, GridHadoopMultimap

public class GridHadoopConcurrentHashMultimap
extends GridHadoopHashMultimapBase

Multimap for map reduce intermediate results.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	GridHadoopConcurrentHashMultimap.AdderImpl Adder.

Nested classes/interfaces inherited from class org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopHashMultimapBase

GridHadoopHashMultimapBase.Input, GridHadoopHashMultimapBase.Reader

Nested classes/interfaces inherited from class org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopMultimapBase

GridHadoopMultimapBase.AdderBase, GridHadoopMultimapBase.ReaderBase, GridHadoopMultimapBase.ValueIterator

Nested classes/interfaces inherited from interface org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopMultimap

GridHadoopMultimap.Adder, GridHadoopMultimap.Key, GridHadoopMultimap.Value, GridHadoopMultimap.Visitor

Field Summary

Fields inherited from class org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopMultimapBase

job, mem, pageSize

Constructor Summary

Constructors

Constructor and Description
GridHadoopConcurrentHashMultimap(org.gridgain.grid.hadoop.GridHadoopJob job, org.gridgain.grid.util.offheap.unsafe.GridUnsafeMemory mem, int cap)

Method Summary

Methods

Modifier and Type	Method and Description
int	capacity()
void	close()
protected long	collision(long meta)
protected void	collision(long meta, long collision)
org.gridgain.grid.hadoop.GridHadoopTaskInput	input(Comparator<Object> ignore)
long	keys()
protected long	meta(int idx)
GridHadoopMultimap.Adder	startAdding()
protected long	value(long meta)
boolean	visit(boolean ignoreLastVisited, GridHadoopMultimap.Visitor v) Incrementally visits all the keys and values in the map.

Methods inherited from class org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopHashMultimapBase

key, keyHash, keySize, value

Methods inherited from class org.gridgain.grid.kernal.processors.hadoop.shuffle.collections.GridHadoopMultimapBase

nextValue, nextValue, valueSize, valueSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridHadoopConcurrentHashMultimap

public GridHadoopConcurrentHashMultimap(org.gridgain.grid.hadoop.GridHadoopJob job,
                                org.gridgain.grid.util.offheap.unsafe.GridUnsafeMemory mem,
                                int cap)

Parameters:

job - Job.

mem - Memory.

cap - Initial capacity.

Method Detail

keys

public long keys()

Returns:

Number of keys.

capacity

public int capacity()

Specified by:

capacity in class GridHadoopHashMultimapBase

Returns:

Current table capacity.

startAdding

public GridHadoopMultimap.Adder startAdding()
                                     throws org.gridgain.grid.GridException

Returns:

Adder object.

Throws:

org.gridgain.grid.GridException - If failed.

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface GridHadoopMultimap

Overrides:

close in class GridHadoopMultimapBase

meta

protected long meta(int idx)

Specified by:

meta in class GridHadoopHashMultimapBase

Parameters:

idx - Index in hash table.

Returns:

Meta page pointer.

visit

public boolean visit(boolean ignoreLastVisited,
            GridHadoopMultimap.Visitor v)
              throws org.gridgain.grid.GridException

Incrementally visits all the keys and values in the map.

Specified by:

visit in interface GridHadoopMultimap

Overrides:

visit in class GridHadoopHashMultimapBase

Parameters:

ignoreLastVisited - Flag indicating that visiting must be started from the beginning.

v - Visitor.

Returns:

false If visiting was impossible due to rehashing.

Throws:

org.gridgain.grid.GridException

input

public org.gridgain.grid.hadoop.GridHadoopTaskInput input(Comparator<Object> ignore)
                                                   throws org.gridgain.grid.GridException

Specified by:

input in interface GridHadoopMultimap

Overrides:

input in class GridHadoopHashMultimapBase

Parameters:

ignore - Optional grouping comparator.

Returns:

Task input.

Throws:

org.gridgain.grid.GridException - If failed.

value

protected long value(long meta)

Overrides:

value in class GridHadoopHashMultimapBase

Parameters:

meta - Meta pointer.

Returns:

Value pointer.

collision

protected long collision(long meta)

Overrides:

collision in class GridHadoopHashMultimapBase

Parameters:

meta - Meta pointer.

Returns:

Collision pointer.

collision

protected void collision(long meta,
             long collision)

Overrides:

collision in class GridHadoopHashMultimapBase

Parameters:

meta - Meta pointer.

collision - Collision pointer.