org.apache.hudi.index.inmemory

Class HoodieInMemoryHashIndex

java.lang.Object

org.apache.hudi.index.HoodieIndex<Object,Object>

org.apache.hudi.index.inmemory.HoodieInMemoryHashIndex

All Implemented Interfaces:

Serializable

public class HoodieInMemoryHashIndex
extends HoodieIndex<Object,Object>

Hoodie Index implementation backed by an in-memory Hash map.

ONLY USE FOR LOCAL TESTING

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hudi.index.HoodieIndex

HoodieIndex.BucketIndexEngineType, HoodieIndex.IndexType

Field Summary

Fields inherited from class org.apache.hudi.index.HoodieIndex

config

Constructor Summary

Constructors

Constructor and Description
HoodieInMemoryHashIndex(HoodieWriteConfig config)

Method Summary

Modifier and Type	Method and Description
boolean	canIndexLogFiles() Mapping is available in HBase already.
boolean	isGlobal() Only looks up by recordKey.
boolean	isImplicitWithStorage() Index needs to be explicitly updated after storage write.
boolean	rollbackCommit(String instantTime) Rollback the effects of the commit made at instantTime.
<R> HoodieData<HoodieRecord<R>>	tagLocation(HoodieData<HoodieRecord<R>> records, HoodieEngineContext context, HoodieTable hoodieTable) Looks up the index and tags each incoming record with a location of a file that contains the row (if it is actually present).
HoodieData<WriteStatus>	updateLocation(HoodieData<WriteStatus> writeStatuses, HoodieEngineContext context, HoodieTable hoodieTable) Extracts the location of written records, and updates the index.

Methods inherited from class org.apache.hudi.index.HoodieIndex

close, requiresTagging, tagLocation, updateLocation

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieInMemoryHashIndex

public HoodieInMemoryHashIndex(HoodieWriteConfig config)

Method Detail

tagLocation

public <R> HoodieData<HoodieRecord<R>> tagLocation(HoodieData<HoodieRecord<R>> records,
                                                   HoodieEngineContext context,
                                                   HoodieTable hoodieTable)

Description copied from class: HoodieIndex

Looks up the index and tags each incoming record with a location of a file that contains the row (if it is actually present).

Specified by:

tagLocation in class HoodieIndex<Object,Object>

updateLocation

public HoodieData<WriteStatus> updateLocation(HoodieData<WriteStatus> writeStatuses,
                                              HoodieEngineContext context,
                                              HoodieTable hoodieTable)

Description copied from class: HoodieIndex

Extracts the location of written records, and updates the index.

Specified by:

updateLocation in class HoodieIndex<Object,Object>

rollbackCommit

public boolean rollbackCommit(String instantTime)

Description copied from class: HoodieIndex

Rollback the effects of the commit made at instantTime.

Specified by:

rollbackCommit in class HoodieIndex<Object,Object>

isGlobal

public boolean isGlobal()

Only looks up by recordKey.

Specified by:

isGlobal in class HoodieIndex<Object,Object>

Returns:

whether or not, the index implementation is global in nature

canIndexLogFiles

public boolean canIndexLogFiles()

Mapping is available in HBase already.

Specified by:

canIndexLogFiles in class HoodieIndex<Object,Object>

Returns:

Returns true/false depending on whether the impl has this capability

isImplicitWithStorage

public boolean isImplicitWithStorage()

Index needs to be explicitly updated after storage write.

Specified by:

isImplicitWithStorage in class HoodieIndex<Object,Object>