org.apache.hudi.table.action.cluster.strategy

Class UpdateStrategy<T extends HoodieRecordPayload,I>

java.lang.Object

org.apache.hudi.table.action.cluster.strategy.UpdateStrategy<T,I>

public abstract class UpdateStrategy<T extends HoodieRecordPayload,I>
extends Object

When file groups in clustering, write records to these file group need to check.

Field Summary

Fields

Modifier and Type	Field and Description
protected HoodieEngineContext	engineContext
protected Set<HoodieFileGroupId>	fileGroupsInPendingClustering

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	UpdateStrategy(HoodieEngineContext engineContext, Set<HoodieFileGroupId> fileGroupsInPendingClustering)

Method Summary

Modifier and Type	Method and Description
abstract Pair<I,Set<HoodieFileGroupId>>	handleUpdate(I taggedRecordsRDD) Check the update records to the file group in clustering.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

engineContext

protected final HoodieEngineContext engineContext

fileGroupsInPendingClustering

protected Set<HoodieFileGroupId> fileGroupsInPendingClustering

Constructor Detail

UpdateStrategy

protected UpdateStrategy(HoodieEngineContext engineContext,
                         Set<HoodieFileGroupId> fileGroupsInPendingClustering)

Method Detail

handleUpdate

public abstract Pair<I,Set<HoodieFileGroupId>> handleUpdate(I taggedRecordsRDD)

Check the update records to the file group in clustering.

Parameters:

taggedRecordsRDD - the records to write, tagged with target file id, future can update tagged records location to a different fileId.

Returns:

the recordsRDD strategy updated and a set of file groups to be updated while pending clustering.