org.apache.hudi.common.table.timeline

Class HoodieMetaserverBasedTimeline

java.lang.Object

org.apache.hudi.common.table.timeline.HoodieDefaultTimeline

org.apache.hudi.common.table.timeline.HoodieActiveTimeline

org.apache.hudi.common.table.timeline.HoodieMetaserverBasedTimeline

All Implemented Interfaces:

Serializable, HoodieTimeline

public class HoodieMetaserverBasedTimeline
extends HoodieActiveTimeline

Active timeline for hoodie table whose metadata is stored in the hoodie meta server instead of file system.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.hudi.common.table.timeline.HoodieActiveTimeline

metaClient, NOT_PARSABLE_TIMESTAMPS, VALID_EXTENSIONS_IN_ACTIVE_TIMELINE

Fields inherited from class org.apache.hudi.common.table.timeline.HoodieDefaultTimeline

details

Fields inherited from interface org.apache.hudi.common.table.timeline.HoodieTimeline

CLEAN_ACTION, CLEAN_EXTENSION, COMMIT_ACTION, COMMIT_EXTENSION, COMPACTION_ACTION, COMPLETED_COMPACTION_SUFFIX, COMPLETED_EXTENSION, DELTA_COMMIT_ACTION, DELTA_COMMIT_EXTENSION, EQUALS, FULL_BOOTSTRAP_INSTANT_TS, GREATER_THAN, GREATER_THAN_OR_EQUALS, INDEX_COMMIT_EXTENSION, INDEXING_ACTION, INFLIGHT_CLEAN_EXTENSION, INFLIGHT_COMMIT_EXTENSION, INFLIGHT_COMPACTION_EXTENSION, INFLIGHT_DELTA_COMMIT_EXTENSION, INFLIGHT_EXTENSION, INFLIGHT_INDEX_COMMIT_EXTENSION, INFLIGHT_LOG_COMPACTION_EXTENSION, INFLIGHT_REPLACE_COMMIT_EXTENSION, INFLIGHT_RESTORE_EXTENSION, INFLIGHT_ROLLBACK_EXTENSION, INFLIGHT_SAVE_SCHEMA_ACTION_EXTENSION, INFLIGHT_SAVEPOINT_EXTENSION, INIT_INSTANT_TS, INVALID_INSTANT_TS, LESSER_THAN, LESSER_THAN_OR_EQUALS, LOG_COMPACTION_ACTION, METADATA_BOOTSTRAP_INSTANT_TS, REPLACE_COMMIT_ACTION, REPLACE_COMMIT_EXTENSION, REQUESTED_CLEAN_EXTENSION, REQUESTED_COMMIT_EXTENSION, REQUESTED_COMPACTION_EXTENSION, REQUESTED_COMPACTION_SUFFIX, REQUESTED_DELTA_COMMIT_EXTENSION, REQUESTED_EXTENSION, REQUESTED_INDEX_COMMIT_EXTENSION, REQUESTED_LOG_COMPACTION_EXTENSION, REQUESTED_LOG_COMPACTION_SUFFIX, REQUESTED_REPLACE_COMMIT_EXTENSION, REQUESTED_RESTORE_EXTENSION, REQUESTED_ROLLBACK_EXTENSION, REQUESTED_SAVE_SCHEMA_ACTION_EXTENSION, RESTORE_ACTION, RESTORE_EXTENSION, ROLLBACK_ACTION, ROLLBACK_EXTENSION, SAVE_SCHEMA_ACTION_EXTENSION, SAVEPOINT_ACTION, SAVEPOINT_EXTENSION, SCHEMA_COMMIT_ACTION, VALID_ACTIONS_IN_TIMELINE

Constructor Summary

Constructors

Constructor and Description
HoodieMetaserverBasedTimeline(HoodieTableMetaClient metaClient, HoodieMetaserverConfig config)

Method Summary

Modifier and Type	Method and Description
void	createFileInMetaPath(String filename, Option<byte[]> content, boolean allowOverwrite)
protected void	deleteInstantFile(HoodieInstant instant)
protected Option<byte[]>	readDataFromPath(org.apache.hadoop.fs.Path detailPath)
HoodieMetaserverBasedTimeline	reload()
protected void	revertCompleteToInflight(HoodieInstant completed, HoodieInstant inflight)
void	transitionState(HoodieInstant fromInstant, HoodieInstant toInstant, Option<byte[]> data, boolean allowRedundantTransitions)

Methods inherited from class org.apache.hudi.common.table.timeline.HoodieActiveTimeline

copyInstant, createNewInstant, createNewInstantTime, createNewInstantTime, createRequestedReplaceCommit, deleteCompactionRequested, deleteCompletedRollback, deleteEmptyInstantIfExists, deleteInflight, deleteInstantFile, deleteInstantFileIfExists, deletePending, formatDate, getInstantDetails, getLastCommitMetadataWithValidData, getLastCommitMetadataWithValidSchema, parseDateFromInstantTime, parseDateFromInstantTimeSafely, readCleanerInfoAsBytes, readCompactionPlanAsBytes, readIndexPlanAsBytes, readRestoreInfoAsBytes, readRollbackInfoAsBytes, revertIndexInflightToRequested, revertInstantFromInflightToRequested, revertLogCompactionInflightToRequested, revertToInflight, saveAsComplete, saveToCleanRequested, saveToCompactionRequested, saveToCompactionRequested, saveToLogCompactionRequested, saveToLogCompactionRequested, saveToPendingIndexAction, saveToPendingReplaceCommit, saveToRestoreRequested, saveToRollbackRequested, transitionCleanInflightToComplete, transitionCleanRequestedToInflight, transitionCompactionInflightToComplete, transitionCompactionRequestedToInflight, transitionIndexInflightToComplete, transitionIndexRequestedToInflight, transitionLogCompactionInflightToComplete, transitionLogCompactionRequestedToInflight, transitionReplaceInflightToComplete, transitionReplaceRequestedToInflight, transitionRequestedToInflight, transitionRequestedToInflight, transitionRequestedToInflight, transitionRestoreRequestedToInflight, transitionRollbackInflightToComplete, transitionRollbackRequestedToInflight

Methods inherited from class org.apache.hudi.common.table.timeline.HoodieDefaultTimeline

containsInstant, containsInstant, containsOrBeforeTimelineStarts, countInstants, empty, filter, filterCompletedAndCompactionInstants, filterCompletedIndexTimeline, filterCompletedInstants, filterCompletedInstantsOrRewriteTimeline, filterCompletedOrMajorOrMinorCompactionInstants, filterInflights, filterInflightsAndRequested, filterInstantsByAction, filterPendingCompactionTimeline, filterPendingExcludingCompaction, filterPendingExcludingLogCompaction, filterPendingExcludingMajorAndMinorCompaction, filterPendingIndexTimeline, filterPendingLogCompactionTimeline, filterPendingMajorOrMinorCompactionTimeline, filterPendingReplaceTimeline, filterPendingRollbackTimeline, filterRequestedRollbackTimeline, findInstantBefore, findInstantsAfter, findInstantsAfter, findInstantsAfterOrEquals, findInstantsBefore, findInstantsBeforeOrEquals, findInstantsInClosedRange, findInstantsInRange, findInstantsInRangeByStateTransitionTime, findInstantsModifiedAfterByStateTransitionTime, firstInstant, firstInstant, getAllCommitsTimeline, getCleanerTimeline, getCommitsAndCompactionTimeline, getCommitsTimeline, getCommitTimeline, getCompletedReplaceTimeline, getContiguousCompletedWriteTimeline, getDeltaCommitTimeline, getFirstNonSavepointCommit, getInstants, getInstantsAsStream, getInstantsOrderedByStateTransitionTime, getLastClusterCommit, getRestoreTimeline, getReverseOrderedInstants, getRollbackAndRestoreTimeline, getRollbackTimeline, getSavePointTimeline, getTimelineHash, getTimelineOfActions, getWriteTimeline, isBeforeTimelineStarts, isEmpty, lastInstant, mergeTimeline, nthFromLastInstant, nthInstant, setInstants, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hudi.common.table.timeline.HoodieTimeline

compareTimestamps, getCleanInflightInstant, getCleanRequestedInstant, getCommitFromCommitFile, getCompactionInflightInstant, getCompactionRequestedInstant, getCompletedInstant, getIndexInflightInstant, getIndexRequestedInstant, getInflightInstant, getLogCompactionInflightInstant, getLogCompactionRequestedInstant, getReplaceCommitInflightInstant, getReplaceCommitRequestedInstant, getRequestedInstant, getRestoreRequestedInstant, getRollbackRequestedInstant, isInClosedRange, isInRange, makeCleanerFileName, makeCommitFileName, makeDeltaFileName, makeFileNameAsComplete, makeFileNameAsInflight, makeIndexCommitFileName, makeInflightCleanerFileName, makeInflightCommitFileName, makeInflightCompactionFileName, makeInflightDeltaFileName, makeInflightIndexFileName, makeInflightLogCompactionFileName, makeInflightReplaceFileName, makeInflightRestoreFileName, makeInflightRollbackFileName, makeInflightSavePointFileName, makeInflightSchemaFileName, makeReplaceFileName, makeRequestedCleanerFileName, makeRequestedCommitFileName, makeRequestedCompactionFileName, makeRequestedDeltaFileName, makeRequestedIndexFileName, makeRequestedLogCompactionFileName, makeRequestedReplaceFileName, makeRequestedRestoreFileName, makeRequestedRollbackFileName, makeRequestSchemaFileName, makeRestoreFileName, makeRollbackFileName, makeSavePointFileName, makeSchemaFileName

Constructor Detail

HoodieMetaserverBasedTimeline

public HoodieMetaserverBasedTimeline(HoodieTableMetaClient metaClient,
                                     HoodieMetaserverConfig config)

Method Detail

deleteInstantFile

protected void deleteInstantFile(HoodieInstant instant)

Overrides:

deleteInstantFile in class HoodieActiveTimeline

transitionState

public void transitionState(HoodieInstant fromInstant,
                            HoodieInstant toInstant,
                            Option<byte[]> data,
                            boolean allowRedundantTransitions)

Overrides:

transitionState in class HoodieActiveTimeline

createFileInMetaPath

public void createFileInMetaPath(String filename,
                                 Option<byte[]> content,
                                 boolean allowOverwrite)

Overrides:

createFileInMetaPath in class HoodieActiveTimeline

revertCompleteToInflight

protected void revertCompleteToInflight(HoodieInstant completed,
                                        HoodieInstant inflight)

Overrides:

revertCompleteToInflight in class HoodieActiveTimeline

readDataFromPath

protected Option<byte[]> readDataFromPath(org.apache.hadoop.fs.Path detailPath)

Overrides:

readDataFromPath in class HoodieActiveTimeline

reload

public HoodieMetaserverBasedTimeline reload()

Overrides:

reload in class HoodieActiveTimeline