| Modifier and Type | Method and Description |
|---|---|
Option<HoodieInstant> |
BaseHoodieTableFileIndex.getLatestCompletedInstant()
Returns latest completed instant as seen by this instance of the file-index
|
| Modifier and Type | Method and Description |
|---|---|
HoodieInstant |
HoodiePendingRollbackInfo.getRollbackInstant() |
| Modifier and Type | Method and Description |
|---|---|
HoodieCleanStat.Builder |
HoodieCleanStat.Builder.withEarliestCommitRetained(Option<HoodieInstant> earliestCommitToRetain) |
| Constructor and Description |
|---|
HoodiePendingRollbackInfo(HoodieInstant rollbackInstant,
HoodieRollbackPlan rollbackPlan) |
| Modifier and Type | Method and Description |
|---|---|
abstract void |
TimelineServerBasedDetectionStrategy.startAsyncDetection(Long initialDelayMs,
Long periodMs,
String markerDir,
String basePath,
Long maxAllowableHeartbeatIntervalInMs,
HoodieStorage storage,
Object markerHandler,
Set<HoodieInstant> completedCommits)
Starts the async conflict detection thread.
|
| Modifier and Type | Method and Description |
|---|---|
List<HoodieInstant> |
HoodieTableMetaClient.scanHoodieInstantsFromFileSystem(Set<String> includedExtensions,
boolean applyLayoutVersionFilters)
Helper method to scan all hoodie-instant metafiles and construct HoodieInstant objects.
|
List<HoodieInstant> |
HoodieTableMetaClient.scanHoodieInstantsFromFileSystem(StoragePath timelinePath,
Set<String> includedExtensions,
boolean applyLayoutVersionFilters)
Helper method to scan all hoodie-instant metafiles and construct HoodieInstant objects.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.avro.Schema |
TableSchemaResolver.getTableAvroSchema(HoodieInstant instant,
boolean includeMetadataFields)
Fetches tables schema in Avro format as of the given instant
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.avro.Schema |
TableSchemaResolver.readSchemaFromLastCompaction(Option<HoodieInstant> lastCompactionCommitOpt)
Deprecated.
please use
TableSchemaResolver.getTableAvroSchema(HoodieInstant, boolean) instead |
| Modifier and Type | Field and Description |
|---|---|
static Comparator<HoodieInstant> |
HoodieInstant.ACTION_COMPARATOR |
static Comparator<HoodieInstant> |
HoodieInstant.COMPARATOR |
protected Function<HoodieInstant,Option<byte[]>> |
HoodieDefaultTimeline.details |
static Comparator<HoodieInstant> |
HoodieInstant.STATE_TRANSITION_COMPARATOR |
| Modifier and Type | Method and Description |
|---|---|
static HoodieInstant |
HoodieTimeline.getCleanInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getCleanRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getCompactionInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getCompactionRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getCompletedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getIndexInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getIndexRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getInflightInstant(HoodieInstant instant,
HoodieTableMetaClient metaClient)
Returns the inflight instant corresponding to the instant being passed.
|
static HoodieInstant |
HoodieTimeline.getLogCompactionInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getLogCompactionRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getReplaceCommitInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getReplaceCommitRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getRequestedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getRestoreRequestedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getRollbackRequestedInstant(HoodieInstant instant) |
HoodieInstant |
HoodieActiveTimeline.revertIndexInflightToRequested(HoodieInstant inflightInstant)
Revert index instant state from inflight to requested.
|
HoodieInstant |
HoodieActiveTimeline.revertInstantFromInflightToRequested(HoodieInstant inflightInstant)
Revert instant state from inflight to requested.
|
HoodieInstant |
HoodieActiveTimeline.revertLogCompactionInflightToRequested(HoodieInstant inflightInstant)
TODO: This method is not needed, since log compaction plan is not a immutable plan.
|
HoodieInstant |
HoodieActiveTimeline.revertToInflight(HoodieInstant instant) |
HoodieInstant |
HoodieActiveTimeline.transitionCleanInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Clean State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionCleanRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition Clean State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionCompactionInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Compaction State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionCompactionRequestedToInflight(HoodieInstant requestedInstant)
Transition Compaction State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionIndexInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition index instant state from inflight to completed.
|
HoodieInstant |
HoodieActiveTimeline.transitionIndexRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition index instant state from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionLogCompactionInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Log Compaction State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionLogCompactionRequestedToInflight(HoodieInstant requestedInstant)
Transition LogCompaction State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionReplaceInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition replace inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionReplaceRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition replace requested file to replace inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionRestoreRequestedToInflight(HoodieInstant requestedInstant)
Transition Restore State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionRollbackInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Rollback State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionRollbackRequestedToInflight(HoodieInstant requestedInstant)
Transition Rollback State from requested to inflight.
|
| Modifier and Type | Method and Description |
|---|---|
abstract Stream<HoodieInstant> |
TimelineLayout.filterHoodieInstants(Stream<HoodieInstant> instantStream) |
protected Stream<HoodieInstant> |
HoodieDefaultTimeline.filterInstantsByAction(String action) |
Option<HoodieInstant> |
HoodieDefaultTimeline.findInstantBefore(String instantTime) |
Option<HoodieInstant> |
HoodieTimeline.findInstantBefore(String instantTime)
Finds the instant before specified time.
|
Option<HoodieInstant> |
HoodieDefaultTimeline.firstInstant() |
Option<HoodieInstant> |
HoodieTimeline.firstInstant() |
Option<HoodieInstant> |
HoodieDefaultTimeline.firstInstant(String action,
HoodieInstant.State state) |
Option<HoodieInstant> |
HoodieTimeline.firstInstant(String action,
HoodieInstant.State state) |
static Option<HoodieInstant> |
TimelineUtils.getEarliestInstantForMetadataArchival(HoodieActiveTimeline dataTableActiveTimeline,
boolean shouldArchiveBeyondSavepoint)
Gets the qualified earliest instant from the active timeline of the data table
for the archival in metadata table.
|
List<HoodieInstant> |
TimelineDiffHelper.TimelineDiffResult.getFinishedCompactionInstants() |
List<HoodieInstant> |
TimelineDiffHelper.TimelineDiffResult.getFinishedOrRemovedLogCompactionInstants() |
Option<HoodieInstant> |
HoodieDefaultTimeline.getFirstNonSavepointCommit() |
Option<HoodieInstant> |
HoodieTimeline.getFirstNonSavepointCommit()
First non-savepoint commit in the active data timeline.
|
Option<HoodieInstant> |
HoodieDefaultTimeline.getFirstPendingClusterInstant() |
Option<HoodieInstant> |
HoodieTimeline.getFirstPendingClusterInstant()
get the least recent pending cluster commit if present
|
List<HoodieInstant> |
HoodieDefaultTimeline.getInstants() |
List<HoodieInstant> |
HoodieTimeline.getInstants() |
Stream<HoodieInstant> |
HoodieDefaultTimeline.getInstantsAsStream() |
Stream<HoodieInstant> |
HoodieTimeline.getInstantsAsStream() |
Stream<HoodieInstant> |
HoodieDefaultTimeline.getInstantsOrderedByStateTransitionTime() |
Stream<HoodieInstant> |
HoodieTimeline.getInstantsOrderedByStateTransitionTime()
Get the stream of instants in order by state transition timestamp of actions.
|
Option<HoodieInstant> |
HoodieDefaultTimeline.getLastClusteringInstant() |
Option<HoodieInstant> |
HoodieTimeline.getLastClusteringInstant()
get the most recent cluster commit if present
|
Option<Pair<HoodieInstant,HoodieCommitMetadata>> |
HoodieActiveTimeline.getLastCommitMetadataWithValidData()
Get the last instant with valid data, and convert this to HoodieCommitMetadata
|
Option<Pair<HoodieInstant,HoodieCommitMetadata>> |
HoodieActiveTimeline.getLastCommitMetadataWithValidSchema()
Returns most recent instant having valid schema in its
HoodieCommitMetadata |
Option<HoodieInstant> |
HoodieDefaultTimeline.getLastPendingClusterInstant() |
Option<HoodieInstant> |
HoodieTimeline.getLastPendingClusterInstant()
get the most recent pending cluster commit if present
|
List<HoodieInstant> |
TimelineDiffHelper.TimelineDiffResult.getNewlySeenInstants() |
Stream<HoodieInstant> |
HoodieDefaultTimeline.getReverseOrderedInstants() |
Stream<HoodieInstant> |
HoodieTimeline.getReverseOrderedInstants() |
Option<HoodieInstant> |
HoodieDefaultTimeline.lastInstant() |
Option<HoodieInstant> |
HoodieTimeline.lastInstant() |
Option<HoodieInstant> |
HoodieDefaultTimeline.nthFromLastInstant(int n) |
Option<HoodieInstant> |
HoodieTimeline.nthFromLastInstant(int n) |
Option<HoodieInstant> |
HoodieDefaultTimeline.nthInstant(int n) |
Option<HoodieInstant> |
HoodieTimeline.nthInstant(int n) |
| Modifier and Type | Method and Description |
|---|---|
int |
HoodieInstant.compareTo(HoodieInstant o) |
boolean |
HoodieDefaultTimeline.containsInstant(HoodieInstant instant) |
boolean |
HoodieTimeline.containsInstant(HoodieInstant instant) |
void |
HoodieActiveTimeline.copyInstant(HoodieInstant instant,
StoragePath dstDir) |
void |
HoodieActiveTimeline.createNewInstant(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteCompactionRequested(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteCompletedRollback(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteEmptyInstantIfExists(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteInflight(HoodieInstant instant) |
protected void |
HoodieActiveTimeline.deleteInstantFile(HoodieInstant instant) |
static void |
HoodieActiveTimeline.deleteInstantFile(HoodieStorage storage,
StoragePath metaPath,
HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteInstantFileIfExists(HoodieInstant instant)
Note: This method should only be used in the case that delete requested/inflight instant or empty clean instant,
and completed commit instant in an archive operation.
|
void |
HoodieActiveTimeline.deletePending(HoodieInstant instant) |
static HoodieCommitMetadata |
TimelineUtils.getCommitMetadata(HoodieInstant instant,
HoodieTimeline timeline)
Returns the commit metadata of the given instant.
|
static HoodieInstant |
HoodieTimeline.getCompletedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getInflightInstant(HoodieInstant instant,
HoodieTableMetaClient metaClient)
Returns the inflight instant corresponding to the instant being passed.
|
Option<byte[]> |
HoodieActiveTimeline.getInstantDetails(HoodieInstant instant) |
Option<byte[]> |
HoodieDefaultTimeline.getInstantDetails(HoodieInstant instant) |
Option<byte[]> |
HoodieTimeline.getInstantDetails(HoodieInstant instant)
Read the completed instant details.
|
Option<byte[]> |
HoodieArchivedTimeline.getInstantDetails(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getRequestedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getRestoreRequestedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getRollbackRequestedInstant(HoodieInstant instant) |
static boolean |
TimelineUtils.isClusteringCommit(HoodieTableMetaClient metaClient,
HoodieInstant instant) |
boolean |
HoodieDefaultTimeline.isEmpty(HoodieInstant instant) |
boolean |
HoodieTimeline.isEmpty(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readCleanerInfoAsBytes(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readCompactionPlanAsBytes(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readIndexPlanAsBytes(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readRestoreInfoAsBytes(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readRollbackInfoAsBytes(HoodieInstant instant) |
protected void |
HoodieActiveTimeline.revertCompleteToInflight(HoodieInstant completed,
HoodieInstant inflight) |
HoodieInstant |
HoodieActiveTimeline.revertIndexInflightToRequested(HoodieInstant inflightInstant)
Revert index instant state from inflight to requested.
|
HoodieInstant |
HoodieActiveTimeline.revertInstantFromInflightToRequested(HoodieInstant inflightInstant)
Revert instant state from inflight to requested.
|
HoodieInstant |
HoodieActiveTimeline.revertLogCompactionInflightToRequested(HoodieInstant inflightInstant)
TODO: This method is not needed, since log compaction plan is not a immutable plan.
|
HoodieInstant |
HoodieActiveTimeline.revertToInflight(HoodieInstant instant) |
void |
HoodieActiveTimeline.saveAsComplete(HoodieInstant instant,
Option<byte[]> data) |
void |
HoodieActiveTimeline.saveToCleanRequested(HoodieInstant instant,
Option<byte[]> content) |
void |
HoodieActiveTimeline.saveToCompactionRequested(HoodieInstant instant,
Option<byte[]> content) |
void |
HoodieActiveTimeline.saveToCompactionRequested(HoodieInstant instant,
Option<byte[]> content,
boolean overwrite) |
void |
HoodieActiveTimeline.saveToLogCompactionRequested(HoodieInstant instant,
Option<byte[]> content) |
void |
HoodieActiveTimeline.saveToLogCompactionRequested(HoodieInstant instant,
Option<byte[]> content,
boolean overwrite) |
void |
HoodieActiveTimeline.saveToPendingIndexAction(HoodieInstant instant,
Option<byte[]> content)
Save content for inflight/requested index instant.
|
void |
HoodieActiveTimeline.saveToPendingReplaceCommit(HoodieInstant instant,
Option<byte[]> content)
Saves content for requested REPLACE instant.
|
void |
HoodieActiveTimeline.saveToRestoreRequested(HoodieInstant instant,
Option<byte[]> content) |
void |
HoodieActiveTimeline.saveToRollbackRequested(HoodieInstant instant,
Option<byte[]> content) |
HoodieInstant |
HoodieActiveTimeline.transitionCleanInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Clean State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionCleanRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition Clean State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionCompactionInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Compaction State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionCompactionRequestedToInflight(HoodieInstant requestedInstant)
Transition Compaction State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionIndexInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition index instant state from inflight to completed.
|
HoodieInstant |
HoodieActiveTimeline.transitionIndexRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition index instant state from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionLogCompactionInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Log Compaction State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionLogCompactionRequestedToInflight(HoodieInstant requestedInstant)
Transition LogCompaction State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionReplaceInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition replace inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionReplaceRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition replace requested file to replace inflight.
|
void |
HoodieActiveTimeline.transitionRequestedToInflight(HoodieInstant requested,
Option<byte[]> content) |
void |
HoodieActiveTimeline.transitionRequestedToInflight(HoodieInstant requested,
Option<byte[]> content,
boolean allowRedundantTransitions) |
HoodieInstant |
HoodieActiveTimeline.transitionRestoreRequestedToInflight(HoodieInstant requestedInstant)
Transition Restore State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionRollbackInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Rollback State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionRollbackRequestedToInflight(HoodieInstant requestedInstant)
Transition Rollback State from requested to inflight.
|
protected void |
HoodieActiveTimeline.transitionState(HoodieInstant fromInstant,
HoodieInstant toInstant,
Option<byte[]> data,
boolean allowRedundantTransitions) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieRestoreMetadata |
TimelineMetadataUtils.convertRestoreMetadata(String startRestoreTime,
long durationInMs,
List<HoodieInstant> instants,
Map<String,List<HoodieRollbackMetadata>> instantToRollbackMetadata) |
static HoodieRollbackMetadata |
TimelineMetadataUtils.convertRollbackMetadata(String startRollbackTime,
Option<Long> durationInMs,
List<HoodieInstant> instants,
List<HoodieRollbackStat> rollbackStats) |
HoodieTimeline |
HoodieDefaultTimeline.filter(Predicate<HoodieInstant> filter) |
HoodieTimeline |
HoodieTimeline.filter(Predicate<HoodieInstant> filter)
Custom Filter of Instants.
|
abstract Stream<HoodieInstant> |
TimelineLayout.filterHoodieInstants(Stream<HoodieInstant> instantStream) |
void |
HoodieDefaultTimeline.setInstants(List<HoodieInstant> instants) |
| Constructor and Description |
|---|
HoodieDefaultTimeline(Stream<HoodieInstant> instants,
Function<HoodieInstant,Option<byte[]>> details) |
HoodieDefaultTimeline(Stream<HoodieInstant> instants,
Function<HoodieInstant,Option<byte[]>> details) |
TimelineDiffResult(List<HoodieInstant> newlySeenInstants,
List<HoodieInstant> finishedCompactionInstants,
List<HoodieInstant> finishedOrRemovedLogCompactionInstants,
boolean canSyncIncrementally) |
TimelineDiffResult(List<HoodieInstant> newlySeenInstants,
List<HoodieInstant> finishedCompactionInstants,
List<HoodieInstant> finishedOrRemovedLogCompactionInstants,
boolean canSyncIncrementally) |
TimelineDiffResult(List<HoodieInstant> newlySeenInstants,
List<HoodieInstant> finishedCompactionInstants,
List<HoodieInstant> finishedOrRemovedLogCompactionInstants,
boolean canSyncIncrementally) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieInstant |
InstantDTO.toInstant(InstantDTO dto) |
| Modifier and Type | Method and Description |
|---|---|
static Pair<HoodieFileGroupId,HoodieInstant> |
ClusteringOpDTO.toClusteringOperation(ClusteringOpDTO dto) |
| Modifier and Type | Method and Description |
|---|---|
static ClusteringOpDTO |
ClusteringOpDTO.fromClusteringOp(HoodieFileGroupId fileGroupId,
HoodieInstant instant) |
static InstantDTO |
InstantDTO.fromInstant(HoodieInstant instant) |
| Modifier and Type | Field and Description |
|---|---|
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.fgIdToPendingClustering
Track file groups in pending clustering.
|
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.fgIdToReplaceInstants
Track replace time for replaced file groups.
|
| Modifier and Type | Method and Description |
|---|---|
protected void |
HoodieTableFileSystemView.addReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected void |
RocksDbBasedFileSystemView.addReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected abstract void |
AbstractTableFileSystemView.addReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups)
Track instant time for new file groups replaced.
|
protected Map<HoodieFileGroupId,HoodieInstant> |
SpillableMapBasedFileSystemView.createFileIdToPendingClusteringMap(Map<HoodieFileGroupId,HoodieInstant> fileGroupsInClustering) |
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.createFileIdToPendingClusteringMap(Map<HoodieFileGroupId,HoodieInstant> fileGroupsInClustering) |
protected Map<HoodieFileGroupId,HoodieInstant> |
SpillableMapBasedFileSystemView.createFileIdToReplaceInstantMap(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.createFileIdToReplaceInstantMap(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected void |
HoodieTableFileSystemView.resetReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected void |
RocksDbBasedFileSystemView.resetReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected abstract void |
AbstractTableFileSystemView.resetReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups)
Track instant time for file groups replaced.
|
| Modifier and Type | Method and Description |
|---|---|
static Map<HoodieFileGroupId,HoodieInstant> |
ClusteringUtils.getAllFileGroupsInPendingClusteringPlans(HoodieTableMetaClient metaClient)
Get filegroups to pending clustering instant mapping for all pending clustering plans.
|
static Stream<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getAllPendingClusteringPlans(HoodieTableMetaClient metaClient)
Get all pending clustering plans along with their instants.
|
static List<Pair<HoodieInstant,HoodieCompactionPlan>> |
CompactionUtils.getAllPendingCompactionPlans(HoodieTableMetaClient metaClient)
Get all pending compaction plans along with their instants.
|
static List<Pair<HoodieInstant,HoodieCompactionPlan>> |
CompactionUtils.getAllPendingLogCompactionPlans(HoodieTableMetaClient metaClient)
Get all pending logcompaction plans along with their instants.
|
static Option<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getClusteringPlan(HoodieTableMetaClient metaClient,
HoodieInstant pendingReplaceInstant)
Get Clustering plan from timeline.
|
static Option<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getClusteringPlan(HoodieTimeline timeline,
HoodieInstant pendingReplaceInstant)
Get Clustering plan from timeline.
|
static Option<Pair<HoodieTimeline,HoodieInstant>> |
CompactionUtils.getDeltaCommitsSinceLatestCompaction(HoodieActiveTimeline activeTimeline)
Returns a pair of (timeline containing the delta commits after the latest completed
compaction commit, the completed compaction commit instant), if the latest completed
compaction commit is present; a pair of (timeline containing all the delta commits,
the first delta commit instant), if there is no completed compaction commit.
|
static Option<Pair<HoodieTimeline,HoodieInstant>> |
CompactionUtils.getDeltaCommitsSinceLatestCompactionRequest(HoodieActiveTimeline activeTimeline) |
static Option<HoodieInstant> |
CleanerUtils.getEarliestCommitToRetain(HoodieTimeline commitsTimeline,
HoodieCleaningPolicy cleaningPolicy,
int commitsRetained,
Instant latestInstant,
int hoursRetained,
HoodieTimelineTimeZone timeZone) |
static Stream<Pair<HoodieFileGroupId,HoodieInstant>> |
ClusteringUtils.getFileGroupsInPendingClusteringInstant(HoodieInstant instant,
HoodieClusteringPlan clusteringPlan) |
static Option<HoodieInstant> |
ClusteringUtils.getOldestInstantToRetainForClustering(HoodieActiveTimeline activeTimeline,
HoodieTableMetaClient metaClient)
Returns the oldest instant to retain.
|
static Option<HoodieInstant> |
CompactionUtils.getOldestInstantToRetainForCompaction(HoodieActiveTimeline activeTimeline,
int maxDeltaCommits)
Gets the oldest instant to retain for MOR compaction.
|
static List<HoodieInstant> |
ClusteringUtils.getPendingClusteringInstantTimes(HoodieTableMetaClient metaClient) |
static List<HoodieInstant> |
CompactionUtils.getPendingCompactionInstantTimes(HoodieTableMetaClient metaClient)
Return all pending compaction instant times.
|
| Modifier and Type | Method and Description |
|---|---|
static HoodieCleanMetadata |
CleanerUtils.getCleanerMetadata(HoodieTableMetaClient metaClient,
HoodieInstant cleanInstant)
Get Latest Version of Hoodie Cleaner Metadata - Output of cleaner operation.
|
static HoodieCleanerPlan |
CleanerUtils.getCleanerPlan(HoodieTableMetaClient metaClient,
HoodieInstant cleanInstant)
Get Latest version of cleaner plan corresponding to a clean instant.
|
static Option<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getClusteringPlan(HoodieTableMetaClient metaClient,
HoodieInstant pendingReplaceInstant)
Get Clustering plan from timeline.
|
static Option<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getClusteringPlan(HoodieTimeline timeline,
HoodieInstant pendingReplaceInstant)
Get Clustering plan from timeline.
|
static Stream<Pair<HoodieFileGroupId,HoodieInstant>> |
ClusteringUtils.getFileGroupsInPendingClusteringInstant(HoodieInstant instant,
HoodieClusteringPlan clusteringPlan) |
static Stream<Pair<HoodieFileGroupId,Pair<String,HoodieCompactionOperation>>> |
CompactionUtils.getPendingCompactionOperations(HoodieInstant instant,
HoodieCompactionPlan compactionPlan)
Get pending compaction operations for both major and minor compaction.
|
static boolean |
ClusteringUtils.isClusteringInstant(HoodieTimeline timeline,
HoodieInstant replaceInstant)
Checks if the requested, inflight, or completed instant of replacecommit action
is a clustering operation, by checking whether the requested instant contains
a clustering plan.
|
static boolean |
ClusteringUtils.isCompletedClusteringInstant(HoodieInstant instant,
HoodieTimeline timeline) |
| Modifier and Type | Method and Description |
|---|---|
static Map<HoodieFileGroupId,Pair<String,HoodieCompactionOperation>> |
CompactionUtils.getAllPendingCompactionOperationsInPendingCompactionPlans(List<Pair<HoodieInstant,HoodieCompactionPlan>> pendingLogCompactionPlanWithInstants)
Get all partition + file Ids with pending Log Compaction operations and their target log compaction instant time.
|
static boolean |
MarkerUtils.hasCommitConflict(HoodieActiveTimeline activeTimeline,
Set<String> currentFileIDs,
Set<HoodieInstant> completedCommitInstants)
Whether there is write conflict with completed commit among multiple writers.
|
| Modifier and Type | Method and Description |
|---|---|
static boolean |
HoodieTableMetadataUtil.isValidInstant(HoodieInstant instant)
Checks if the Instant is a delta commit and has a valid suffix for operations on MDT.
|
Copyright © 2024 The Apache Software Foundation. All rights reserved.