| Modifier and Type | Method and Description |
|---|---|
Option<HoodieInstant> |
BaseHoodieTableFileIndex.getLatestCompletedInstant()
Returns latest completed instant as seen by this instance of the file-index
|
| Modifier and Type | Method and Description |
|---|---|
HoodieInstant |
HoodiePendingRollbackInfo.getRollbackInstant() |
| Modifier and Type | Method and Description |
|---|---|
HoodieCleanStat.Builder |
HoodieCleanStat.Builder.withEarliestCommitRetained(Option<HoodieInstant> earliestCommitToRetain) |
| Constructor and Description |
|---|
HoodiePendingRollbackInfo(HoodieInstant rollbackInstant,
HoodieRollbackPlan rollbackPlan) |
| Modifier and Type | Method and Description |
|---|---|
List<HoodieInstant> |
HoodieTableMetaClient.scanHoodieInstantsFromFileSystem(org.apache.hadoop.fs.Path timelinePath,
Set<String> includedExtensions,
boolean applyLayoutVersionFilters)
Helper method to scan all hoodie-instant metafiles and construct HoodieInstant objects.
|
List<HoodieInstant> |
HoodieTableMetaClient.scanHoodieInstantsFromFileSystem(Set<String> includedExtensions,
boolean applyLayoutVersionFilters)
Helper method to scan all hoodie-instant metafiles and construct HoodieInstant objects.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.avro.Schema |
TableSchemaResolver.getTableAvroSchema(HoodieInstant instant,
boolean includeMetadataFields)
Fetches tables schema in Avro format as of the given instant
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.parquet.schema.MessageType |
TableSchemaResolver.readSchemaFromLastCompaction(Option<HoodieInstant> lastCompactionCommitOpt)
Deprecated.
please use
TableSchemaResolver.getTableAvroSchema(HoodieInstant, boolean) instead |
| Modifier and Type | Field and Description |
|---|---|
static Comparator<HoodieInstant> |
HoodieInstant.ACTION_COMPARATOR |
static Comparator<HoodieInstant> |
HoodieInstant.COMPARATOR |
protected Function<HoodieInstant,Option<byte[]>> |
HoodieDefaultTimeline.details |
| Modifier and Type | Method and Description |
|---|---|
static HoodieInstant |
HoodieTimeline.getCleanInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getCleanRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getCompactionInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getCompactionRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getCompletedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getIndexInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getIndexRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getInflightInstant(HoodieInstant instant,
HoodieTableType tableType)
Returns the inflight instant corresponding to the instant being passed.
|
static HoodieInstant |
HoodieTimeline.getReplaceCommitInflightInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getReplaceCommitRequestedInstant(String timestamp) |
static HoodieInstant |
HoodieTimeline.getRequestedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getRollbackRequestedInstant(HoodieInstant instant) |
HoodieInstant |
HoodieActiveTimeline.revertIndexInflightToRequested(HoodieInstant inflightInstant)
Revert index instant state from inflight to requested.
|
HoodieInstant |
HoodieActiveTimeline.revertInstantFromInflightToRequested(HoodieInstant inflightInstant)
Revert instant state from inflight to requested.
|
HoodieInstant |
HoodieActiveTimeline.revertToInflight(HoodieInstant instant) |
HoodieInstant |
HoodieActiveTimeline.transitionCleanInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Clean State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionCleanRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition Clean State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionCompactionInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Compaction State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionCompactionRequestedToInflight(HoodieInstant requestedInstant)
Transition Compaction State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionIndexInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition index instant state from inflight to completed.
|
HoodieInstant |
HoodieActiveTimeline.transitionIndexRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition index instant state from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionReplaceInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition replace inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionReplaceRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition replace requested file to replace inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionRestoreRequestedToInflight(HoodieInstant requestedInstant)
Transition Restore State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionRollbackInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Rollback State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionRollbackRequestedToInflight(HoodieInstant requestedInstant)
Transition Rollback State from requested to inflight.
|
| Modifier and Type | Method and Description |
|---|---|
int |
HoodieInstant.compareTo(HoodieInstant o) |
boolean |
HoodieDefaultTimeline.containsInstant(HoodieInstant instant) |
boolean |
HoodieTimeline.containsInstant(HoodieInstant instant) |
void |
HoodieActiveTimeline.createNewInstant(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteCompactionRequested(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteCompletedRollback(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteEmptyInstantIfExists(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteInflight(HoodieInstant instant) |
static void |
HoodieActiveTimeline.deleteInstantFile(org.apache.hadoop.fs.FileSystem fs,
String metaPath,
HoodieInstant instant) |
protected void |
HoodieActiveTimeline.deleteInstantFile(HoodieInstant instant) |
void |
HoodieActiveTimeline.deleteInstantFileIfExists(HoodieInstant instant) |
void |
HoodieActiveTimeline.deletePending(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getCompletedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getInflightInstant(HoodieInstant instant,
HoodieTableType tableType)
Returns the inflight instant corresponding to the instant being passed.
|
Option<byte[]> |
HoodieActiveTimeline.getInstantDetails(HoodieInstant instant) |
Option<byte[]> |
HoodieDefaultTimeline.getInstantDetails(HoodieInstant instant) |
Option<byte[]> |
HoodieTimeline.getInstantDetails(HoodieInstant instant)
Read the completed instant details.
|
Option<byte[]> |
HoodieArchivedTimeline.getInstantDetails(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getRequestedInstant(HoodieInstant instant) |
static HoodieInstant |
HoodieTimeline.getRollbackRequestedInstant(HoodieInstant instant) |
static boolean |
TimelineUtils.isClusteringCommit(HoodieTableMetaClient metaClient,
HoodieInstant instant) |
boolean |
HoodieDefaultTimeline.isEmpty(HoodieInstant instant) |
boolean |
HoodieTimeline.isEmpty(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readCleanerInfoAsBytes(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readCompactionPlanAsBytes(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readIndexPlanAsBytes(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readRestoreInfoAsBytes(HoodieInstant instant) |
Option<byte[]> |
HoodieActiveTimeline.readRollbackInfoAsBytes(HoodieInstant instant) |
protected void |
HoodieActiveTimeline.revertCompleteToInflight(HoodieInstant completed,
HoodieInstant inflight) |
HoodieInstant |
HoodieActiveTimeline.revertIndexInflightToRequested(HoodieInstant inflightInstant)
Revert index instant state from inflight to requested.
|
HoodieInstant |
HoodieActiveTimeline.revertInstantFromInflightToRequested(HoodieInstant inflightInstant)
Revert instant state from inflight to requested.
|
HoodieInstant |
HoodieActiveTimeline.revertToInflight(HoodieInstant instant) |
void |
HoodieActiveTimeline.saveAsComplete(HoodieInstant instant,
Option<byte[]> data) |
void |
HoodieActiveTimeline.saveToCleanRequested(HoodieInstant instant,
Option<byte[]> content) |
void |
HoodieActiveTimeline.saveToCompactionRequested(HoodieInstant instant,
Option<byte[]> content) |
void |
HoodieActiveTimeline.saveToCompactionRequested(HoodieInstant instant,
Option<byte[]> content,
boolean overwrite) |
void |
HoodieActiveTimeline.saveToPendingIndexAction(HoodieInstant instant,
Option<byte[]> content)
Save content for inflight/requested index instant.
|
void |
HoodieActiveTimeline.saveToPendingReplaceCommit(HoodieInstant instant,
Option<byte[]> content)
Saves content for requested REPLACE instant.
|
void |
HoodieActiveTimeline.saveToRestoreRequested(HoodieInstant instant,
Option<byte[]> content) |
void |
HoodieActiveTimeline.saveToRollbackRequested(HoodieInstant instant,
Option<byte[]> content) |
HoodieInstant |
HoodieActiveTimeline.transitionCleanInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Clean State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionCleanRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition Clean State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionCompactionInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Compaction State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionCompactionRequestedToInflight(HoodieInstant requestedInstant)
Transition Compaction State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionIndexInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition index instant state from inflight to completed.
|
HoodieInstant |
HoodieActiveTimeline.transitionIndexRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition index instant state from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionReplaceInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition replace inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionReplaceRequestedToInflight(HoodieInstant requestedInstant,
Option<byte[]> data)
Transition replace requested file to replace inflight.
|
void |
HoodieActiveTimeline.transitionRequestedToInflight(HoodieInstant requested,
Option<byte[]> content) |
void |
HoodieActiveTimeline.transitionRequestedToInflight(HoodieInstant requested,
Option<byte[]> content,
boolean allowRedundantTransitions) |
HoodieInstant |
HoodieActiveTimeline.transitionRestoreRequestedToInflight(HoodieInstant requestedInstant)
Transition Restore State from requested to inflight.
|
HoodieInstant |
HoodieActiveTimeline.transitionRollbackInflightToComplete(HoodieInstant inflightInstant,
Option<byte[]> data)
Transition Rollback State from inflight to Committed.
|
HoodieInstant |
HoodieActiveTimeline.transitionRollbackRequestedToInflight(HoodieInstant requestedInstant)
Transition Rollback State from requested to inflight.
|
protected void |
HoodieActiveTimeline.transitionState(HoodieInstant fromInstant,
HoodieInstant toInstant,
Option<byte[]> data,
boolean allowRedundantTransitions) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieRestoreMetadata |
TimelineMetadataUtils.convertRestoreMetadata(String startRestoreTime,
long durationInMs,
List<HoodieInstant> instants,
Map<String,List<HoodieRollbackMetadata>> instantToRollbackMetadata) |
static HoodieRollbackMetadata |
TimelineMetadataUtils.convertRollbackMetadata(String startRollbackTime,
Option<Long> durationInMs,
List<HoodieInstant> instants,
List<HoodieRollbackStat> rollbackStats) |
HoodieTimeline |
HoodieDefaultTimeline.filter(Predicate<HoodieInstant> filter) |
HoodieTimeline |
HoodieTimeline.filter(Predicate<HoodieInstant> filter)
Custom Filter of Instants.
|
abstract Stream<HoodieInstant> |
TimelineLayout.filterHoodieInstants(Stream<HoodieInstant> instantStream) |
void |
HoodieDefaultTimeline.setInstants(List<HoodieInstant> instants) |
| Constructor and Description |
|---|
HoodieDefaultTimeline(Stream<HoodieInstant> instants,
Function<HoodieInstant,Option<byte[]>> details) |
HoodieDefaultTimeline(Stream<HoodieInstant> instants,
Function<HoodieInstant,Option<byte[]>> details) |
TimelineDiffResult(List<HoodieInstant> newlySeenInstants,
List<HoodieInstant> finishedCompactionInstants,
boolean canSyncIncrementally) |
TimelineDiffResult(List<HoodieInstant> newlySeenInstants,
List<HoodieInstant> finishedCompactionInstants,
boolean canSyncIncrementally) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieInstant |
InstantDTO.toInstant(InstantDTO dto) |
| Modifier and Type | Method and Description |
|---|---|
static Pair<HoodieFileGroupId,HoodieInstant> |
ClusteringOpDTO.toClusteringOperation(ClusteringOpDTO dto) |
| Modifier and Type | Method and Description |
|---|---|
static ClusteringOpDTO |
ClusteringOpDTO.fromClusteringOp(HoodieFileGroupId fileGroupId,
HoodieInstant instant) |
static InstantDTO |
InstantDTO.fromInstant(HoodieInstant instant) |
| Modifier and Type | Field and Description |
|---|---|
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.fgIdToPendingClustering
Track file groups in pending clustering.
|
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.fgIdToReplaceInstants
Track replace time for replaced file groups.
|
| Modifier and Type | Method and Description |
|---|---|
protected void |
HoodieTableFileSystemView.addReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected void |
RocksDbBasedFileSystemView.addReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected abstract void |
AbstractTableFileSystemView.addReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups)
Track instant time for new file groups replaced.
|
protected Map<HoodieFileGroupId,HoodieInstant> |
SpillableMapBasedFileSystemView.createFileIdToPendingClusteringMap(Map<HoodieFileGroupId,HoodieInstant> fileGroupsInClustering) |
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.createFileIdToPendingClusteringMap(Map<HoodieFileGroupId,HoodieInstant> fileGroupsInClustering) |
protected Map<HoodieFileGroupId,HoodieInstant> |
SpillableMapBasedFileSystemView.createFileIdToReplaceInstantMap(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.createFileIdToReplaceInstantMap(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected void |
HoodieTableFileSystemView.resetReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected void |
RocksDbBasedFileSystemView.resetReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups) |
protected abstract void |
AbstractTableFileSystemView.resetReplacedFileGroups(Map<HoodieFileGroupId,HoodieInstant> replacedFileGroups)
Track instant time for file groups replaced.
|
| Modifier and Type | Method and Description |
|---|---|
static Map<HoodieFileGroupId,HoodieInstant> |
ClusteringUtils.getAllFileGroupsInPendingClusteringPlans(HoodieTableMetaClient metaClient)
Get filegroups to pending clustering instant mapping for all pending clustering plans.
|
static Stream<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getAllPendingClusteringPlans(HoodieTableMetaClient metaClient)
Get all pending clustering plans along with their instants.
|
static List<Pair<HoodieInstant,HoodieCompactionPlan>> |
CompactionUtils.getAllPendingCompactionPlans(HoodieTableMetaClient metaClient)
Get all pending compaction plans along with their instants.
|
static Option<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getClusteringPlan(HoodieTableMetaClient metaClient,
HoodieInstant pendingReplaceInstant)
Get Clustering plan from timeline.
|
static Option<Pair<HoodieTimeline,HoodieInstant>> |
CompactionUtils.getDeltaCommitsSinceLatestCompaction(HoodieActiveTimeline activeTimeline)
Returns a pair of (timeline containing the delta commits after the latest completed
compaction commit, the completed compaction commit instant), if the latest completed
compaction commit is present; a pair of (timeline containing all the delta commits,
the first delta commit instant), if there is no completed compaction commit.
|
static Option<Pair<HoodieTimeline,HoodieInstant>> |
CompactionUtils.getDeltaCommitsSinceLatestCompactionRequest(HoodieActiveTimeline activeTimeline) |
static Stream<Pair<HoodieFileGroupId,HoodieInstant>> |
ClusteringUtils.getFileGroupsInPendingClusteringInstant(HoodieInstant instant,
HoodieClusteringPlan clusteringPlan) |
static Option<HoodieInstant> |
CompactionUtils.getOldestInstantToRetainForCompaction(HoodieActiveTimeline activeTimeline,
int maxDeltaCommits)
Gets the oldest instant to retain for MOR compaction.
|
static List<HoodieInstant> |
ClusteringUtils.getPendingClusteringInstantTimes(HoodieTableMetaClient metaClient) |
static List<HoodieInstant> |
CompactionUtils.getPendingCompactionInstantTimes(HoodieTableMetaClient metaClient)
Return all pending compaction instant times.
|
| Modifier and Type | Method and Description |
|---|---|
static HoodieCleanMetadata |
CleanerUtils.getCleanerMetadata(HoodieTableMetaClient metaClient,
HoodieInstant cleanInstant)
Get Latest Version of Hoodie Cleaner Metadata - Output of cleaner operation.
|
static HoodieCleanerPlan |
CleanerUtils.getCleanerPlan(HoodieTableMetaClient metaClient,
HoodieInstant cleanInstant)
Get Latest version of cleaner plan corresponding to a clean instant.
|
static Option<Pair<HoodieInstant,HoodieClusteringPlan>> |
ClusteringUtils.getClusteringPlan(HoodieTableMetaClient metaClient,
HoodieInstant pendingReplaceInstant)
Get Clustering plan from timeline.
|
static Stream<Pair<HoodieFileGroupId,HoodieInstant>> |
ClusteringUtils.getFileGroupsInPendingClusteringInstant(HoodieInstant instant,
HoodieClusteringPlan clusteringPlan) |
static Stream<Pair<HoodieFileGroupId,Pair<String,HoodieCompactionOperation>>> |
CompactionUtils.getPendingCompactionOperations(HoodieInstant instant,
HoodieCompactionPlan compactionPlan) |
static boolean |
ClusteringUtils.isPendingClusteringInstant(HoodieTableMetaClient metaClient,
HoodieInstant instant) |
Copyright © 2022 The Apache Software Foundation. All rights reserved.