| Modifier and Type | Method and Description |
|---|---|
protected HoodieTimeline |
BaseHoodieTableFileIndex.getActiveTimeline() |
| Modifier and Type | Method and Description |
|---|---|
HoodieTimeline |
HoodieFileGroup.getTimeline() |
| Constructor and Description |
|---|
HoodieFileGroup(HoodieFileGroupId fileGroupId,
HoodieTimeline timeline) |
HoodieFileGroup(String partitionPath,
String id,
HoodieTimeline timeline) |
| Modifier and Type | Method and Description |
|---|---|
HoodieTimeline |
HoodieTableMetaClient.getCommitsAndCompactionTimeline()
Get the commit + pending-compaction timeline visible for this table.
|
HoodieTimeline |
HoodieTableMetaClient.getCommitsTimeline()
Get the commit timeline visible for this table.
|
HoodieTimeline |
HoodieTableMetaClient.getCommitTimeline()
Get the compacted commit timeline visible for this table.
|
| Modifier and Type | Class and Description |
|---|---|
class |
HoodieActiveTimeline
Represents the Active Timeline for the Hoodie table.
|
class |
HoodieArchivedTimeline
Represents the Archived Timeline for the Hoodie table.
|
class |
HoodieDefaultTimeline
HoodieDefaultTimeline is a default implementation of the HoodieTimeline.
|
| Modifier and Type | Method and Description |
|---|---|
HoodieTimeline |
HoodieDefaultTimeline.filter(Predicate<HoodieInstant> filter) |
HoodieTimeline |
HoodieTimeline.filter(Predicate<HoodieInstant> filter)
Custom Filter of Instants.
|
HoodieTimeline |
HoodieDefaultTimeline.filterCompletedAndCompactionInstants() |
HoodieTimeline |
HoodieTimeline.filterCompletedAndCompactionInstants()
Filter this timeline to just include the completed + compaction (inflight + requested) instants A RT filesystem
view is constructed with this timeline so that file-slice after pending compaction-requested instant-time is also
considered valid.
|
HoodieTimeline |
HoodieDefaultTimeline.filterCompletedIndexTimeline() |
HoodieTimeline |
HoodieTimeline.filterCompletedIndexTimeline()
Filter this timeline to just include completed index instants.
|
HoodieTimeline |
HoodieDefaultTimeline.filterCompletedInstants() |
HoodieTimeline |
HoodieTimeline.filterCompletedInstants()
Filter this timeline to just include the completed instants.
|
HoodieTimeline |
HoodieDefaultTimeline.filterInflights() |
HoodieTimeline |
HoodieTimeline.filterInflights()
Filter this timeline to just include the in-flights.
|
HoodieTimeline |
HoodieDefaultTimeline.filterInflightsAndRequested() |
HoodieTimeline |
HoodieTimeline.filterInflightsAndRequested()
Filter this timeline to include requested and in-flights.
|
HoodieTimeline |
HoodieDefaultTimeline.filterPendingCompactionTimeline() |
HoodieTimeline |
HoodieTimeline.filterPendingCompactionTimeline()
Filter this timeline to just include requested and inflight compaction instants.
|
HoodieTimeline |
HoodieDefaultTimeline.filterPendingExcludingCompaction() |
HoodieTimeline |
HoodieTimeline.filterPendingExcludingCompaction()
Filter this timeline to just include the in-flights excluding compaction instants.
|
HoodieTimeline |
HoodieDefaultTimeline.filterPendingIndexTimeline() |
HoodieTimeline |
HoodieTimeline.filterPendingIndexTimeline()
Filter this timeline to just include requested and inflight index instants.
|
HoodieTimeline |
HoodieDefaultTimeline.filterPendingReplaceTimeline() |
HoodieTimeline |
HoodieTimeline.filterPendingReplaceTimeline()
Filter this timeline to just include requested and inflight replacecommit instants.
|
HoodieTimeline |
HoodieDefaultTimeline.filterPendingRollbackTimeline() |
HoodieTimeline |
HoodieTimeline.filterPendingRollbackTimeline()
Filter this timeline to include pending rollbacks.
|
HoodieTimeline |
HoodieDefaultTimeline.findInstantsAfter(String instantTime) |
HoodieTimeline |
HoodieTimeline.findInstantsAfter(String instantTime)
Create a new Timeline with all the instants after startTs.
|
HoodieTimeline |
HoodieTimeline.findInstantsAfter(String instantTime,
int numCommits)
Create a new Timeline with all the instants after startTs.
|
HoodieTimeline |
HoodieTimeline.findInstantsAfterOrEquals(String commitTime,
int numCommits)
Create a new Timeline with all the instants after startTs.
|
HoodieTimeline |
HoodieTimeline.findInstantsBefore(String instantTime)
Create a new Timeline with all instants before specified time.
|
HoodieTimeline |
HoodieTimeline.findInstantsBeforeOrEquals(String instantTime)
Create new timeline with all instants before or equals specified time.
|
HoodieTimeline |
HoodieTimeline.findInstantsInRange(String startTs,
String endTs)
Create a new Timeline with instants after startTs and before or on endTs.
|
HoodieTimeline |
HoodieDefaultTimeline.getAllCommitsTimeline()
Get all instants (commits, delta commits, compaction, clean, savepoint, rollback, replace commits, index) that result in actions,
in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getCleanerTimeline()
Get only the cleaner action (inflight and completed) in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getCommitsTimeline()
Get all instants (commits, delta commits) that produce new data, in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getCommitTimeline()
Get only pure commits (inflight and completed) in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getCompletedReplaceTimeline() |
HoodieTimeline |
HoodieTimeline.getCompletedReplaceTimeline()
Timeline to just include replace instants that have valid (commit/deltacommit) actions.
|
HoodieTimeline |
HoodieDefaultTimeline.getContiguousCompletedWriteTimeline() |
HoodieTimeline |
HoodieTimeline.getContiguousCompletedWriteTimeline()
Timeline to just include commits (commit/deltacommit), compaction and replace actions that are completed and contiguous.
|
HoodieTimeline |
HoodieDefaultTimeline.getDeltaCommitTimeline()
Get only the delta commits (inflight and completed) in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getRestoreTimeline()
Get only the restore action (inflight and completed) in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getRollbackAndRestoreTimeline()
Get only the rollback and restore action (inflight and completed) in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getRollbackTimeline()
Get only the rollback action (inflight and completed) in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getSavePointTimeline()
Get only the save point action (inflight and completed) in the active timeline.
|
HoodieTimeline |
HoodieDefaultTimeline.getTimelineOfActions(Set<String> actions)
Get a timeline of a specific set of actions.
|
HoodieTimeline |
HoodieTimeline.getWriteTimeline()
Timeline to just include commits (commit/deltacommit), compaction and replace actions.
|
| Modifier and Type | Method and Description |
|---|---|
static List<String> |
TimelineUtils.getAffectedPartitions(HoodieTimeline timeline)
Returns partitions that have been modified including internal operations such as clean in the passed timeline.
|
static List<String> |
TimelineUtils.getDroppedPartitions(HoodieTimeline timeline)
Returns partitions that have been deleted or marked for deletion in the given timeline.
|
static TimelineDiffHelper.TimelineDiffResult |
TimelineDiffHelper.getNewInstantsForIncrementalSync(HoodieTimeline oldTimeline,
HoodieTimeline newTimeline) |
static List<String> |
TimelineUtils.getWrittenPartitions(HoodieTimeline timeline)
Returns partitions that have new data strictly after commitTime.
|
| Modifier and Type | Method and Description |
|---|---|
static HoodieTimeline |
TimelineDTO.toTimeline(TimelineDTO dto,
HoodieTableMetaClient metaClient) |
| Modifier and Type | Method and Description |
|---|---|
static TimelineDTO |
TimelineDTO.fromTimeline(HoodieTimeline timeline) |
| Modifier and Type | Method and Description |
|---|---|
HoodieTimeline |
TableFileSystemView.getTimeline()
Timeline corresponding to the view.
|
HoodieTimeline |
IncrementalTimelineSyncFileSystemView.getTimeline() |
HoodieTimeline |
AbstractTableFileSystemView.getTimeline() |
HoodieTimeline |
PriorityBasedFileSystemView.getTimeline() |
HoodieTimeline |
RemoteHoodieTableFileSystemView.getTimeline() |
HoodieTimeline |
AbstractTableFileSystemView.getVisibleCommitsAndCompactionTimeline()
Return Only Commits and Compaction timeline for building file-groups.
|
| Modifier and Type | Method and Description |
|---|---|
protected List<HoodieFileGroup> |
AbstractTableFileSystemView.buildFileGroups(org.apache.hadoop.fs.FileStatus[] statuses,
HoodieTimeline timeline,
boolean addPendingCompactionFileSlice)
Build FileGroups from passed in file-status.
|
protected List<HoodieFileGroup> |
AbstractTableFileSystemView.buildFileGroups(Stream<HoodieBaseFile> baseFileStream,
Stream<HoodieLogFile> logFileStream,
HoodieTimeline timeline,
boolean addPendingCompactionFileSlice) |
static HoodieTableFileSystemView |
FileSystemViewManager.createInMemoryFileSystemViewWithTimeline(HoodieEngineContext engineContext,
HoodieTableMetaClient metaClient,
HoodieMetadataConfig metadataConfig,
HoodieTimeline timeline) |
void |
HoodieTableFileSystemView.init(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline) |
protected void |
RocksDbBasedFileSystemView.init(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline) |
protected void |
AbstractTableFileSystemView.init(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline)
Initialize the view.
|
void |
HoodieTableFileSystemView.init(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
org.apache.hadoop.fs.FileStatus[] fileStatuses) |
protected void |
IncrementalTimelineSyncFileSystemView.refreshTimeline(HoodieTimeline visibleActiveTimeline) |
protected void |
AbstractTableFileSystemView.refreshTimeline(HoodieTimeline visibleActiveTimeline)
Refresh commits timeline.
|
protected void |
IncrementalTimelineSyncFileSystemView.runSync(HoodieTimeline oldTimeline,
HoodieTimeline newTimeline) |
protected void |
AbstractTableFileSystemView.runSync(HoodieTimeline oldTimeline,
HoodieTimeline newTimeline)
Performs complete reset of file-system view.
|
| Constructor and Description |
|---|
HoodieTableFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline)
Create a file system view, as of the given timeline.
|
HoodieTableFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
boolean enableIncrementalTimelineSync)
Create a file system view, as of the given timeline.
|
HoodieTableFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
org.apache.hadoop.fs.FileStatus[] fileStatuses)
Create a file system view, as of the given timeline, with the provided file statuses.
|
RocksDbBasedFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
org.apache.hadoop.fs.FileStatus[] fileStatuses,
FileSystemViewStorageConfig config) |
RocksDbBasedFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
FileSystemViewStorageConfig config) |
SpillableMapBasedFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
org.apache.hadoop.fs.FileStatus[] fileStatuses,
FileSystemViewStorageConfig config,
HoodieCommonConfig commonConfig) |
SpillableMapBasedFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
FileSystemViewStorageConfig config,
HoodieCommonConfig commonConfig) |
| Modifier and Type | Method and Description |
|---|---|
static Option<Pair<HoodieTimeline,HoodieInstant>> |
CompactionUtils.getDeltaCommitsSinceLatestCompaction(HoodieActiveTimeline activeTimeline)
Returns a pair of (timeline containing the delta commits after the latest completed
compaction commit, the completed compaction commit instant), if the latest completed
compaction commit is present; a pair of (timeline containing all the delta commits,
the first delta commit instant), if there is no completed compaction commit.
|
static Option<Pair<HoodieTimeline,HoodieInstant>> |
CompactionUtils.getDeltaCommitsSinceLatestCompactionRequest(HoodieActiveTimeline activeTimeline) |
| Modifier and Type | Method and Description |
|---|---|
static Option<HoodieCommitMetadata> |
CommitUtils.getLatestCommitMetadataWithValidCheckpointInfo(HoodieTimeline timeline,
String checkpointKey)
Process previous commits metadata in the timeline to determine the checkpoint given a checkpoint key.
|
| Constructor and Description |
|---|
HoodieMetadataFileSystemView(HoodieEngineContext engineContext,
HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
HoodieMetadataConfig metadataConfig) |
HoodieMetadataFileSystemView(HoodieTableMetaClient metaClient,
HoodieTimeline visibleActiveTimeline,
HoodieTableMetadata tableMetadata) |
Copyright © 2022 The Apache Software Foundation. All rights reserved.