| Modifier and Type | Method and Description |
|---|---|
abstract List<HoodieFileGroupId> |
BootstrapIndex.IndexReader.getIndexedFileGroupIds()
Return list file-ids indexed.
|
abstract Map<HoodieFileGroupId,BootstrapFileMapping> |
BootstrapIndex.IndexReader.getSourceFileMappingForFileIds(List<HoodieFileGroupId> ids)
Lookup Bootstrap index by file group ids.
|
| Modifier and Type | Method and Description |
|---|---|
abstract Map<HoodieFileGroupId,BootstrapFileMapping> |
BootstrapIndex.IndexReader.getSourceFileMappingForFileIds(List<HoodieFileGroupId> ids)
Lookup Bootstrap index by file group ids.
|
| Modifier and Type | Method and Description |
|---|---|
List<HoodieFileGroupId> |
HFileBootstrapIndexReader.getIndexedFileGroupIds() |
Map<HoodieFileGroupId,BootstrapFileMapping> |
HFileBootstrapIndexReader.getSourceFileMappingForFileIds(List<HoodieFileGroupId> ids) |
| Modifier and Type | Method and Description |
|---|---|
Map<HoodieFileGroupId,BootstrapFileMapping> |
HFileBootstrapIndexReader.getSourceFileMappingForFileIds(List<HoodieFileGroupId> ids) |
| Modifier and Type | Method and Description |
|---|---|
HoodieFileGroupId |
BootstrapFileMapping.getFileGroupId() |
HoodieFileGroupId |
CompactionOperation.getFileGroupId() |
HoodieFileGroupId |
BootstrapBaseFileMapping.getFileGroupId() |
HoodieFileGroupId |
HoodieFileGroup.getFileGroupId() |
HoodieFileGroupId |
FileSlice.getFileGroupId() |
| Modifier and Type | Method and Description |
|---|---|
Map<HoodieFileGroupId,String> |
HoodieCommitMetadata.getFileGroupIdAndFullPaths(String basePath) |
| Modifier and Type | Method and Description |
|---|---|
int |
HoodieFileGroupId.compareTo(HoodieFileGroupId o) |
static Option<Pair<String,List<String>>> |
HoodieCommitMetadata.getFileSliceForFileGroupFromDeltaCommit(byte[] bytes,
HoodieFileGroupId fileGroupId)
parse the bytes of deltacommit, and get the base file and the log files belonging to this
provided file group.
|
| Constructor and Description |
|---|
BootstrapBaseFileMapping(HoodieFileGroupId fileGroupId,
HoodieFileStatus bootstrapFileStatus) |
FileSlice(HoodieFileGroupId fileGroupId,
String baseInstantTime) |
FileSlice(HoodieFileGroupId fileGroupId,
String baseInstantTime,
HoodieBaseFile baseFile,
List<HoodieLogFile> logFiles) |
HoodieFileGroup(HoodieFileGroupId fileGroupId,
HoodieTimeline timeline) |
| Modifier and Type | Method and Description |
|---|---|
Map<HoodieFileGroupId,List<HoodieCDCFileSplit>> |
HoodieCDCExtractor.extractCDCFileSplits()
At the granularity of a file group, trace the mapping between
each commit/instant and changes to this file group.
|
| Modifier and Type | Method and Description |
|---|---|
static Pair<HoodieFileGroupId,HoodieInstant> |
ClusteringOpDTO.toClusteringOperation(ClusteringOpDTO dto) |
| Modifier and Type | Method and Description |
|---|---|
static ClusteringOpDTO |
ClusteringOpDTO.fromClusteringOp(HoodieFileGroupId fileGroupId,
HoodieInstant instant) |
| Modifier and Type | Field and Description |
|---|---|
protected Map<HoodieFileGroupId,BootstrapBaseFileMapping> |
HoodieTableFileSystemView.fgIdToBootstrapBaseFile
PartitionPath + File-Id to bootstrap base File (Index Only bootstrapped).
|
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.fgIdToPendingClustering
Track file groups in pending clustering.
|
protected Map<HoodieFileGroupId,Pair<String,CompactionOperation>> |
HoodieTableFileSystemView.fgIdToPendingCompaction
PartitionPath + File-Id to pending compaction instant time.
|
protected Map<HoodieFileGroupId,Pair<String,CompactionOperation>> |
HoodieTableFileSystemView.fgIdToPendingLogCompaction
PartitionPath + File-Id to pending logcompaction instant time.
|
protected Map<HoodieFileGroupId,HoodieInstant> |
HoodieTableFileSystemView.fgIdToReplaceInstants
Track replace time for replaced file groups.
|
| Modifier and Type | Method and Description |
|---|---|
protected HoodieBaseFile |
AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(HoodieFileGroupId fileGroupId,
HoodieBaseFile baseFile) |
protected HoodieBaseFile |
AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(HoodieFileGroupId fileGroupId,
HoodieBaseFile baseFile,
Function<HoodieFileGroupId,Option<BootstrapBaseFileMapping>> bootstrapBaseFileMappingFunc) |
protected Option<BootstrapBaseFileMapping> |
HoodieTableFileSystemView.getBootstrapBaseFile(HoodieFileGroupId fileGroupId) |
protected Option<BootstrapBaseFileMapping> |
RocksDbBasedFileSystemView.getBootstrapBaseFile(HoodieFileGroupId fileGroupId) |
protected abstract Option<BootstrapBaseFileMapping> |
AbstractTableFileSystemView.getBootstrapBaseFile(HoodieFileGroupId fileGroupId)
Return pending compaction operation for a file-group.
|
protected Option<HoodieInstant> |
HoodieTableFileSystemView.getPendingClusteringInstant(HoodieFileGroupId fgId) |
protected Option<HoodieInstant> |
RocksDbBasedFileSystemView.getPendingClusteringInstant(HoodieFileGroupId fgId) |
protected abstract Option<HoodieInstant> |
AbstractTableFileSystemView.getPendingClusteringInstant(HoodieFileGroupId fileGroupId)
Get pending clustering instant time for specified file group.
|
protected Option<Pair<String,CompactionOperation>> |
HoodieTableFileSystemView.getPendingCompactionOperationWithInstant(HoodieFileGroupId fgId) |
protected Option<Pair<String,CompactionOperation>> |
RocksDbBasedFileSystemView.getPendingCompactionOperationWithInstant(HoodieFileGroupId fgId) |
protected abstract Option<Pair<String,CompactionOperation>> |
AbstractTableFileSystemView.getPendingCompactionOperationWithInstant(HoodieFileGroupId fileGroupId)
Return pending compaction operation for a file-group.
|
protected Option<Pair<String,CompactionOperation>> |
HoodieTableFileSystemView.getPendingLogCompactionOperationWithInstant(HoodieFileGroupId fgId) |
protected Option<Pair<String,CompactionOperation>> |
RocksDbBasedFileSystemView.getPendingLogCompactionOperationWithInstant(HoodieFileGroupId fgId) |
protected abstract Option<Pair<String,CompactionOperation>> |
AbstractTableFileSystemView.getPendingLogCompactionOperationWithInstant(HoodieFileGroupId fileGroupId)
Return pending Log compaction operation for a file-group.
|
protected Option<HoodieInstant> |
HoodieTableFileSystemView.getReplaceInstant(HoodieFileGroupId fileGroupId) |
protected Option<HoodieInstant> |
RocksDbBasedFileSystemView.getReplaceInstant(HoodieFileGroupId fileGroupId) |
protected abstract Option<HoodieInstant> |
AbstractTableFileSystemView.getReplaceInstant(HoodieFileGroupId fileGroupId)
Track instant time for file groups replaced.
|
protected boolean |
HoodieTableFileSystemView.isBootstrapBaseFilePresentForFileId(HoodieFileGroupId fgId) |
protected boolean |
RocksDbBasedFileSystemView.isBootstrapBaseFilePresentForFileId(HoodieFileGroupId fgId) |
protected abstract boolean |
AbstractTableFileSystemView.isBootstrapBaseFilePresentForFileId(HoodieFileGroupId fgId)
Check if there is an bootstrap base file present for this file.
|
protected boolean |
HoodieTableFileSystemView.isPendingClusteringScheduledForFileId(HoodieFileGroupId fgId) |
protected boolean |
RocksDbBasedFileSystemView.isPendingClusteringScheduledForFileId(HoodieFileGroupId fgId) |
protected abstract boolean |
AbstractTableFileSystemView.isPendingClusteringScheduledForFileId(HoodieFileGroupId fgId)
Check if there is an outstanding clustering operation (requested/inflight) scheduled for this file.
|
protected boolean |
HoodieTableFileSystemView.isPendingCompactionScheduledForFileId(HoodieFileGroupId fgId) |
protected boolean |
RocksDbBasedFileSystemView.isPendingCompactionScheduledForFileId(HoodieFileGroupId fgId) |
protected abstract boolean |
AbstractTableFileSystemView.isPendingCompactionScheduledForFileId(HoodieFileGroupId fgId)
Check if there is an outstanding compaction scheduled for this file.
|
protected boolean |
HoodieTableFileSystemView.isPendingLogCompactionScheduledForFileId(HoodieFileGroupId fgId) |
protected boolean |
RocksDbBasedFileSystemView.isPendingLogCompactionScheduledForFileId(HoodieFileGroupId fgId) |
protected abstract boolean |
AbstractTableFileSystemView.isPendingLogCompactionScheduledForFileId(HoodieFileGroupId fgId)
Check if there is an outstanding log compaction scheduled for this file.
|
| Modifier and Type | Method and Description |
|---|---|
static Map<HoodieFileGroupId,HoodieInstant> |
ClusteringUtils.getAllFileGroupsInPendingClusteringPlans(HoodieTableMetaClient metaClient)
Get filegroups to pending clustering instant mapping for all pending clustering plans.
|
static Map<HoodieFileGroupId,Pair<String,HoodieCompactionOperation>> |
CompactionUtils.getAllPendingCompactionOperations(HoodieTableMetaClient metaClient)
Get all PartitionPath + file-ids with pending Compaction operations and their target compaction instant time.
|
static Map<HoodieFileGroupId,Pair<String,HoodieCompactionOperation>> |
CompactionUtils.getAllPendingCompactionOperationsInPendingCompactionPlans(List<Pair<HoodieInstant,HoodieCompactionPlan>> pendingLogCompactionPlanWithInstants)
Get all partition + file Ids with pending Log Compaction operations and their target log compaction instant time.
|
static Map<HoodieFileGroupId,Pair<String,HoodieCompactionOperation>> |
CompactionUtils.getAllPendingLogCompactionOperations(HoodieTableMetaClient metaClient)
Get all partition + file Ids with pending Log Compaction operations and their target log compaction instant time.
|
static Stream<HoodieFileGroupId> |
ClusteringUtils.getFileGroupsFromClusteringGroup(HoodieClusteringGroup group) |
static Stream<HoodieFileGroupId> |
ClusteringUtils.getFileGroupsFromClusteringPlan(HoodieClusteringPlan clusteringPlan) |
static Stream<Pair<HoodieFileGroupId,HoodieInstant>> |
ClusteringUtils.getFileGroupsInPendingClusteringInstant(HoodieInstant instant,
HoodieClusteringPlan clusteringPlan) |
static Stream<Pair<HoodieFileGroupId,Pair<String,HoodieCompactionOperation>>> |
CompactionUtils.getPendingCompactionOperations(HoodieInstant instant,
HoodieCompactionPlan compactionPlan)
Get pending compaction operations for both major and minor compaction.
|
| Modifier and Type | Method and Description |
|---|---|
String |
RocksDBSchemaHelper.getKeyForBootstrapBaseFile(HoodieFileGroupId fgId) |
String |
RocksDBSchemaHelper.getKeyForFileGroupsInPendingClustering(HoodieFileGroupId fgId) |
String |
RocksDBSchemaHelper.getKeyForPendingCompactionLookup(HoodieFileGroupId fgId) |
String |
RocksDBSchemaHelper.getKeyForPendingLogCompactionLookup(HoodieFileGroupId fgId) |
String |
RocksDBSchemaHelper.getKeyForReplacedFileGroup(HoodieFileGroupId fgId) |
Copyright © 2024 The Apache Software Foundation. All rights reserved.