| Package | Description |
|---|---|
| org.apache.hudi.common.model | |
| org.apache.hudi.common.table.timeline.dto | |
| org.apache.hudi.common.table.view | |
| org.apache.hudi.metadata |
| Modifier and Type | Method and Description |
|---|---|
Stream<HoodieBaseFile> |
HoodieFileGroup.getAllBaseFiles()
Stream of committed data files, sorted reverse commit time.
|
Option<HoodieBaseFile> |
FileSlice.getBaseFile() |
Option<HoodieBaseFile> |
CompactionOperation.getBaseFile(String basePath,
String partitionPath) |
Option<HoodieBaseFile> |
HoodieFileGroup.getLatestDataFile()
Gets the latest data file.
|
| Modifier and Type | Method and Description |
|---|---|
void |
HoodieFileGroup.addBaseFile(HoodieBaseFile dataFile)
Add a new datafile into the file group.
|
void |
FileSlice.setBaseFile(HoodieBaseFile baseFile) |
| Constructor and Description |
|---|
FileSlice(HoodieFileGroupId fileGroupId,
String baseInstantTime,
HoodieBaseFile baseFile,
List<HoodieLogFile> logFiles) |
HoodieBaseFile(HoodieBaseFile dataFile) |
| Constructor and Description |
|---|
CompactionOperation(Option<HoodieBaseFile> dataFile,
String partitionPath,
List<HoodieLogFile> logFiles,
Map<String,Double> metrics) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieBaseFile |
BaseFileDTO.toHoodieBaseFile(BaseFileDTO dto) |
| Modifier and Type | Method and Description |
|---|---|
protected HoodieBaseFile |
AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(HoodieFileGroupId fileGroupId,
HoodieBaseFile baseFile) |
protected HoodieBaseFile |
AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(HoodieFileGroupId fileGroupId,
HoodieBaseFile baseFile,
Function<HoodieFileGroupId,Option<BootstrapBaseFileMapping>> bootstrapBaseFileMappingFunc) |
| Modifier and Type | Method and Description |
|---|---|
protected Option<HoodieBaseFile> |
RocksDbBasedFileSystemView.fetchLatestBaseFile(String partitionPath,
String fileId) |
protected Option<HoodieBaseFile> |
AbstractTableFileSystemView.fetchLatestBaseFile(String partitionPath,
String fileId)
Default implementation for fetching latest base-file.
|
Stream<HoodieBaseFile> |
AbstractTableFileSystemView.fetchLatestBaseFiles(String partitionPath)
Default implementation for fetching latest base-files for the partition-path.
|
Stream<HoodieBaseFile> |
TableFileSystemView.BaseFileOnlyView.getAllBaseFiles(String partitionPath)
Stream all the data file versions grouped by FileId for a given partition.
|
Stream<HoodieBaseFile> |
AbstractTableFileSystemView.getAllBaseFiles(String partitionStr) |
Stream<HoodieBaseFile> |
PriorityBasedFileSystemView.getAllBaseFiles(String partitionPath) |
Stream<HoodieBaseFile> |
RemoteHoodieTableFileSystemView.getAllBaseFiles(String partitionPath) |
Map<String,Stream<HoodieBaseFile>> |
TableFileSystemView.BaseFileOnlyViewWithLatestSlice.getAllLatestBaseFilesBeforeOrOn(String maxCommitTime)
Streams the latest version base files in all partitions with precondition that
commitTime(file) before maxCommitTime.
|
Map<String,Stream<HoodieBaseFile>> |
AbstractTableFileSystemView.getAllLatestBaseFilesBeforeOrOn(String maxCommitTime) |
Map<String,Stream<HoodieBaseFile>> |
PriorityBasedFileSystemView.getAllLatestBaseFilesBeforeOrOn(String maxCommitTime) |
Map<String,Stream<HoodieBaseFile>> |
RemoteHoodieTableFileSystemView.getAllLatestBaseFilesBeforeOrOn(String maxCommitTime) |
Option<HoodieBaseFile> |
TableFileSystemView.BaseFileOnlyView.getBaseFileOn(String partitionPath,
String instantTime,
String fileId)
Get the version of data file matching the instant time in the given partition.
|
Option<HoodieBaseFile> |
AbstractTableFileSystemView.getBaseFileOn(String partitionStr,
String instantTime,
String fileId) |
Option<HoodieBaseFile> |
PriorityBasedFileSystemView.getBaseFileOn(String partitionPath,
String instantTime,
String fileId) |
Option<HoodieBaseFile> |
RemoteHoodieTableFileSystemView.getBaseFileOn(String partitionPath,
String instantTime,
String fileId) |
protected Option<HoodieBaseFile> |
AbstractTableFileSystemView.getLatestBaseFile(HoodieFileGroup fileGroup) |
Option<HoodieBaseFile> |
TableFileSystemView.BaseFileOnlyViewWithLatestSlice.getLatestBaseFile(String partitionPath,
String fileId)
Get Latest data file for a partition and file-Id.
|
Option<HoodieBaseFile> |
AbstractTableFileSystemView.getLatestBaseFile(String partitionStr,
String fileId)
Get Latest base file for a partition and file-Id.
|
Option<HoodieBaseFile> |
PriorityBasedFileSystemView.getLatestBaseFile(String partitionPath,
String fileId) |
Option<HoodieBaseFile> |
RemoteHoodieTableFileSystemView.getLatestBaseFile(String partitionPath,
String fileId) |
Stream<HoodieBaseFile> |
TableFileSystemView.BaseFileOnlyViewWithLatestSlice.getLatestBaseFiles()
Stream all the latest data files, in the file system view.
|
Stream<HoodieBaseFile> |
AbstractTableFileSystemView.getLatestBaseFiles() |
Stream<HoodieBaseFile> |
PriorityBasedFileSystemView.getLatestBaseFiles() |
Stream<HoodieBaseFile> |
RemoteHoodieTableFileSystemView.getLatestBaseFiles() |
Stream<HoodieBaseFile> |
HoodieTablePreCommitFileSystemView.getLatestBaseFiles(String partitionStr)
Combine committed base files + new files created/replaced for given partition.
|
Stream<HoodieBaseFile> |
TableFileSystemView.BaseFileOnlyViewWithLatestSlice.getLatestBaseFiles(String partitionPath)
Stream all the latest data files in the given partition.
|
Stream<HoodieBaseFile> |
AbstractTableFileSystemView.getLatestBaseFiles(String partitionStr) |
Stream<HoodieBaseFile> |
PriorityBasedFileSystemView.getLatestBaseFiles(String partitionPath) |
Stream<HoodieBaseFile> |
RemoteHoodieTableFileSystemView.getLatestBaseFiles(String partitionPath) |
Stream<HoodieBaseFile> |
TableFileSystemView.BaseFileOnlyViewWithLatestSlice.getLatestBaseFilesBeforeOrOn(String partitionPath,
String maxCommitTime)
Stream all the latest version data files in the given partition with precondition that commitTime(file) before
maxCommitTime.
|
Stream<HoodieBaseFile> |
AbstractTableFileSystemView.getLatestBaseFilesBeforeOrOn(String partitionStr,
String maxCommitTime) |
Stream<HoodieBaseFile> |
PriorityBasedFileSystemView.getLatestBaseFilesBeforeOrOn(String partitionPath,
String maxCommitTime) |
Stream<HoodieBaseFile> |
RemoteHoodieTableFileSystemView.getLatestBaseFilesBeforeOrOn(String partitionPath,
String maxCommitTime) |
Stream<HoodieBaseFile> |
TableFileSystemView.BaseFileOnlyViewWithLatestSlice.getLatestBaseFilesInRange(List<String> commitsToReturn)
Stream all the latest data files pass.
|
Stream<HoodieBaseFile> |
AbstractTableFileSystemView.getLatestBaseFilesInRange(List<String> commitsToReturn) |
Stream<HoodieBaseFile> |
PriorityBasedFileSystemView.getLatestBaseFilesInRange(List<String> commitsToReturn) |
Stream<HoodieBaseFile> |
RemoteHoodieTableFileSystemView.getLatestBaseFilesInRange(List<String> commitsToReturn) |
| Modifier and Type | Method and Description |
|---|---|
protected HoodieBaseFile |
AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(HoodieFileGroupId fileGroupId,
HoodieBaseFile baseFile) |
protected HoodieBaseFile |
AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(HoodieFileGroupId fileGroupId,
HoodieBaseFile baseFile,
Function<HoodieFileGroupId,Option<BootstrapBaseFileMapping>> bootstrapBaseFileMappingFunc) |
protected boolean |
AbstractTableFileSystemView.isBaseFileDueToPendingClustering(HoodieBaseFile baseFile)
With async clustering, it is possible to see partial/complete base-files due to inflight-clustering, Ignore those
base-files.
|
protected boolean |
AbstractTableFileSystemView.isBaseFileDueToPendingCompaction(String partitionPath,
HoodieBaseFile baseFile)
With async compaction, it is possible to see partial/complete base-files due to inflight-compactions, Ignore those
base-files.
|
| Modifier and Type | Method and Description |
|---|---|
protected List<HoodieFileGroup> |
AbstractTableFileSystemView.buildFileGroups(String partition,
Stream<HoodieBaseFile> baseFileStream,
Stream<HoodieLogFile> logFileStream,
HoodieTimeline timeline,
boolean addPendingCompactionFileSlice) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieData<HoodieRecord> |
HoodieTableMetadataUtil.readRecordKeysFromBaseFiles(HoodieEngineContext engineContext,
HoodieConfig config,
List<Pair<String,HoodieBaseFile>> partitionBaseFilePairs,
boolean forDelete,
int recordIndexMaxParallelism,
String basePath,
StorageConfiguration<?> configuration,
String activeModule)
Deprecated.
|
Copyright © 2024 The Apache Software Foundation. All rights reserved.