| Package | Description |
|---|---|
| org.apache.hudi.common.fs | |
| org.apache.hudi.common.util | |
| org.apache.hudi.storage | |
| org.apache.hudi.storage.inline |
| Modifier and Type | Method and Description |
|---|---|
void |
ConsistencyGuard.waitTillFileAppears(StoragePath filePath)
Wait for file to be listable based on configurable timeout.
|
void |
ConsistencyGuard.waitTillFileDisappears(StoragePath filePath)
Wait for file to be listable based on configurable timeout.
|
| Modifier and Type | Method and Description |
|---|---|
static boolean |
FileIOUtils.copy(HoodieStorage srcStorage,
StoragePath src,
HoodieStorage dstStorage,
StoragePath dst,
boolean deleteSource,
boolean overwrite) |
static boolean |
FileIOUtils.copy(HoodieStorage srcStorage,
StoragePathInfo srcPathInfo,
HoodieStorage dstStorage,
StoragePath dst,
boolean deleteSource,
boolean overwrite)
Copy files between FileSystems.
|
static void |
FileIOUtils.copy(HoodieStorage storage,
StoragePath sourceFilePath,
StoragePath destFilePath)
Copies the file content from source path to destination path.
|
static void |
FileIOUtils.createFileInPath(HoodieStorage storage,
StoragePath fullPath,
Option<HoodieInstantWriter> contentWriter) |
static void |
FileIOUtils.createFileInPath(HoodieStorage storage,
StoragePath fullPath,
Option<HoodieInstantWriter> contentWriter,
boolean ignoreIOE) |
static Option<byte[]> |
FileIOUtils.readDataFromPath(HoodieStorage storage,
StoragePath detailPath) |
static Option<byte[]> |
FileIOUtils.readDataFromPath(HoodieStorage storage,
StoragePath detailPath,
boolean ignoreIOE) |
| Modifier and Type | Method and Description |
|---|---|
StoragePath |
StoragePath.getParent() |
StoragePath |
StoragePathInfo.getPath() |
StoragePath |
StoragePath.getPathWithoutSchemeAndAuthority() |
StoragePath |
StoragePath.makeQualified(URI defaultUri)
Returns a qualified path object.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
StoragePathFilter.accept(StoragePath path)
Tests whether the specified path should be included in a path list.
|
abstract OutputStream |
HoodieStorage.append(StoragePath path)
Appends to an existing file (optional operation).
|
int |
StoragePath.compareTo(StoragePath o) |
OutputStream |
HoodieStorage.create(StoragePath path)
Create an OutputStream at the indicated path.
|
abstract OutputStream |
HoodieStorage.create(StoragePath path,
boolean overwrite)
Creates an OutputStream at the indicated path.
|
abstract OutputStream |
HoodieStorage.create(StoragePath path,
boolean overwrite,
Integer bufferSize,
Short replication,
Long sizeThreshold)
Creates an OutputStream at the indicated path.
|
abstract boolean |
HoodieStorage.createDirectory(StoragePath path)
Creates the directory and non-existent parent directories.
|
void |
HoodieStorage.createImmutableFileInPath(StoragePath path,
Option<HoodieInstantWriter> contentWriter)
Creates a new file with overwrite set to false.
|
void |
HoodieStorage.createImmutableFileInPath(StoragePath path,
Option<HoodieInstantWriter> contentWriter,
boolean needTempFile)
Creates a new file with overwrite set to false.
|
boolean |
HoodieStorage.createNewFile(StoragePath path)
Creates an empty new file at the indicated path.
|
abstract boolean |
HoodieStorage.deleteDirectory(StoragePath path)
Deletes a directory at path.
|
abstract boolean |
HoodieStorage.deleteFile(StoragePath path)
Deletes a file at path.
|
abstract boolean |
HoodieStorage.exists(StoragePath path)
Checks if a path exists.
|
abstract int |
HoodieStorage.getDefaultBlockSize(StoragePath path) |
abstract short |
HoodieStorage.getDefaultReplication(StoragePath path) |
abstract StoragePathInfo |
HoodieStorage.getPathInfo(StoragePath path)
Returns a
StoragePathInfo object that represents the path. |
List<StoragePathInfo> |
HoodieStorage.globEntries(StoragePath pathPattern)
Returns all the files that match the pathPattern and are not checksum files.
|
abstract List<StoragePathInfo> |
HoodieStorage.globEntries(StoragePath pathPattern,
StoragePathFilter filter)
Returns all the files that match the pathPattern and are not checksum files,
and filters the results.
|
abstract List<StoragePathInfo> |
HoodieStorage.listDirectEntries(StoragePath path)
Lists the path info of the direct files/directories in the given path if the path is a directory.
|
abstract List<StoragePathInfo> |
HoodieStorage.listDirectEntries(StoragePath path,
StoragePathFilter filter)
Lists the path info of the direct files/directories in the given path
and filters the results, if the path is a directory.
|
abstract List<StoragePathInfo> |
HoodieStorage.listFiles(StoragePath path)
Lists the path info of all files under the give path recursively.
|
abstract HoodieStorage |
HoodieStorage.newInstance(StoragePath path,
StorageConfiguration<?> storageConf) |
abstract InputStream |
HoodieStorage.open(StoragePath path)
Opens an InputStream at the indicated path.
|
SeekableDataInputStream |
HoodieStorage.openSeekable(StoragePath path,
boolean wrapStream)
Opens an SeekableDataInputStream at the indicated path with seeks supported.
|
abstract SeekableDataInputStream |
HoodieStorage.openSeekable(StoragePath path,
int bufferSize,
boolean wrapStream)
Opens an SeekableDataInputStream at the indicated path with seeks supported.
|
abstract boolean |
HoodieStorage.rename(StoragePath oldPath,
StoragePath newPath)
Renames the path from old to new.
|
abstract void |
HoodieStorage.setModificationTime(StoragePath path,
long modificationTimeInMillisEpoch)
Sets Modification Time for the storage Path
|
| Modifier and Type | Method and Description |
|---|---|
List<StoragePathInfo> |
HoodieStorage.listDirectEntries(List<StoragePath> pathList)
Lists the file info of the direct files/directories in the given list of paths,
if the paths are directory.
|
List<StoragePathInfo> |
HoodieStorage.listDirectEntries(List<StoragePath> pathList,
StoragePathFilter filter)
Lists the file info of the direct files/directories in the given list of paths
and filters the results, if the paths are directory.
|
| Constructor and Description |
|---|
StoragePath(StoragePath parent,
String child) |
StoragePathInfo(StoragePath path,
long length,
boolean isDirectory,
short blockReplication,
long blockSize,
long modificationTime) |
StoragePathInfo(StoragePath path,
long length,
boolean isDirectory,
short blockReplication,
long blockSize,
long modificationTime,
String[] locations) |
| Modifier and Type | Method and Description |
|---|---|
static StoragePath |
InLineFSUtils.getInlineFilePath(StoragePath outerPath,
String origScheme,
long inLineStartOffset,
long inLineLength)
Get the InlineFS Path for a given schema and its Path.
|
static StoragePath |
InLineFSUtils.getOuterFilePathFromInlinePath(StoragePath inlineFSPath) |
| Modifier and Type | Method and Description |
|---|---|
static StoragePath |
InLineFSUtils.getInlineFilePath(StoragePath outerPath,
String origScheme,
long inLineStartOffset,
long inLineLength)
Get the InlineFS Path for a given schema and its Path.
|
static StoragePath |
InLineFSUtils.getOuterFilePathFromInlinePath(StoragePath inlineFSPath) |
static long |
InLineFSUtils.length(StoragePath inlinePath)
Returns length of the block (embedded w/in the base file) identified by the given InlineFS path
input: "inlinefs:/file1/s3a/?start_offset=20&length=40".
|
static long |
InLineFSUtils.startOffset(StoragePath inlineFSPath)
Returns start offset w/in the base for the block identified by the given InlineFS path
input: "inlinefs://file1/s3a/?start_offset=20&length=40".
|
Copyright © 2025 The Apache Software Foundation. All rights reserved.