public class HadoopInLineFSUtils extends InLineFSUtils
EQUALS_STR, LENGTH_STR, LOCAL_FILESYSTEM_SCHEME, SCHEME, SCHEME_SEPARATOR, START_OFFSET_STR| Constructor and Description |
|---|
HadoopInLineFSUtils() |
| Modifier and Type | Method and Description |
|---|---|
static StorageConfiguration<org.apache.hadoop.conf.Configuration> |
buildInlineConf(StorageConfiguration<org.apache.hadoop.conf.Configuration> storageConf) |
static org.apache.hadoop.fs.Path |
getOuterFilePathFromInlinePath(org.apache.hadoop.fs.Path inlineFSPath)
InlineFS Path format:
"inlinefs://path/to/outer/file/outer_file_scheme/?start_offset=start_offset>&length=
|
getInlineFilePath, getOuterFilePathFromInlinePath, length, startOffsetpublic static StorageConfiguration<org.apache.hadoop.conf.Configuration> buildInlineConf(StorageConfiguration<org.apache.hadoop.conf.Configuration> storageConf)
public static org.apache.hadoop.fs.Path getOuterFilePathFromInlinePath(org.apache.hadoop.fs.Path inlineFSPath)
Outer File Path format: "outer_file_scheme://path/to/outer/file"
Example Input: "inlinefs://file1/s3a/?start_offset=20&length=40". Output: "s3a://file1"
inlineFSPath - InLineFS Path to get the outer file PathCopyright © 2024 The Apache Software Foundation. All rights reserved.