public class InLineFSUtils extends Object
| Modifier and Type | Field and Description |
|---|---|
protected static String |
EQUALS_STR |
protected static String |
LENGTH_STR |
protected static String |
LOCAL_FILESYSTEM_SCHEME |
static String |
SCHEME |
protected static String |
SCHEME_SEPARATOR |
protected static String |
START_OFFSET_STR |
| Constructor and Description |
|---|
InLineFSUtils() |
| Modifier and Type | Method and Description |
|---|---|
static StoragePath |
getInlineFilePath(StoragePath outerPath,
String origScheme,
long inLineStartOffset,
long inLineLength)
Get the InlineFS Path for a given schema and its Path.
|
static StoragePath |
getOuterFilePathFromInlinePath(StoragePath inlineFSPath) |
static long |
length(StoragePath inlinePath)
Returns length of the block (embedded w/in the base file) identified by the given InlineFS path
input: "inlinefs:/file1/s3a/?start_offset=20&length=40".
|
static long |
startOffset(StoragePath inlineFSPath)
Returns start offset w/in the base for the block identified by the given InlineFS path
input: "inlinefs://file1/s3a/?start_offset=20&length=40".
|
public static final String SCHEME
protected static final String START_OFFSET_STR
protected static final String LENGTH_STR
protected static final String SCHEME_SEPARATOR
protected static final String EQUALS_STR
protected static final String LOCAL_FILESYSTEM_SCHEME
public static StoragePath getInlineFilePath(StoragePath outerPath, String origScheme, long inLineStartOffset, long inLineLength)
Examples:
Input Path: s3a://file1, origScheme: file, startOffset = 20, length = 40
Output: "inlinefs://file1/s3a/?start_offset=20&length=40"
Real-world example:
Input Path: tests_7af7f087-c807-4f5e-a759-65fd9c21063b/hudi_multi_fg_pt_v8_mor/.hoodie/metadata/column_stats/
.col-stats-0001-0_20250429145946675.log.1_1-120-382
origScheme: local, startOffset = 8036, length = 6959
Output: "inlinefs://tests_7af7f087-c807-4f5e-a759-65fd9c21063b/hudi_multi_fg_pt_v8_mor/.hoodie/metadata/column_stats/
.col-stats-0001-0_20250429145946675.log.1_1-120-382/local/?start_offset=8036&length=6959"
outerPath - The outer file pathorigScheme - The file schemainLineStartOffset - Start offset for the inline fileinLineLength - Length for the inline fileStoragePath for the requested outer path and schemapublic static StoragePath getOuterFilePathFromInlinePath(StoragePath inlineFSPath)
public static long startOffset(StoragePath inlineFSPath)
public static long length(StoragePath inlinePath)
Copyright © 2025 The Apache Software Foundation. All rights reserved.