org.apache.hudi.storage.inline

Class InLineFSUtils

java.lang.Object

org.apache.hudi.storage.inline.InLineFSUtils

public class InLineFSUtils
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
protected static String	EQUALS_STR
protected static String	LENGTH_STR
protected static String	LOCAL_FILESYSTEM_SCHEME
static String	SCHEME
protected static String	SCHEME_SEPARATOR
protected static String	START_OFFSET_STR

Constructor Summary

Constructors

Constructor and Description
InLineFSUtils()

Method Summary

Modifier and Type	Method and Description
static StoragePath	getInlineFilePath(StoragePath outerPath, String origScheme, long inLineStartOffset, long inLineLength) Get the InlineFS Path for a given schema and its Path.
static StoragePath	getOuterFilePathFromInlinePath(StoragePath inlineFSPath)
static long	length(StoragePath inlinePath) Returns length of the block (embedded w/in the base file) identified by the given InlineFS path input: "inlinefs:/file1/s3a/?start_offset=20&length=40".
static long	startOffset(StoragePath inlineFSPath) Returns start offset w/in the base for the block identified by the given InlineFS path input: "inlinefs://file1/s3a/?start_offset=20&length=40".

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SCHEME

public static final String SCHEME

See Also:

Constant Field Values

START_OFFSET_STR

protected static final String START_OFFSET_STR

See Also:

Constant Field Values

LENGTH_STR

protected static final String LENGTH_STR

See Also:

Constant Field Values

SCHEME_SEPARATOR

protected static final String SCHEME_SEPARATOR

See Also:

Constant Field Values

EQUALS_STR

protected static final String EQUALS_STR

See Also:

Constant Field Values

LOCAL_FILESYSTEM_SCHEME

protected static final String LOCAL_FILESYSTEM_SCHEME

See Also:

Constant Field Values

Constructor Detail

InLineFSUtils

public InLineFSUtils()

Method Detail

getInlineFilePath

public static StoragePath getInlineFilePath(StoragePath outerPath,
                                            String origScheme,
                                            long inLineStartOffset,
                                            long inLineLength)

Get the InlineFS Path for a given schema and its Path.

Examples:

 Input Path: s3a://file1, origScheme: file, startOffset = 20, length = 40
 Output: "inlinefs://file1/s3a/?start_offset=20&length=40"

 Real-world example:
 Input Path: tests_7af7f087-c807-4f5e-a759-65fd9c21063b/hudi_multi_fg_pt_v8_mor/.hoodie/metadata/column_stats/
             .col-stats-0001-0_20250429145946675.log.1_1-120-382
 origScheme: local, startOffset = 8036, length = 6959
 Output: "inlinefs://tests_7af7f087-c807-4f5e-a759-65fd9c21063b/hudi_multi_fg_pt_v8_mor/.hoodie/metadata/column_stats/
          .col-stats-0001-0_20250429145946675.log.1_1-120-382/local/?start_offset=8036&length=6959"
 

Parameters:

outerPath - The outer file path

origScheme - The file schema

inLineStartOffset - Start offset for the inline file

inLineLength - Length for the inline file

Returns:

InlineFS StoragePath for the requested outer path and schema

getOuterFilePathFromInlinePath

public static StoragePath getOuterFilePathFromInlinePath(StoragePath inlineFSPath)

startOffset

public static long startOffset(StoragePath inlineFSPath)

Returns start offset w/in the base for the block identified by the given InlineFS path input: "inlinefs://file1/s3a/?start_offset=20&length=40". output: 20

length

public static long length(StoragePath inlinePath)

Returns length of the block (embedded w/in the base file) identified by the given InlineFS path input: "inlinefs:/file1/s3a/?start_offset=20&length=40". output: 40