A B C D E F G H I L M N O P R S T U V W

A

access(Path, FsAction) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

add(String) - Method in class org.apache.hudi.avro.HoodieAvroWriteSupport

addDelegationTokens(String, Credentials) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

addFooterMetadata(String, String) - Method in class org.apache.hudi.avro.HoodieAvroWriteSupport

addPropsFromFile(StoragePath) - Method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

Add properties from external configuration files.

addPropsFromStream(BufferedReader, StoragePath) - Method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

Add properties from buffered reader.

addSchemeIfLocalPath(String) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

addToGlobalProps(String, String) - Static method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

addToVector(TypeDescription, ColumnVector, Schema, Object, int) - Static method in class org.apache.hudi.common.util.AvroOrcUtils

Add an object (of a given ORC type) to the column vector at a given position.

addUnionValue(UnionColumnVector, List<TypeDescription>, Schema, Object, int) - Static method in class org.apache.hudi.common.util.AvroOrcUtils

Match value with its ORC type and add to the union vector at a given position.

append(Path, int, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

append(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

append(Path, int) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

append(Path, int, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

append(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

append(Path, int) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

append(Path, int, Progressable) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

append(Path, int, Progressable) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

append(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

appendBlock(HoodieLogBlock) - Method in class org.apache.hudi.common.table.log.HoodieLogFormatWriter

appendBlocks(List<HoodieLogBlock>) - Method in class org.apache.hudi.common.table.log.HoodieLogFormatWriter

appendNextPartition(String, List<BootstrapFileMapping>) - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexWriter

AvroOrcUtils - Class in org.apache.hudi.common.util

Methods including addToVector, addUnionValue, createOrcSchema are originally from https://github.com/streamsets/datacollector.

AvroOrcUtils() - Constructor for class org.apache.hudi.common.util.AvroOrcUtils

B

begin() - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexWriter

BLOOM_FILTER_ENABLED - Static variable in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

BLOOM_FILTER_EXPECTED_NDV - Static variable in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

BoundedFsDataInputStream - Class in org.apache.hudi.hadoop.fs

Implementation of FSDataInputStream with bound check based on file size.

BoundedFsDataInputStream(FileSystem, Path, InputStream) - Constructor for class org.apache.hudi.hadoop.fs.BoundedFsDataInputStream

buildInlineConf(StorageConfiguration<Configuration>) - Static method in class org.apache.hudi.hadoop.fs.inline.HadoopInLineFSUtils

C

CACHE_DATA_IN_L1 - Static variable in class org.apache.hudi.io.hadoop.HoodieHFileConfig

CachingPath - Class in org.apache.hudi.hadoop.fs

This is an extension of the Path class allowing to avoid repetitive computations (like getFileName, toString) which are secured by its immutability NOTE: This class is thread-safe

CachingPath(String, String) - Constructor for class org.apache.hudi.hadoop.fs.CachingPath

CachingPath(Path, String) - Constructor for class org.apache.hudi.hadoop.fs.CachingPath

CachingPath(String, Path) - Constructor for class org.apache.hudi.hadoop.fs.CachingPath

CachingPath(Path, Path) - Constructor for class org.apache.hudi.hadoop.fs.CachingPath

CachingPath(String) - Constructor for class org.apache.hudi.hadoop.fs.CachingPath

CachingPath(URI) - Constructor for class org.apache.hudi.hadoop.fs.CachingPath

cancelDeleteOnExit(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

canWrite() - Method in class org.apache.hudi.io.hadoop.HoodieAvroHFileWriter

canWrite() - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcWriter

canWrite() - Method in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

canWrite() - Method in class org.apache.hudi.io.hadoop.HoodieParquetStreamWriter

clearGlobalProps() - Static method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

close() - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexReader

close() - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexWriter

Close Writer Handles.

close() - Method in class org.apache.hudi.common.table.log.HoodieLogFormatWriter

close() - Method in class org.apache.hudi.common.util.ParquetReaderIterator

close() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

close() - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

close() - Method in class org.apache.hudi.hadoop.fs.SizeAwareFSDataOutputStream

close() - Method in class org.apache.hudi.io.hadoop.HoodieAvroHFileWriter

close() - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

close() - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcWriter

close() - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

close() - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetWriter

close() - Method in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

close() - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

close() - Method in class org.apache.hudi.io.hadoop.HoodieParquetStreamWriter

close() - Method in class org.apache.hudi.io.hadoop.OrcReaderIterator

close() - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

completeLocalOutput(Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

concat(Path, Path[]) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

concatPathUnsafe(Path, Path) - Static method in class org.apache.hudi.hadoop.fs.CachingPath

concatPathUnsafe(Path, String) - Static method in class org.apache.hudi.hadoop.fs.CachingPath

CONF_FILE_DIR_ENV_NAME - Static variable in class org.apache.hudi.common.config.DFSPropertiesConfiguration

constructAbsolutePathInHadoopPath(String, String) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

convertAvroSchemaToParquet(Schema, Configuration) - Static method in class org.apache.hudi.common.table.ParquetTableSchemaResolver

convertPathWithScheme(Path, String) - Static method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

convertToHadoopFileStatus(StoragePathInfo) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

convertToHadoopPath(StoragePath) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

convertToHoodiePath(StoragePath, Configuration) - Static method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

convertToHoodiePath(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

convertToStoragePath(Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

convertToStoragePathInfo(FileStatus) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

copyFromLocalFile(Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

copyFromLocalFile(boolean, Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

copyFromLocalFile(boolean, boolean, Path[], Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

copyFromLocalFile(boolean, boolean, Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

copyToLocalFile(Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

copyToLocalFile(boolean, Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

copyToLocalFile(boolean, Path, Path, boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, short) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, short, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, boolean, int) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, boolean, int, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, boolean, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable, Options.ChecksumOpt) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, boolean, int, short, long) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, short) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, short, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, boolean, int) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, boolean, int, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, boolean, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable, Options.ChecksumOpt) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, boolean, int, short, long) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

create(long) - Method in class org.apache.hudi.parquet.io.OutputStreamBackedOutputFile

create(StoragePath, boolean) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

create(StoragePath, boolean, Integer, Short, Long) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

create(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

createAvroSchema(TypeDescription) - Static method in class org.apache.hudi.common.util.AvroOrcUtils

createAvroSchemaWithDefaultValue(TypeDescription, String, String, boolean) - Static method in class org.apache.hudi.common.util.AvroOrcUtils

createDirectory(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

createHadoopConf(Properties) - Static method in class org.apache.hudi.common.util.HadoopConfigUtils

Creates a Hadoop Configuration instance with the properties.

createHFileReader(FileSystem, Path, CacheConfig, Configuration) - Static method in class org.apache.hudi.io.hadoop.HoodieHFileUtils

Creates HFile reader for a file with default `primaryReplicaReader` as true.

createHFileReader(HoodieStorage, StoragePath, CacheConfig, Configuration) - Static method in class org.apache.hudi.io.hadoop.HoodieHFileUtils

Creates HFile reader for a file with default `primaryReplicaReader` as true.

createHFileReader(HoodieStorage, StoragePath, byte[]) - Static method in class org.apache.hudi.io.hadoop.HoodieHFileUtils

Creates HFile reader for byte array with default `primaryReplicaReader` as true.

createNewFile(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

createNewFile(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

createNewFile(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

createNonRecursive(Path, boolean, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

createNonRecursive(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

createOrcSchema(Schema) - Static method in class org.apache.hudi.common.util.AvroOrcUtils

createOrOverwrite(long) - Method in class org.apache.hudi.parquet.io.OutputStreamBackedOutputFile

createRelativePathUnsafe(String) - Static method in class org.apache.hudi.hadoop.fs.CachingPath

Creates path based on the provided *relative* path NOTE: This is an unsafe version that is relying on the fact that the caller is aware what they are doing this is not going to work with paths having scheme (which require parsing) and is only meant to work w/ relative paths in a few specific cases.

createSnapshot(Path, String) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

createSymlink(Path, Path, boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

D

DEFAULT_CONF_FILE_DIR - Static variable in class org.apache.hudi.common.config.DFSPropertiesConfiguration

DEFAULT_PATH - Static variable in class org.apache.hudi.common.config.DFSPropertiesConfiguration

DEFAULT_PROPERTIES_FILE - Static variable in class org.apache.hudi.common.config.DFSPropertiesConfiguration

defaultBlockSize() - Method in class org.apache.hudi.parquet.io.OutputStreamBackedOutputFile

delete(Path, boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

delete(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

delete(Path, boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

delete(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

delete(Path, boolean) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

delete(Path, boolean) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

deleteDirectory(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

deleteFile(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

deleteFilesParallelize(HoodieTableMetaClient, List<String>, HoodieEngineContext, int, boolean) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

deleteOnExit(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

deleteSnapshot(Path, String) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

DFSPropertiesConfiguration - Class in org.apache.hudi.common.config

A simplified versions of Apache commons - PropertiesConfiguration, that supports limited field types and hierarchical configurations within the same folder as the root file.

DFSPropertiesConfiguration(Configuration, StoragePath) - Constructor for class org.apache.hudi.common.config.DFSPropertiesConfiguration

DFSPropertiesConfiguration() - Constructor for class org.apache.hudi.common.config.DFSPropertiesConfiguration

dictionaryEnabled() - Method in class org.apache.hudi.io.storage.HoodieParquetConfig

disableCompatibility() - Method in class org.apache.parquet.avro.HoodieAvroParquetReaderBuilder

DROP_BEHIND_CACHE_COMPACTION - Static variable in class org.apache.hudi.io.hadoop.HoodieHFileConfig

E

equals(Object) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

equals(Object) - Method in class org.apache.hudi.hadoop.fs.SerializablePath

executeFuncWithTimeAndByteMetrics(String, Path, long, HoodieWrapperFileSystem.CheckedFunction<R>) - Static method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

executeFuncWithTimeMetrics(String, Path, HoodieWrapperFileSystem.CheckedFunction<R>) - Static method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

exists(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

exists(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

exists(Path) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

exists(Path) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

exists(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

F

fetchHoodieKeys(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.HFileUtils

fetchHoodieKeys(HoodieStorage, StoragePath, Option<BaseKeyGenerator>) - Method in class org.apache.hudi.common.util.HFileUtils

fetchHoodieKeys(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.OrcUtils

Fetch HoodieKeys from the given ORC file.

fetchHoodieKeys(HoodieStorage, StoragePath, Option<BaseKeyGenerator>) - Method in class org.apache.hudi.common.util.OrcUtils

fetchHoodieKeys(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.ParquetUtils

Fetch HoodieKeys from the given parquet file.

fetchHoodieKeys(HoodieStorage, StoragePath, Option<BaseKeyGenerator>) - Method in class org.apache.hudi.common.util.ParquetUtils

Fetch HoodieKeys from the given parquet file.

filterRowKeys(HoodieStorage, StoragePath, Set<String>) - Method in class org.apache.hudi.common.util.HFileUtils

filterRowKeys(HoodieStorage, StoragePath, Set<String>) - Method in class org.apache.hudi.common.util.OrcUtils

Read the rowKey list matching the given filter, from the given ORC file.

filterRowKeys(HoodieStorage, StoragePath, Set<String>) - Method in class org.apache.hudi.common.util.ParquetUtils

Read the rowKey list matching the given filter, from the given parquet file.

filterRowKeys(Set) - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

filterRowKeys(Set<String>) - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

filterRowKeys(Set<String>) - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

Filter keys by availability.

finalizeWrite() - Method in class org.apache.hudi.avro.HoodieAvroWriteSupport

finish() - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexWriter

fromFileStatus(FileStatus) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

fromFileStatus(FileStatus) - Static method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

fromFileStatuses(FileStatus[]) - Static method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

fromFSPermission(FsPermission) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

fromPath(Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

G

get() - Method in interface org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem.CheckedFunction

get() - Method in class org.apache.hudi.hadoop.fs.SerializablePath

getAccessTime() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getAclStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getAllDataFilesInPartition(FileSystem, Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Get the names of all the base and log files in the given partition path.

getBlockSize() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getBlockSize(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getBlockSize() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

getBlockSize() - Method in class org.apache.hudi.io.storage.HoodieParquetConfig

getBloomFilter() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

getBooleanWithAltKeys(Configuration, ConfigProperty<?>) - Static method in class org.apache.hudi.common.util.HadoopConfigUtils

Gets the boolean value for a ConfigProperty config from Hadoop configuration.

getBootstrapBasePath() - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexReader

getBytesWritten(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getBytesWritten() - Method in class org.apache.hudi.hadoop.fs.SizeAwareFSDataOutputStream

getCanonicalServiceName() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getChildFileSystems() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getCompressionAlgorithm() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

getCompressionCodecName(String) - Static method in class org.apache.hudi.common.util.ParquetUtils

getCompressionCodecName() - Method in class org.apache.hudi.io.storage.HoodieParquetConfig

getCompressionRatio() - Method in class org.apache.hudi.io.storage.HoodieParquetConfig

getConf() - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

getConf() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getContentSummary(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getCurrentSize() - Method in class org.apache.hudi.common.table.log.HoodieLogFormatWriter

getDataSize() - Method in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

getDefaultBlockSize() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getDefaultBlockSize(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getDefaultBlockSize(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

getDefaultBufferSize() - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

getDefaultReplication() - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

getDefaultReplication(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

getDefaultReplication() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getDefaultReplication(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getDefaultReplication(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

getDelegationToken(String) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getDFSFullPartitionPath(FileSystem, Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Get DFS full partition path (e.g.

getFileAsBytes() - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

getFileBlockLocations(FileStatus, long, long) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getFileBlockLocations(Path, long, long) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getFileChecksum(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getFileChecksum(Path, long) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getFileDescriptor() - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

getFileFormatUtils(HoodieFileFormat) - Method in class org.apache.hudi.io.hadoop.HoodieHadoopIOFactory

getFileIdFromFilePath(Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Check if the file is a base file of a log file.

getFileIdFromLogPath(Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Get the first part of the file name in the log file.

getFileLinkStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getFileSize(FileSystem, Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getFileStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

getFileStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getFileStatus(Path) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

getFileStatus(Path) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

getFileStatusAtLevel(HoodieEngineContext, FileSystem, Path, int, int) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Lists file status at a certain level in the directory hierarchy.

getFileSystem() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getFileSystem() - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

getFormat() - Method in class org.apache.hudi.common.util.HFileUtils

getFormat() - Method in class org.apache.hudi.common.util.OrcUtils

getFormat() - Method in class org.apache.hudi.common.util.ParquetUtils

getFs(String, StorageConfiguration<T>) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getFs(Path, StorageConfiguration<T>) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getFs(Path, StorageConfiguration<T>, boolean) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getFs(String, Configuration) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getFs(StoragePath, Configuration) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getFs(Path, Configuration) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getFs(String, Configuration, boolean) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getFSDataInputStream(FileSystem, StoragePath, int, boolean) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Fetch the right FSDataInputStream to be used by wrapping with required input streams.

getGlobalProperties() - Method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

getGlobalProps() - Static method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

getGroup() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getHadoopConf() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

getHFileComparator() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

getHFileCompressionAlgorithm(Map<String, String>) - Static method in class org.apache.hudi.common.util.HFileUtils

Gets the Compression.Algorithm Enum based on the CompressionCodec name.

getHomeDirectory() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getHoodieKeyIterator(HoodieStorage, StoragePath, Option<BaseKeyGenerator>) - Method in class org.apache.hudi.common.util.HFileUtils

getHoodieKeyIterator(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.HFileUtils

getHoodieKeyIterator(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.OrcUtils

Provides a closable iterator for reading the given ORC file.

getHoodieKeyIterator(HoodieStorage, StoragePath, Option<BaseKeyGenerator>) - Method in class org.apache.hudi.common.util.OrcUtils

getHoodieKeyIterator(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.ParquetUtils

getHoodieKeyIterator(HoodieStorage, StoragePath, Option<BaseKeyGenerator>) - Method in class org.apache.hudi.common.util.ParquetUtils

Returns a closable iterator for reading the given parquet file.

getHoodieScheme(String) - Static method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getIndexedFileGroupIds() - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexReader

getIndexedPartitionPaths() - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexReader

getIndexedRecordIterator(Schema, Schema) - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

getIndexedRecordIterator(Schema) - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

getIndexedRecordIterator(Schema, Schema) - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

getIndexedRecordIterator(Schema, Schema) - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

getIndexedRecordsByKeyPrefixIterator(List<String>, Schema) - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

getIndexedRecordsByKeysIterator(List<String>, Schema) - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

getInline() - Method in class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

getKeyFieldName() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

getLen() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getLength(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getLinkTarget(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getLogFile() - Method in class org.apache.hudi.common.table.log.HoodieLogFormatWriter

getMaxFileSize() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

getMaxFileSize() - Method in class org.apache.hudi.io.storage.HoodieParquetConfig

getModificationTime() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getName() - Method in class org.apache.hudi.hadoop.fs.CachingPath

getName() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getOuterFilePathFromInlinePath(Path) - Static method in class org.apache.hudi.hadoop.fs.inline.HadoopInLineFSUtils

InlineFS Path format: "inlinefs://path/to/outer/file/outer_file_scheme/?start_offset=start_offset>&length="

getOwner() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getPageSize() - Method in class org.apache.hudi.io.storage.HoodieParquetConfig

getParent() - Method in class org.apache.hudi.hadoop.fs.CachingPath

getPath() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getPathInfo(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

getPathWithoutSchemeAndAuthority(Path) - Static method in class org.apache.hudi.hadoop.fs.CachingPath

This is Path.getPathWithoutSchemeAndAuthority(Path) counterpart, instantiating CachingPath

getPermission() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getPos() - Method in class org.apache.hudi.hadoop.fs.HadoopSeekableDataInputStream

getPos() - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

getProps() - Method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

getProps(boolean) - Method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

getRawStorage() - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

getRawValueWithAltKeys(Configuration, ConfigProperty<?>) - Static method in class org.apache.hudi.common.util.HadoopConfigUtils

Gets the raw value for a ConfigProperty config from Hadoop configuration.

getReaderFactory(HoodieRecord.HoodieRecordType) - Method in class org.apache.hudi.io.hadoop.HoodieHadoopIOFactory

getReadSupport() - Method in class org.apache.parquet.avro.HoodieAvroParquetReaderBuilder

getRecordCountForNextSizeCheck() - Method in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

getRecordIterator(Schema) - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

getRecordKeyIterator() - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

getRecordKeyIterator() - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

getRecordKeyIterator() - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

getRecordsByKeyPrefixIterator(List<String>, Schema) - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

getRecordsByKeysIterator(List<String>, Schema) - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

getRelativePartitionPath(Path, Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Given a base partition and a partition path, return relative path of partition path to the base path.

getReplication() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getReplication(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getRowCount(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.HFileUtils

getRowCount(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.OrcUtils

getRowCount(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.ParquetUtils

Returns the number of records in the parquet file.

getSchema() - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

getSchema() - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

getSchema() - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

getScheme() - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

getScheme() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getScheme() - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

getScheme() - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

getScheme() - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

getServerDefaults() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getServerDefaults(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getSizeThreshold() - Method in class org.apache.hudi.common.table.log.HoodieLogFormatWriter

getSourceFileMappingForFileIds(List<HoodieFileGroupId>) - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexReader

getSourceFileMappingForPartition(String) - Method in class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexReader

getStatus() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getStorage(StoragePath) - Method in class org.apache.hudi.io.hadoop.HoodieHadoopIOFactory

getStorage(StoragePath, boolean, long, int, long, String, ConsistencyGuard) - Method in class org.apache.hudi.io.hadoop.HoodieHadoopIOFactory

getStorageConf(Configuration) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getStorageConf() - Method in class org.apache.hudi.io.storage.HoodieParquetConfig

getStorageConfWithCopy(Configuration) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

getString(String) - Method in class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

getSymlink() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

getTableParquetSchema() - Method in class org.apache.hudi.common.table.ParquetTableSchemaResolver

Gets full schema (user + metadata) for a hoodie table in Parquet format.

getTableParquetSchema(boolean) - Method in class org.apache.hudi.common.table.ParquetTableSchemaResolver

Gets users data schema for a hoodie table in Parquet format.

getTotalRecords() - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

getTotalRecords() - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

getTotalRecords() - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

getUri() - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

getUri() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getUri() - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

getUri() - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

getUri() - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

getUsed() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getWorkingDirectory() - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

getWorkingDirectory() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getWorkingDirectory() - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

getWorkingDirectory() - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

getWriterFactory(HoodieRecord.HoodieRecordType) - Method in class org.apache.hudi.io.hadoop.HoodieHadoopIOFactory

getWriteSupport() - Method in class org.apache.hudi.io.storage.HoodieParquetConfig

getWrittenRecordCount() - Method in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

getXAttr(Path, String) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getXAttrs(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

getXAttrs(Path, List<String>) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

globEntries(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

globEntries(StoragePath, StoragePathFilter) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

globStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

globStatus(Path, PathFilter) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

globStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

globStatus(Path, PathFilter) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

H

HadoopConfigUtils - Class in org.apache.hudi.common.util

Utils on Hadoop Configuration.

HadoopConfigUtils() - Constructor for class org.apache.hudi.common.util.HadoopConfigUtils

HadoopFSUtils - Class in org.apache.hudi.hadoop.fs

Utility functions related to accessing the file storage on Hadoop.

HadoopFSUtils() - Constructor for class org.apache.hudi.hadoop.fs.HadoopFSUtils

HadoopInLineFSUtils - Class in org.apache.hudi.hadoop.fs.inline

Utils to parse InLineFileSystem paths.

HadoopInLineFSUtils() - Constructor for class org.apache.hudi.hadoop.fs.inline.HadoopInLineFSUtils

HadoopSeekableDataInputStream - Class in org.apache.hudi.hadoop.fs

An implementation of SeekableDataInputStream based on Hadoop's FSDataInputStream

HadoopSeekableDataInputStream(FSDataInputStream) - Constructor for class org.apache.hudi.hadoop.fs.HadoopSeekableDataInputStream

HadoopStorageConfiguration - Class in org.apache.hudi.storage.hadoop

Implementation of StorageConfiguration providing Hadoop's Configuration.

HadoopStorageConfiguration(Boolean) - Constructor for class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

HadoopStorageConfiguration(Configuration) - Constructor for class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

HadoopStorageConfiguration(Configuration, boolean) - Constructor for class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

HadoopStorageConfiguration(HadoopStorageConfiguration) - Constructor for class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

handleParquetBloomFilters(ParquetWriter.Builder, Configuration) - Method in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

Once we get parquet version >= 1.12 among all engines we can cleanup the reflexion hack.

hashCode() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

hasNext() - Method in class org.apache.hudi.common.util.ParquetReaderIterator

hasNext() - Method in class org.apache.hudi.io.hadoop.OrcReaderIterator

HBaseHFileBootstrapIndexReader - Class in org.apache.hudi.common.bootstrap.index.hfile

HBase HFile reader based Index Reader.

HBaseHFileBootstrapIndexReader(HoodieTableMetaClient) - Constructor for class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexReader

HBaseHFileBootstrapIndexWriter - Class in org.apache.hudi.common.bootstrap.index.hfile

HBaseHFileBootstrapIndexWriter(String, HoodieTableMetaClient) - Constructor for class org.apache.hudi.common.bootstrap.index.hfile.HBaseHFileBootstrapIndexWriter

HFILE_COMPARATOR - Static variable in class org.apache.hudi.io.hadoop.HoodieHFileConfig

HFileBootstrapIndex - Class in org.apache.hudi.common.bootstrap.index

WARNING: DO NOT DO ANYTHING TO THIS CLASS INCLUDING CHANGING THE PACKAGE OR YOU COULD BREAK BACKWARDS COMPATIBILITY!!! see https://github.com/apache/hudi/pull/5004

HFileBootstrapIndex() - Constructor for class org.apache.hudi.common.bootstrap.index.HFileBootstrapIndex

HFileBootstrapIndex.HoodieKVComparator - Class in org.apache.hudi.common.bootstrap.index

This class is explicitly used as Key Comparator to workaround hard coded legacy format class names inside HBase.

HFileUtils - Class in org.apache.hudi.common.util

Utility functions for HFile files.

HFileUtils() - Constructor for class org.apache.hudi.common.util.HFileUtils

HOODIE_SCHEME_PREFIX - Static variable in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

HoodieAvroFileReaderFactory - Class in org.apache.hudi.io.hadoop

HoodieAvroFileReaderFactory(HoodieStorage) - Constructor for class org.apache.hudi.io.hadoop.HoodieAvroFileReaderFactory

HoodieAvroFileWriterFactory - Class in org.apache.hudi.io.hadoop

HoodieAvroFileWriterFactory(HoodieStorage) - Constructor for class org.apache.hudi.io.hadoop.HoodieAvroFileWriterFactory

HoodieAvroHFileWriter - Class in org.apache.hudi.io.hadoop

HoodieHFileWriter writes IndexedRecords into an HFile.

HoodieAvroHFileWriter(String, StoragePath, HoodieHFileConfig, Schema, TaskContextSupplier, boolean) - Constructor for class org.apache.hudi.io.hadoop.HoodieAvroHFileWriter

HoodieAvroOrcReader - Class in org.apache.hudi.io.hadoop

HoodieFileReader implementation for ORC format.

HoodieAvroOrcReader(HoodieStorage, StoragePath) - Constructor for class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

HoodieAvroOrcWriter - Class in org.apache.hudi.io.hadoop

HoodieAvroOrcWriter(String, StoragePath, HoodieOrcConfig, Schema, TaskContextSupplier) - Constructor for class org.apache.hudi.io.hadoop.HoodieAvroOrcWriter

HoodieAvroParquetReader - Class in org.apache.hudi.io.hadoop

HoodieFileReader implementation for parquet format.

HoodieAvroParquetReader(HoodieStorage, StoragePath) - Constructor for class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

HoodieAvroParquetReaderBuilder<T> - Class in org.apache.parquet.avro

Copy from org.apache.parquet.avro.AvroParquetReader.Builder.

HoodieAvroParquetReaderBuilder(StoragePath) - Constructor for class org.apache.parquet.avro.HoodieAvroParquetReaderBuilder

Deprecated.

HoodieAvroParquetReaderBuilder(InputFile) - Constructor for class org.apache.parquet.avro.HoodieAvroParquetReaderBuilder

HoodieAvroParquetWriter - Class in org.apache.hudi.io.hadoop

HoodieParquetWriter extends the ParquetWriter to help limit the size of underlying file.

HoodieAvroParquetWriter(StoragePath, HoodieParquetConfig<HoodieAvroWriteSupport>, String, TaskContextSupplier, boolean) - Constructor for class org.apache.hudi.io.hadoop.HoodieAvroParquetWriter

HoodieAvroReadSupport<T> - Class in org.apache.parquet.avro

Support to avro-record read parquet-log which written by spark-record.

HoodieAvroReadSupport(GenericData) - Constructor for class org.apache.parquet.avro.HoodieAvroReadSupport

HoodieAvroReadSupport() - Constructor for class org.apache.parquet.avro.HoodieAvroReadSupport

HoodieAvroWriteSupport<T> - Class in org.apache.hudi.avro

Wrap AvroWriterSupport for plugging in the bloom filter.

HoodieAvroWriteSupport(MessageType, Schema, Option<BloomFilter>, Properties) - Constructor for class org.apache.hudi.avro.HoodieAvroWriteSupport

HoodieBaseParquetWriter<R> - Class in org.apache.hudi.io.hadoop

Base class of Hudi's custom ParquetWriter implementations

HoodieBaseParquetWriter(StoragePath, HoodieParquetConfig<? extends WriteSupport<R>>) - Constructor for class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

HoodieHadoopIOFactory - Class in org.apache.hudi.io.hadoop

Creates readers and writers for AVRO record payloads.

HoodieHadoopIOFactory(HoodieStorage) - Constructor for class org.apache.hudi.io.hadoop.HoodieHadoopIOFactory

HoodieHadoopStorage - Class in org.apache.hudi.storage.hadoop

Implementation of HoodieStorage using Hadoop's FileSystem

HoodieHadoopStorage(StoragePath, StorageConfiguration<?>) - Constructor for class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

HoodieHadoopStorage(Path, Configuration) - Constructor for class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

HoodieHadoopStorage(String, Configuration) - Constructor for class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

HoodieHadoopStorage(String, StorageConfiguration<?>) - Constructor for class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

HoodieHadoopStorage(StoragePath, StorageConfiguration<?>, boolean, long, int, long, String, ConsistencyGuard) - Constructor for class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

HoodieHadoopStorage(FileSystem) - Constructor for class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

HoodieHBaseAvroHFileReader - Class in org.apache.hudi.io.hadoop

NOTE: PLEASE READ DOCS & COMMENTS CAREFULLY BEFORE MAKING CHANGES

HoodieHBaseAvroHFileReader(StorageConfiguration<?>, StoragePath, Option<Schema>) - Constructor for class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

HoodieHBaseAvroHFileReader(StorageConfiguration<?>, StoragePath, HoodieStorage, byte[], Option<Schema>) - Constructor for class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

HoodieHBaseAvroHFileReader(StorageConfiguration<?>, StoragePath) - Constructor for class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

HoodieHBaseAvroHFileReader(StoragePath, HoodieStorage, StorageConfiguration<?>, Option<Schema>, Option<byte[]>) - Constructor for class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

HoodieHBaseKVComparator - Class in org.apache.hudi.io.storage

This class is explicitly used as Key Comparator to work around the hard coded legacy format class names inside HBase.

HoodieHBaseKVComparator() - Constructor for class org.apache.hudi.io.storage.HoodieHBaseKVComparator

HoodieHFileConfig - Class in org.apache.hudi.io.hadoop

HoodieHFileConfig(Configuration, Compression.Algorithm, int, long, String, boolean, boolean, boolean, BloomFilter, CellComparator) - Constructor for class org.apache.hudi.io.hadoop.HoodieHFileConfig

HoodieHFileUtils - Class in org.apache.hudi.io.hadoop

Util class for HFile reading and writing in Hudi

HoodieHFileUtils() - Constructor for class org.apache.hudi.io.hadoop.HoodieHFileUtils

HoodieKVComparator() - Constructor for class org.apache.hudi.common.bootstrap.index.HFileBootstrapIndex.HoodieKVComparator

HoodieLogFormatWriter - Class in org.apache.hudi.common.table.log

HoodieLogFormatWriter can be used to append blocks to a log file Use HoodieLogFormat.WriterBuilder to construct.

HoodieLogFormatWriter(HoodieStorage, HoodieLogFile, Integer, Short, Long, String, HoodieLogFileWriteCallback) - Constructor for class org.apache.hudi.common.table.log.HoodieLogFormatWriter

HoodieParquetConfig<T> - Class in org.apache.hudi.io.storage

Base ParquetConfig to hold config params for writing to Parquet.

HoodieParquetConfig(T, CompressionCodecName, int, int, long, StorageConfiguration<?>, double, boolean) - Constructor for class org.apache.hudi.io.storage.HoodieParquetConfig

HoodieParquetStreamWriter - Class in org.apache.hudi.io.hadoop

Hudi log block writer for parquet format.

HoodieParquetStreamWriter(FSDataOutputStream, HoodieParquetConfig<HoodieAvroWriteSupport>) - Constructor for class org.apache.hudi.io.hadoop.HoodieParquetStreamWriter

HoodieRetryWrapperFileSystem - Class in org.apache.hudi.hadoop.fs

Extending FileSystem implementation of I/O operations with retries.

HoodieRetryWrapperFileSystem(FileSystem, long, int, long, String) - Constructor for class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

HoodieSerializableFileStatus - Class in org.apache.hudi.hadoop.fs

A serializable file status implementation

HoodieWrapperFileSystem - Class in org.apache.hudi.hadoop.fs

HoodieWrapperFileSystem wraps the default file system.

HoodieWrapperFileSystem() - Constructor for class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

HoodieWrapperFileSystem(FileSystem, ConsistencyGuard) - Constructor for class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

HoodieWrapperFileSystem.CheckedFunction<R> - Interface in org.apache.hudi.hadoop.fs

Checked function interface.

HoodieWrapperFileSystem.MetricName - Enum in org.apache.hudi.hadoop.fs

Names for metrics.

I

init(Configuration, Map<String, String>, MessageType) - Method in class org.apache.parquet.avro.HoodieAvroReadSupport

initialize(URI, Configuration) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

initialize(URI, Configuration) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

initialize(URI, Configuration) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

InLineFileSystem - Class in org.apache.hudi.hadoop.fs.inline

Enables reading any inline file at a given offset and length.

InLineFileSystem() - Constructor for class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

InLineFsDataInputStream - Class in org.apache.hudi.hadoop.fs.inline

Inline FSDataInputStream.

InLineFsDataInputStream(long, FSDataInputStream, long) - Constructor for class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

InMemoryFileSystem - Class in org.apache.hudi.hadoop.fs.inline

A FileSystem which stores all content in memory and returns a byte[] when InMemoryFileSystem.getFileAsBytes() is called This FileSystem is used only in write path.

isBaseFile(Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

isCHDFileSystem(FileSystem) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Chdfs will throw IOException instead of EOFException.

isDataFile(Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

Returns true if the given path is a Base file or a Log file.

isDirectory() - Method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

isDirectory(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

isFile(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

isGCSFileSystem(FileSystem) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

This is due to HUDI-140 GCS has a different behavior for detecting EOF during seek().

isLogFile(Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

L

listCorruptFileBlocks(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

listDirectEntries(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

listDirectEntries(List<StoragePath>) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

listDirectEntries(StoragePath, StoragePathFilter) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

listFiles(Path, boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

listFiles(Path, boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

listFiles(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

listLocatedStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

listLocatedStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

listStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

listStatus(Path, PathFilter) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

listStatus(Path[]) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

listStatus(Path[], PathFilter) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

listStatus(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

listStatus(Path, PathFilter) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

listStatus(Path[]) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

listStatus(Path[], PathFilter) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

listStatus(Path) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

listStatus(Path) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

listXAttrs(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

loadGlobalProps() - Static method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

Load global props from hudi-defaults.conf which is under class loader or CONF_FILE_DIR_ENV_NAME.

M

makeQualified(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

markSupported() - Method in class org.apache.hudi.hadoop.fs.BoundedFsDataInputStream

mkdirs(Path, FsPermission) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

mkdirs(Path, FsPermission) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

mkdirs(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

mkdirs(Path, FsPermission) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

mkdirs(Path, FsPermission) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

modifyAclEntries(Path, List<AclEntry>) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

moveFromLocalFile(Path[], Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

moveFromLocalFile(Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

moveToLocalFile(Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

N

newBootstrapFileReader(HoodieFileReader, HoodieFileReader, Option<String[]>, Object[]) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileReaderFactory

newHFileFileReader(HoodieConfig, StoragePath, Option<Schema>) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileReaderFactory

newHFileFileReader(HoodieConfig, StoragePath, HoodieStorage, byte[], Option<Schema>) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileReaderFactory

newHFileFileWriter(String, StoragePath, HoodieConfig, Schema, TaskContextSupplier) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileWriterFactory

newInstance() - Method in class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

newInstance(StoragePath, StorageConfiguration<?>) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

newOrcFileReader(StoragePath) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileReaderFactory

newOrcFileWriter(String, StoragePath, HoodieConfig, Schema, TaskContextSupplier) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileWriterFactory

newParquetFileReader(StoragePath) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileReaderFactory

newParquetFileWriter(String, StoragePath, HoodieConfig, Schema, TaskContextSupplier) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileWriterFactory

newParquetFileWriter(OutputStream, HoodieConfig, Schema) - Method in class org.apache.hudi.io.hadoop.HoodieAvroFileWriterFactory

next() - Method in class org.apache.hudi.common.util.ParquetReaderIterator

next() - Method in class org.apache.hudi.io.hadoop.OrcReaderIterator

O

open(Path, int) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

open(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

open(Path, int) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

open(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

open(Path, int) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

open(Path, int) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

open(StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

openSeekable(StoragePath, int, boolean) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

OrcReaderIterator<T> - Class in org.apache.hudi.io.hadoop

This class wraps a ORC reader and provides an iterator based api to read from an ORC file.

OrcReaderIterator(RecordReader, Schema, TypeDescription) - Constructor for class org.apache.hudi.io.hadoop.OrcReaderIterator

OrcUtils - Class in org.apache.hudi.common.util

Utility functions for ORC files.

OrcUtils() - Constructor for class org.apache.hudi.common.util.OrcUtils

org.apache.hudi.avro - package org.apache.hudi.avro

org.apache.hudi.common.bootstrap.index - package org.apache.hudi.common.bootstrap.index

org.apache.hudi.common.bootstrap.index.hfile - package org.apache.hudi.common.bootstrap.index.hfile

org.apache.hudi.common.config - package org.apache.hudi.common.config

org.apache.hudi.common.table - package org.apache.hudi.common.table

org.apache.hudi.common.table.log - package org.apache.hudi.common.table.log

org.apache.hudi.common.util - package org.apache.hudi.common.util

org.apache.hudi.hadoop.fs - package org.apache.hudi.hadoop.fs

org.apache.hudi.hadoop.fs.inline - package org.apache.hudi.hadoop.fs.inline

org.apache.hudi.io.hadoop - package org.apache.hudi.io.hadoop

org.apache.hudi.io.storage - package org.apache.hudi.io.storage

org.apache.hudi.parquet.io - package org.apache.hudi.parquet.io

org.apache.hudi.storage.hadoop - package org.apache.hudi.storage.hadoop

org.apache.parquet.avro - package org.apache.parquet.avro

OutputStreamBackedOutputFile - Class in org.apache.hudi.parquet.io

Implementation of the OutputFile backed by OutputStream

OutputStreamBackedOutputFile(FSDataOutputStream) - Constructor for class org.apache.hudi.parquet.io.OutputStreamBackedOutputFile

P

parallelizeFilesProcess(HoodieEngineContext, FileSystem, int, FSUtils.SerializableFunction<Pair<String, StorageConfiguration<Configuration>>, T>, List<String>) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

ParquetReaderIterator<T> - Class in org.apache.hudi.common.util

This class wraps a parquet reader and provides an iterator based api to read from a parquet file.

ParquetReaderIterator(ParquetReader<? extends T>) - Constructor for class org.apache.hudi.common.util.ParquetReaderIterator

ParquetTableSchemaResolver - Class in org.apache.hudi.common.table

ParquetTableSchemaResolver(HoodieTableMetaClient) - Constructor for class org.apache.hudi.common.table.ParquetTableSchemaResolver

ParquetUtils - Class in org.apache.hudi.common.util

Utility functions involving with parquet.

ParquetUtils() - Constructor for class org.apache.hudi.common.util.ParquetUtils

PREFETCH_ON_OPEN - Static variable in class org.apache.hudi.io.hadoop.HoodieHFileConfig

prepareHadoopConf(Configuration) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

properties - Variable in class org.apache.hudi.avro.HoodieAvroWriteSupport

R

read(long, byte[], int, int) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

read(ByteBuffer) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

read(ByteBufferPool, int, EnumSet<ReadOption>) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

read(ByteBuffer) - Method in class org.apache.hudi.hadoop.fs.TimedFSDataInputStream

read(long, byte[], int, int) - Method in class org.apache.hudi.hadoop.fs.TimedFSDataInputStream

read(ByteBufferPool, int, EnumSet<ReadOption>) - Method in class org.apache.hudi.hadoop.fs.TimedFSDataInputStream

readAvroRecords(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.HFileUtils

readAvroRecords(HoodieStorage, StoragePath, Schema) - Method in class org.apache.hudi.common.util.HFileUtils

readAvroRecords(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.OrcUtils

NOTE: This literally reads the entire file contents, thus should be used with caution.

readAvroRecords(HoodieStorage, StoragePath, Schema) - Method in class org.apache.hudi.common.util.OrcUtils

NOTE: This literally reads the entire file contents, thus should be used with caution.

readAvroRecords(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.ParquetUtils

NOTE: This literally reads the entire file contents, thus should be used with caution.

readAvroRecords(HoodieStorage, StoragePath, Schema) - Method in class org.apache.hudi.common.util.ParquetUtils

readAvroSchema(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.HFileUtils

readAvroSchema(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.OrcUtils

readAvroSchema(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.ParquetUtils

readBloomFilter() - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

readBloomFilter() - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

readBloomFilter() - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

readColumnStatsFromMetadata(HoodieStorage, StoragePath, List<String>) - Method in class org.apache.hudi.common.util.HFileUtils

readColumnStatsFromMetadata(HoodieStorage, StoragePath, List<String>) - Method in class org.apache.hudi.common.util.OrcUtils

readColumnStatsFromMetadata(HoodieStorage, StoragePath, List<String>) - Method in class org.apache.hudi.common.util.ParquetUtils

readFooter(HoodieStorage, boolean, StoragePath, String...) - Method in class org.apache.hudi.common.util.HFileUtils

readFooter(HoodieStorage, boolean, StoragePath, String...) - Method in class org.apache.hudi.common.util.OrcUtils

readFooter(HoodieStorage, boolean, StoragePath, String...) - Method in class org.apache.hudi.common.util.ParquetUtils

readFromVector(TypeDescription, ColumnVector, Schema, int) - Static method in class org.apache.hudi.common.util.AvroOrcUtils

Read the Column vector at a given position conforming to a given ORC schema.

readFully(long, byte[], int, int) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

readFully(long, byte[]) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

readFully(long, byte[]) - Method in class org.apache.hudi.hadoop.fs.TimedFSDataInputStream

readFully(long, byte[], int, int) - Method in class org.apache.hudi.hadoop.fs.TimedFSDataInputStream

readMetadata(HoodieStorage, StoragePath) - Static method in class org.apache.hudi.common.util.ParquetUtils

readMinMaxRecordKeys() - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcReader

readMinMaxRecordKeys() - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetReader

readMinMaxRecordKeys() - Method in class org.apache.hudi.io.hadoop.HoodieHBaseAvroHFileReader

readSchema(HoodieStorage, StoragePath) - Method in class org.apache.hudi.common.util.ParquetUtils

Get the schema of the given parquet file.

recoverDFSFileLease(DistributedFileSystem, Path) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

When a file was opened and the task died without closing the stream, another task executor cannot open because the existing lease will be active.

refreshGlobalProps() - Static method in class org.apache.hudi.common.config.DFSPropertiesConfiguration

registerFileSystem(StoragePath, Configuration) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

releaseBuffer(ByteBuffer) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

removeAcl(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

removeAclEntries(Path, List<AclEntry>) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

removeDefaultAcl(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

removeXAttr(Path, String) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

rename(Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

rename(Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

rename(Path, Path) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

rename(Path, Path) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

rename(StoragePath, StoragePath) - Method in class org.apache.hudi.storage.hadoop.HoodieHadoopStorage

renameSnapshot(Path, String, String) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

resolvePath(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

S

SCHEME - Static variable in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

SCHEME - Static variable in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

SchemeAwareFSDataInputStream - Class in org.apache.hudi.hadoop.fs

Scheme aware FSDataInputStream so that we manipulate seeks for GS filesystem.

SchemeAwareFSDataInputStream(InputStream, boolean) - Constructor for class org.apache.hudi.hadoop.fs.SchemeAwareFSDataInputStream

seek(long) - Method in class org.apache.hudi.hadoop.fs.BoundedFsDataInputStream

seek(long) - Method in class org.apache.hudi.hadoop.fs.HadoopSeekableDataInputStream

seek(long) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

seek(long) - Method in class org.apache.hudi.hadoop.fs.SchemeAwareFSDataInputStream

seekToNewSource(long) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

SerializablePath - Class in org.apache.hudi.hadoop.fs

Serializable wrapper encapsulating Path

SerializablePath(Path) - Constructor for class org.apache.hudi.hadoop.fs.SerializablePath

serializeRecordsToLogBlock(HoodieStorage, List<HoodieRecord>, Schema, Schema, String, Map<String, String>) - Method in class org.apache.hudi.common.util.HFileUtils

serializeRecordsToLogBlock(HoodieStorage, List<HoodieRecord>, Schema, Schema, String, Map<String, String>) - Method in class org.apache.hudi.common.util.OrcUtils

serializeRecordsToLogBlock(HoodieStorage, List<HoodieRecord>, Schema, Schema, String, Map<String, String>) - Method in class org.apache.hudi.common.util.ParquetUtils

set(String, String) - Method in class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

setAcl(Path, List<AclEntry>) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setConf(Configuration) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setDropBehind(Boolean) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

setMetricsRegistry(Registry, Registry) - Static method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setOwner(Path, String, String) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setPermission(Path, FsPermission) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setReadahead(Long) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

setReplication(Path, short) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setTimes(Path, long, long) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setVerifyChecksum(boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setWorkingDirectory(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieRetryWrapperFileSystem

setWorkingDirectory(Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setWorkingDirectory(Path) - Method in class org.apache.hudi.hadoop.fs.inline.InLineFileSystem

setWorkingDirectory(Path) - Method in class org.apache.hudi.hadoop.fs.inline.InMemoryFileSystem

setWriteChecksum(boolean) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setXAttr(Path, String, byte[]) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

setXAttr(Path, String, byte[], EnumSet<XAttrSetFlag>) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

shouldCacheDataInL1() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

shouldDropBehindCacheCompaction() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

shouldPrefetchBlocksOnOpen() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

SizeAwareFSDataOutputStream - Class in org.apache.hudi.hadoop.fs

Wrapper over FSDataOutputStream to keep track of the size of the written bytes.

SizeAwareFSDataOutputStream(Path, FSDataOutputStream, ConsistencyGuard, Runnable) - Constructor for class org.apache.hudi.hadoop.fs.SizeAwareFSDataOutputStream

skip(long) - Method in class org.apache.hudi.hadoop.fs.BoundedFsDataInputStream

startLocalOutput(Path, Path) - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

subPath(String) - Method in class org.apache.hudi.hadoop.fs.CachingPath

supportsBlockSize() - Method in class org.apache.hudi.parquet.io.OutputStreamBackedOutputFile

supportsSymlinks() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

T

TimedFSDataInputStream - Class in org.apache.hudi.hadoop.fs

Wrapper over FSDataInputStream that also times the operations.

TimedFSDataInputStream(Path, FSDataInputStream) - Constructor for class org.apache.hudi.hadoop.fs.TimedFSDataInputStream

toFileStatus(HoodieSerializableFileStatus) - Static method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

toFileStatuses(HoodieSerializableFileStatus[]) - Static method in class org.apache.hudi.hadoop.fs.HoodieSerializableFileStatus

toFSPermission(HoodieFSPermission) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

toPath(HoodiePath) - Static method in class org.apache.hudi.hadoop.fs.HadoopFSUtils

toString() - Method in class org.apache.hudi.hadoop.fs.CachingPath

toString() - Method in class org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem

toString() - Method in class org.apache.hudi.hadoop.fs.SerializablePath

toString() - Method in class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

U

unbuffer() - Method in class org.apache.hudi.hadoop.fs.inline.InLineFsDataInputStream

unwrap() - Method in class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

unwrapCopy() - Method in class org.apache.hudi.storage.hadoop.HadoopStorageConfiguration

useBloomFilter() - Method in class org.apache.hudi.io.hadoop.HoodieHFileConfig

V

valueOf(String) - Static method in enum org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem.MetricName

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem.MetricName

Returns an array containing the constants of this enum type, in the order they are declared.

W

withCompatibility(boolean) - Method in class org.apache.parquet.avro.HoodieAvroParquetReaderBuilder

withDataModel(GenericData) - Method in class org.apache.parquet.avro.HoodieAvroParquetReaderBuilder

wrap(Path) - Static method in class org.apache.hudi.hadoop.fs.CachingPath

write(byte[], int, int) - Method in class org.apache.hudi.hadoop.fs.SizeAwareFSDataOutputStream

write(byte[]) - Method in class org.apache.hudi.hadoop.fs.SizeAwareFSDataOutputStream

write(R) - Method in class org.apache.hudi.io.hadoop.HoodieBaseParquetWriter

writeAvro(String, IndexedRecord) - Method in class org.apache.hudi.io.hadoop.HoodieAvroHFileWriter

writeAvro(String, IndexedRecord) - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcWriter

writeAvro(String, IndexedRecord) - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetWriter

writeAvro(String, IndexedRecord) - Method in class org.apache.hudi.io.hadoop.HoodieParquetStreamWriter

writeAvroWithMetadata(HoodieKey, IndexedRecord) - Method in class org.apache.hudi.io.hadoop.HoodieAvroHFileWriter

writeAvroWithMetadata(HoodieKey, IndexedRecord) - Method in class org.apache.hudi.io.hadoop.HoodieAvroOrcWriter

writeAvroWithMetadata(HoodieKey, IndexedRecord) - Method in class org.apache.hudi.io.hadoop.HoodieAvroParquetWriter

writeAvroWithMetadata(HoodieKey, IndexedRecord) - Method in class org.apache.hudi.io.hadoop.HoodieParquetStreamWriter

writeMetaFile(HoodieStorage, StoragePath, Properties) - Method in class org.apache.hudi.common.util.HFileUtils

writeMetaFile(HoodieStorage, StoragePath, Properties) - Method in class org.apache.hudi.common.util.OrcUtils

writeMetaFile(HoodieStorage, StoragePath, Properties) - Method in class org.apache.hudi.common.util.ParquetUtils

A B C D E F G H I L M N O P R S T U V W