org.apache.hudi.io.hadoop

Class HoodieHFileUtils

java.lang.Object

org.apache.hudi.io.hadoop.HoodieHFileUtils

public class HoodieHFileUtils
extends Object

Util class for HFile reading and writing in Hudi

Constructor Summary

Constructors

Constructor and Description
HoodieHFileUtils()

Method Summary

Modifier and Type	Method and Description
static org.apache.hadoop.hbase.io.hfile.HFile.Reader	createHFileReader(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, org.apache.hadoop.hbase.io.hfile.CacheConfig cacheConfig, org.apache.hadoop.conf.Configuration configuration) Creates HFile reader for a file with default `primaryReplicaReader` as true.
static org.apache.hadoop.hbase.io.hfile.HFile.Reader	createHFileReader(HoodieStorage storage, StoragePath dummyPath, byte[] content) Creates HFile reader for byte array with default `primaryReplicaReader` as true.
static org.apache.hadoop.hbase.io.hfile.HFile.Reader	createHFileReader(HoodieStorage storage, StoragePath path, org.apache.hadoop.hbase.io.hfile.CacheConfig cacheConfig, org.apache.hadoop.conf.Configuration configuration) Creates HFile reader for a file with default `primaryReplicaReader` as true.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieHFileUtils

public HoodieHFileUtils()

Method Detail

createHFileReader

public static org.apache.hadoop.hbase.io.hfile.HFile.Reader createHFileReader(org.apache.hadoop.fs.FileSystem fs,
                                                                              org.apache.hadoop.fs.Path path,
                                                                              org.apache.hadoop.hbase.io.hfile.CacheConfig cacheConfig,
                                                                              org.apache.hadoop.conf.Configuration configuration)

Creates HFile reader for a file with default `primaryReplicaReader` as true.

Parameters:

fs - File system.

path - Path to file to read.

cacheConfig - Cache configuration.

configuration - Configuration

Returns:

HFile reader

Throws:

IOException - Upon error.

createHFileReader

public static org.apache.hadoop.hbase.io.hfile.HFile.Reader createHFileReader(HoodieStorage storage,
                                                                              StoragePath path,
                                                                              org.apache.hadoop.hbase.io.hfile.CacheConfig cacheConfig,
                                                                              org.apache.hadoop.conf.Configuration configuration)

Creates HFile reader for a file with default `primaryReplicaReader` as true.

Parameters:

storage - HoodieStorage instance.

path - path of file to read.

cacheConfig - Cache configuration.

configuration - Configuration

Returns:

HFile reader

Throws:

IOException - Upon error.

createHFileReader

public static org.apache.hadoop.hbase.io.hfile.HFile.Reader createHFileReader(HoodieStorage storage,
                                                                              StoragePath dummyPath,
                                                                              byte[] content)

Creates HFile reader for byte array with default `primaryReplicaReader` as true.

Parameters:

storage - HoodieStorage instance.

dummyPath - Dummy path to file to read.

content - Content in byte array.

Returns:

HFile reader

Throws:

IOException - Upon error.