| Modifier and Type | Class and Description |
|---|---|
class |
HoodieCommonConfig
Hudi configs used across engines.
|
class |
HoodieMetadataConfig
Configurations used by the HUDI Metadata Table.
|
class |
HoodieMetaserverConfig
Configurations used by the HUDI Metaserver.
|
class |
HoodieStorageConfig
Storage related config.
|
class |
HoodieTableServiceManagerConfig
Configurations used by the Hudi Table Service Manager.
|
class |
TimestampKeyGeneratorConfig
Timestamp-based key generator configs.
|
| Modifier and Type | Method and Description |
|---|---|
void |
HoodieConfig.setDefault(HoodieConfig config) |
void |
HoodieConfig.setDefaultOnCondition(boolean condition,
HoodieConfig config) |
| Modifier and Type | Method and Description |
|---|---|
ConfigProperty<T> |
ConfigProperty.withInferFunction(Function<HoodieConfig,Option<T>> inferFunction) |
| Modifier and Type | Field and Description |
|---|---|
protected HoodieConfig |
DirectMarkerBasedDetectionStrategy.config |
| Constructor and Description |
|---|
DirectMarkerBasedDetectionStrategy(HoodieStorage storage,
String partitionPath,
String fileId,
String instantTime,
HoodieActiveTimeline activeTimeline,
HoodieConfig config) |
| Modifier and Type | Class and Description |
|---|---|
class |
ConsistencyGuardConfig
The consistency guard relevant config options.
|
class |
FileSystemRetryConfig
The file system retry relevant config options.
|
| Modifier and Type | Class and Description |
|---|---|
class |
HoodieTableConfig |
| Modifier and Type | Class and Description |
|---|---|
class |
FileSystemViewStorageConfig
File System View Storage Configurations.
|
| Modifier and Type | Field and Description |
|---|---|
static HoodieConfig |
ConfigUtils.DEFAULT_HUDI_CONFIG_FOR_READER |
| Modifier and Type | Method and Description |
|---|---|
static HoodieConfig |
ConfigUtils.getReaderConfigs(StorageConfiguration<?> storageConf) |
| Modifier and Type | Class and Description |
|---|---|
class |
HoodieMetricsCloudWatchConfig |
class |
HoodieMetricsConfig
Fetch the configurations used by the Metrics system.
|
class |
HoodieMetricsDatadogConfig
Configs for Datadog reporter type.
|
class |
HoodieMetricsGraphiteConfig
Configs for Graphite reporter type.
|
class |
HoodieMetricsJmxConfig
Configs for Jmx reporter type.
|
class |
HoodieMetricsM3Config
Configs for M3 reporter type.
|
class |
HoodieMetricsPrometheusConfig
Configs for Prometheus/Pushgaeway reporter type.
|
| Modifier and Type | Method and Description |
|---|---|
protected static BloomFilter |
HoodieFileWriterFactory.createBloomFilter(HoodieConfig config) |
static boolean |
HoodieFileWriterFactory.enableBloomFilter(boolean populateMetaFields,
HoodieConfig config)
Check if need to enable bloom filter.
|
HoodieFileReader |
HoodieFileReaderFactory.getContentReader(HoodieConfig hoodieConfig,
StoragePath path,
HoodieFileFormat format,
HoodieStorage storage,
byte[] content,
Option<org.apache.avro.Schema> schemaOption) |
HoodieFileReader |
HoodieFileReaderFactory.getFileReader(HoodieConfig hoodieConfig,
StoragePath path) |
HoodieFileReader |
HoodieFileReaderFactory.getFileReader(HoodieConfig hoodieConfig,
StoragePath path,
HoodieFileFormat format) |
HoodieFileReader |
HoodieFileReaderFactory.getFileReader(HoodieConfig hoodieConfig,
StoragePath path,
HoodieFileFormat format,
Option<org.apache.avro.Schema> schemaOption) |
static <T,I,K,O> HoodieFileWriter |
HoodieFileWriterFactory.getFileWriter(HoodieFileFormat format,
OutputStream outputStream,
HoodieStorage storage,
HoodieConfig config,
org.apache.avro.Schema schema,
HoodieRecord.HoodieRecordType recordType) |
static <T,I,K,O> HoodieFileWriter |
HoodieFileWriterFactory.getFileWriter(String instantTime,
StoragePath path,
HoodieStorage storage,
HoodieConfig config,
org.apache.avro.Schema schema,
TaskContextSupplier taskContextSupplier,
HoodieRecord.HoodieRecordType recordType) |
protected <T,I,K,O> HoodieFileWriter |
HoodieFileWriterFactory.getFileWriterByFormat(HoodieFileFormat format,
OutputStream outputStream,
HoodieConfig config,
org.apache.avro.Schema schema) |
protected <T,I,K,O> HoodieFileWriter |
HoodieFileWriterFactory.getFileWriterByFormat(String extension,
String instantTime,
StoragePath path,
HoodieConfig config,
org.apache.avro.Schema schema,
TaskContextSupplier taskContextSupplier) |
protected static boolean |
HoodieFileReaderFactory.isUseNativeHFileReaderEnabled(HoodieConfig hoodieConfig) |
protected HoodieFileReader |
HoodieFileReaderFactory.newHFileFileReader(HoodieConfig hoodieConfig,
StoragePath path,
HoodieStorage storage,
byte[] content,
Option<org.apache.avro.Schema> schemaOption) |
protected HoodieFileReader |
HoodieFileReaderFactory.newHFileFileReader(HoodieConfig hoodieConfig,
StoragePath path,
Option<org.apache.avro.Schema> schemaOption) |
protected HoodieFileWriter |
HoodieFileWriterFactory.newHFileFileWriter(String instantTime,
StoragePath path,
HoodieConfig config,
org.apache.avro.Schema schema,
TaskContextSupplier taskContextSupplier) |
protected HoodieFileWriter |
HoodieFileWriterFactory.newOrcFileWriter(String instantTime,
StoragePath path,
HoodieConfig config,
org.apache.avro.Schema schema,
TaskContextSupplier taskContextSupplier) |
protected HoodieFileWriter |
HoodieFileWriterFactory.newParquetFileWriter(OutputStream outputStream,
HoodieConfig config,
org.apache.avro.Schema schema) |
protected HoodieFileWriter |
HoodieFileWriterFactory.newParquetFileWriter(String instantTime,
StoragePath path,
HoodieConfig config,
org.apache.avro.Schema schema,
TaskContextSupplier taskContextSupplier) |
| Modifier and Type | Class and Description |
|---|---|
class |
KeyGeneratorOptions
Key generator configs.
|
| Modifier and Type | Method and Description |
|---|---|
static HoodieData<HoodieRecord> |
HoodieTableMetadataUtil.convertMetadataToBloomFilterRecords(HoodieEngineContext context,
HoodieConfig hoodieConfig,
HoodieCommitMetadata commitMetadata,
String instantTime,
HoodieTableMetaClient dataMetaClient,
String bloomFilterType,
int bloomIndexParallelism)
Convert commit action metadata to bloom filter records.
|
static Map<MetadataPartitionType,HoodieData<HoodieRecord>> |
HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext context,
HoodieConfig hoodieConfig,
HoodieCommitMetadata commitMetadata,
String instantTime,
HoodieTableMetaClient dataMetaClient,
List<MetadataPartitionType> enabledPartitionTypes,
String bloomFilterType,
int bloomIndexParallelism,
boolean isColumnStatsIndexEnabled,
int columnStatsIndexParallelism,
List<String> targetColumnsForColumnStatsIndex)
Convert commit action to metadata records for the enabled partition types.
|
static HoodieData<HoodieRecord> |
HoodieTableMetadataUtil.readRecordKeysFromBaseFiles(HoodieEngineContext engineContext,
HoodieConfig config,
List<Pair<String,HoodieBaseFile>> partitionBaseFilePairs,
boolean forDelete,
int recordIndexMaxParallelism,
String basePath,
StorageConfiguration<?> configuration,
String activeModule)
Deprecated.
|
Copyright © 2024 The Apache Software Foundation. All rights reserved.