org.apache.hudi.io.hadoop

Class HoodieHadoopIOFactory

java.lang.Object

org.apache.hudi.io.storage.HoodieIOFactory

org.apache.hudi.io.hadoop.HoodieHadoopIOFactory

public class HoodieHadoopIOFactory
extends HoodieIOFactory

Creates readers and writers for AVRO record payloads. Currently uses reflection to support SPARK record payloads but this ability should be removed with [HUDI-7746]

Field Summary

Fields inherited from class org.apache.hudi.io.storage.HoodieIOFactory

storage

Constructor Summary

Constructors

Constructor and Description
HoodieHadoopIOFactory(HoodieStorage storage)

Method Summary

Modifier and Type	Method and Description
FileFormatUtils	getFileFormatUtils(HoodieFileFormat fileFormat)
HoodieFileReaderFactory	getReaderFactory(HoodieRecord.HoodieRecordType recordType)
HoodieStorage	getStorage(StoragePath storagePath)
HoodieStorage	getStorage(StoragePath path, boolean enableRetry, long maxRetryIntervalMs, int maxRetryNumbers, long initialRetryIntervalMs, String retryExceptions, ConsistencyGuard consistencyGuard)
HoodieFileWriterFactory	getWriterFactory(HoodieRecord.HoodieRecordType recordType)

Methods inherited from class org.apache.hudi.io.storage.HoodieIOFactory

getFileFormatUtils, getIOFactory

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieHadoopIOFactory

public HoodieHadoopIOFactory(HoodieStorage storage)

Method Detail

getReaderFactory

public HoodieFileReaderFactory getReaderFactory(HoodieRecord.HoodieRecordType recordType)

Specified by:

getReaderFactory in class HoodieIOFactory

getWriterFactory

public HoodieFileWriterFactory getWriterFactory(HoodieRecord.HoodieRecordType recordType)

Specified by:

getWriterFactory in class HoodieIOFactory

getFileFormatUtils

public FileFormatUtils getFileFormatUtils(HoodieFileFormat fileFormat)

Specified by:

getFileFormatUtils in class HoodieIOFactory

getStorage

public HoodieStorage getStorage(StoragePath storagePath)

Specified by:

getStorage in class HoodieIOFactory

getStorage

public HoodieStorage getStorage(StoragePath path,
                                boolean enableRetry,
                                long maxRetryIntervalMs,
                                int maxRetryNumbers,
                                long initialRetryIntervalMs,
                                String retryExceptions,
                                ConsistencyGuard consistencyGuard)

Specified by:

getStorage in class HoodieIOFactory