org.apache.hudi.client.bootstrap

Class HoodieBootstrapSchemaProvider

java.lang.Object

org.apache.hudi.client.bootstrap.HoodieBootstrapSchemaProvider

public abstract class HoodieBootstrapSchemaProvider
extends Object

Bootstrap Schema Provider. Schema provided in config is used. If not available, use schema from Parquet

Field Summary

Fields

Modifier and Type	Field and Description
protected HoodieWriteConfig	writeConfig

Constructor Summary

Constructors

Constructor and Description
HoodieBootstrapSchemaProvider(HoodieWriteConfig writeConfig)

Method Summary

Modifier and Type	Method and Description
org.apache.avro.Schema	getBootstrapSchema(HoodieEngineContext context, List<Pair<String,List<HoodieFileStatus>>> partitions) Main API to select avro schema for bootstrapping.
protected abstract org.apache.avro.Schema	getBootstrapSourceSchema(HoodieEngineContext context, List<Pair<String,List<HoodieFileStatus>>> partitions) Select a random file to be used to generate avro schema.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

writeConfig

protected final HoodieWriteConfig writeConfig

Constructor Detail

HoodieBootstrapSchemaProvider

public HoodieBootstrapSchemaProvider(HoodieWriteConfig writeConfig)

Method Detail

getBootstrapSchema

public final org.apache.avro.Schema getBootstrapSchema(HoodieEngineContext context,
                                                       List<Pair<String,List<HoodieFileStatus>>> partitions)

Main API to select avro schema for bootstrapping.

Parameters:

context - HoodieEngineContext

partitions - List of partitions with files within them

Returns:

Avro Schema

getBootstrapSourceSchema

protected abstract org.apache.avro.Schema getBootstrapSourceSchema(HoodieEngineContext context,
                                                                   List<Pair<String,List<HoodieFileStatus>>> partitions)

Select a random file to be used to generate avro schema. Override this method to get custom schema selection.

Parameters:

context - HoodieEngineContext

partitions - List of partitions with files within them

Returns:

Avro Schema