org.apache.hudi.cli

Class BootstrapExecutorUtils

java.lang.Object

org.apache.hudi.cli.BootstrapExecutorUtils

All Implemented Interfaces:

Serializable

public class BootstrapExecutorUtils
extends Object
implements Serializable

Performs bootstrap from a non-hudi source. import static org.apache.hudi.common.util.ConfigUtils.filterProperties;

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BootstrapExecutorUtils.Config

Field Summary

Fields

Modifier and Type	Field and Description
static String	CHECKPOINT_KEY

Constructor Summary

Constructors

Constructor and Description
BootstrapExecutorUtils(BootstrapExecutorUtils.Config cfg, org.apache.spark.api.java.JavaSparkContext jssc, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf, TypedProperties properties) Bootstrap Executor.

Method Summary

Modifier and Type	Method and Description
static SchemaProvider	createSchemaProvider(String schemaProviderClass, TypedProperties cfg, org.apache.spark.api.java.JavaSparkContext jssc)
void	execute() Executes Bootstrap.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CHECKPOINT_KEY

public static final String CHECKPOINT_KEY

See Also:

Constant Field Values

Constructor Detail

BootstrapExecutorUtils

public BootstrapExecutorUtils(BootstrapExecutorUtils.Config cfg,
                              org.apache.spark.api.java.JavaSparkContext jssc,
                              org.apache.hadoop.fs.FileSystem fs,
                              org.apache.hadoop.conf.Configuration conf,
                              TypedProperties properties)
                       throws IOException

Bootstrap Executor.

Parameters:

cfg - Hudi Streamer Config

jssc - Java Spark Context

fs - File System

properties - Bootstrap Writer Properties

Throws:

IOException

Method Detail

createSchemaProvider

public static SchemaProvider createSchemaProvider(String schemaProviderClass,
                                                  TypedProperties cfg,
                                                  org.apache.spark.api.java.JavaSparkContext jssc)
                                           throws IOException

Throws:

IOException

execute

public void execute()
             throws IOException

Executes Bootstrap.

Throws:

IOException