org.apache.hudi.integ.testsuite.dag.nodes

Class InsertNode

java.lang.Object

org.apache.hudi.integ.testsuite.dag.nodes.DagNode<org.apache.spark.api.java.JavaRDD<org.apache.hudi.client.WriteStatus>>

org.apache.hudi.integ.testsuite.dag.nodes.InsertNode

All Implemented Interfaces:

Comparable<DagNode<org.apache.spark.api.java.JavaRDD<org.apache.hudi.client.WriteStatus>>>

Direct Known Subclasses:

BulkInsertNode, DeleteNode, InsertOverwriteNode, InsertOverwriteTableNode, UpsertNode

public class InsertNode
extends DagNode<org.apache.spark.api.java.JavaRDD<org.apache.hudi.client.WriteStatus>>

An insert node in the DAG of operations for a workflow.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.spark.api.java.JavaRDD<DeltaWriteStats>	deltaWriteStatsRDD

Fields inherited from class org.apache.hudi.integ.testsuite.dag.nodes.DagNode

childNodes, config, log, parentNodes, result

Constructor Summary

Constructors

Constructor and Description
InsertNode(DeltaConfig.Config config)

Method Summary

Modifier and Type	Method and Description
void	execute(ExecutionContext executionContext, int curItrCount) Execute the DagNode.
protected void	generate(DeltaGenerator deltaGenerator)
protected org.apache.spark.api.java.JavaRDD<org.apache.hudi.client.WriteStatus>	ingest(HoodieTestSuiteWriter hoodieTestSuiteWriter, org.apache.hudi.common.util.Option<String> commitTime)

Methods inherited from class org.apache.hudi.integ.testsuite.dag.nodes.DagNode

addChildNode, addParentNode, clone, compareTo, equals, getChildNodes, getConfig, getName, getParentNodes, getResult, hashCode, isCompleted, setCompleted, setParentNodes

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Field Detail

deltaWriteStatsRDD

protected org.apache.spark.api.java.JavaRDD<DeltaWriteStats> deltaWriteStatsRDD

Constructor Detail

InsertNode

public InsertNode(DeltaConfig.Config config)

Method Detail

execute

public void execute(ExecutionContext executionContext,
                    int curItrCount)
             throws Exception

Description copied from class: DagNode

Execute the DagNode.

Specified by:

execute in class DagNode<org.apache.spark.api.java.JavaRDD<org.apache.hudi.client.WriteStatus>>

Parameters:

executionContext - The context needed for an execution of a node.

curItrCount - iteration count for executing the node.

Throws:

Exception - Thrown if the execution failed.

generate

protected void generate(DeltaGenerator deltaGenerator)
                 throws Exception

Throws:

Exception

ingest

protected org.apache.spark.api.java.JavaRDD<org.apache.hudi.client.WriteStatus> ingest(HoodieTestSuiteWriter hoodieTestSuiteWriter,
                                                                                       org.apache.hudi.common.util.Option<String> commitTime)
                                                                                throws Exception

Throws:

Exception