org.apache.hudi.integ.testsuite.dag.scheduler

Class DagScheduler

java.lang.Object

org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler

Direct Known Subclasses:

SaferSchemaDagScheduler

public class DagScheduler
extends Object

The Dag scheduler schedules the workflow DAGs. It will convert DAG to node set and execute the nodes according to the relations between nodes.

Constructor Summary

Constructors

Constructor and Description
DagScheduler(WorkflowDag workflowDag, WriterContext writerContext, org.apache.spark.api.java.JavaSparkContext jsc)

Method Summary

Modifier and Type	Method and Description
protected void	executeNode(DagNode node, int curRound) Execute the given node.
void	schedule() Method to start executing workflow DAGs.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DagScheduler

public DagScheduler(WorkflowDag workflowDag,
                    WriterContext writerContext,
                    org.apache.spark.api.java.JavaSparkContext jsc)

Method Detail

schedule

public void schedule()
              throws Exception

Method to start executing workflow DAGs.

Throws:

Exception - Thrown if schedule failed.

executeNode

protected void executeNode(DagNode node,
                           int curRound)

Execute the given node.

Parameters:

node - The node to be executed