org.apache.tez.dag.app.dag.impl

Class RootInputVertexManager

java.lang.Object

org.apache.tez.dag.api.VertexManagerPlugin

org.apache.tez.dag.app.dag.impl.RootInputVertexManager

public class RootInputVertexManager
extends org.apache.tez.dag.api.VertexManagerPlugin

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	RootInputVertexManager.RootInputVertexManagerConfigBuilder Helper class to configure RootInputVertexManager

Field Summary

Fields

Modifier and Type	Field and Description
static String	TEZ_ROOT_INPUT_VERTEX_MANAGER_ENABLE_SLOW_START Enables slow start for the vertex.
static boolean	TEZ_ROOT_INPUT_VERTEX_MANAGER_ENABLE_SLOW_START_DEFAULT
static String	TEZ_ROOT_INPUT_VERTEX_MANAGER_MAX_SRC_FRACTION In case of a Broadcast connection, once this fraction of source tasks have completed, all tasks on the current vertex can be scheduled.
static float	TEZ_ROOT_INPUT_VERTEX_MANAGER_MAX_SRC_FRACTION_DEFAULT
static String	TEZ_ROOT_INPUT_VERTEX_MANAGER_MIN_SRC_FRACTION In case of a Broadcast connection, the fraction of source tasks which should complete before tasks for the current vertex are scheduled
static float	TEZ_ROOT_INPUT_VERTEX_MANAGER_MIN_SRC_FRACTION_DEFAULT

Constructor Summary

Constructors

Constructor and Description
RootInputVertexManager(org.apache.tez.dag.api.VertexManagerPluginContext context)

Method Summary

Modifier and Type	Method and Description
static RootInputVertexManager.RootInputVertexManagerConfigBuilder	createConfigBuilder(org.apache.hadoop.conf.Configuration conf) Create a VertexManagerPluginDescriptor builder that can be used to configure the plugin.
void	initialize()
void	onRootVertexInitialized(String inputName, org.apache.tez.dag.api.InputDescriptor inputDescriptor, List<org.apache.tez.runtime.api.Event> events)
void	onSourceTaskCompleted(org.apache.tez.runtime.api.TaskAttemptIdentifier attempt)
void	onVertexManagerEventReceived(org.apache.tez.runtime.api.events.VertexManagerEvent vmEvent)
void	onVertexStarted(List<org.apache.tez.runtime.api.TaskAttemptIdentifier> completions)
void	onVertexStateUpdated(org.apache.tez.dag.api.event.VertexStateUpdate stateUpdate)

Methods inherited from class org.apache.tez.dag.api.VertexManagerPlugin

getContext, onSourceTaskCompleted, onVertexStarted

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TEZ_ROOT_INPUT_VERTEX_MANAGER_ENABLE_SLOW_START

public static final String TEZ_ROOT_INPUT_VERTEX_MANAGER_ENABLE_SLOW_START

Enables slow start for the vertex. Based on min/max fraction configs

See Also:

Constant Field Values

TEZ_ROOT_INPUT_VERTEX_MANAGER_ENABLE_SLOW_START_DEFAULT

public static final boolean TEZ_ROOT_INPUT_VERTEX_MANAGER_ENABLE_SLOW_START_DEFAULT

See Also:

Constant Field Values

TEZ_ROOT_INPUT_VERTEX_MANAGER_MIN_SRC_FRACTION

public static final String TEZ_ROOT_INPUT_VERTEX_MANAGER_MIN_SRC_FRACTION

In case of a Broadcast connection, the fraction of source tasks which should complete before tasks for the current vertex are scheduled

See Also:

Constant Field Values

TEZ_ROOT_INPUT_VERTEX_MANAGER_MIN_SRC_FRACTION_DEFAULT

public static final float TEZ_ROOT_INPUT_VERTEX_MANAGER_MIN_SRC_FRACTION_DEFAULT

See Also:

Constant Field Values

TEZ_ROOT_INPUT_VERTEX_MANAGER_MAX_SRC_FRACTION

public static final String TEZ_ROOT_INPUT_VERTEX_MANAGER_MAX_SRC_FRACTION

In case of a Broadcast connection, once this fraction of source tasks have completed, all tasks on the current vertex can be scheduled. Number of tasks ready for scheduling on the current vertex scales linearly between min-fraction and max-fraction. Defaults to the greater of the default value or tez.root-input-vertex-manager.min-src-fraction.

See Also:

Constant Field Values

TEZ_ROOT_INPUT_VERTEX_MANAGER_MAX_SRC_FRACTION_DEFAULT

public static final float TEZ_ROOT_INPUT_VERTEX_MANAGER_MAX_SRC_FRACTION_DEFAULT

See Also:

Constant Field Values

Constructor Detail

RootInputVertexManager

public RootInputVertexManager(org.apache.tez.dag.api.VertexManagerPluginContext context)

Method Detail

onVertexStarted

public void onVertexStarted(List<org.apache.tez.runtime.api.TaskAttemptIdentifier> completions)

Overrides:

onVertexStarted in class org.apache.tez.dag.api.VertexManagerPlugin

onVertexStateUpdated

public void onVertexStateUpdated(org.apache.tez.dag.api.event.VertexStateUpdate stateUpdate)

Overrides:

onVertexStateUpdated in class org.apache.tez.dag.api.VertexManagerPlugin

onSourceTaskCompleted

public void onSourceTaskCompleted(org.apache.tez.runtime.api.TaskAttemptIdentifier attempt)

Overrides:

onSourceTaskCompleted in class org.apache.tez.dag.api.VertexManagerPlugin

initialize

public void initialize()

Specified by:

initialize in class org.apache.tez.dag.api.VertexManagerPlugin

onVertexManagerEventReceived

public void onVertexManagerEventReceived(org.apache.tez.runtime.api.events.VertexManagerEvent vmEvent)

Specified by:

onVertexManagerEventReceived in class org.apache.tez.dag.api.VertexManagerPlugin

onRootVertexInitialized

public void onRootVertexInitialized(String inputName,
                                    org.apache.tez.dag.api.InputDescriptor inputDescriptor,
                                    List<org.apache.tez.runtime.api.Event> events)

Specified by:

onRootVertexInitialized in class org.apache.tez.dag.api.VertexManagerPlugin

createConfigBuilder

public static RootInputVertexManager.RootInputVertexManagerConfigBuilder createConfigBuilder(@Nullable
                                                                                             org.apache.hadoop.conf.Configuration conf)

Create a VertexManagerPluginDescriptor builder that can be used to configure the plugin.

Parameters:

conf - Configuration May be modified in place. May be null if the configuration parameters are to be set only via code. If configuration values may be changed at runtime via a config file then pass in a Configuration that is initialized from a config file. The parameters that are not overridden in code will be derived from the Configuration object.

Returns:

RootInputVertexManager.RootInputVertexManagerConfigBuilder