org.apache.tez.dag.library.vertexmanager

Class FairShuffleEdgeManager

java.lang.Object

org.apache.tez.dag.api.EdgeManagerPlugin

org.apache.tez.dag.api.EdgeManagerPluginOnDemand

org.apache.tez.dag.library.vertexmanager.FairShuffleEdgeManager

public class FairShuffleEdgeManager
extends org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Edge manager for fair routing. Each destination task has its DestinationTaskInputsProperty used to decide how to do event routing between source and destination.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

org.apache.tez.dag.api.EdgeManagerPluginOnDemand.CompositeEventRouteMetadata, org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata

Constructor Summary

Constructors

Constructor and Description
FairShuffleEdgeManager(org.apache.tez.dag.api.EdgeManagerPluginContext context)

Method Summary

Modifier and Type	Method and Description
int	getNumDestinationConsumerTasks(int sourceTaskIndex)
int	getNumDestinationTaskPhysicalInputs(int destTaskIndex)
int	getNumSourceTaskPhysicalOutputs(int sourceTaskIndex)
void	initialize()
void	prepareForRouting()
org.apache.tez.dag.api.EdgeManagerPluginOnDemand.CompositeEventRouteMetadata	routeCompositeDataMovementEventToDestination(int sourceTaskIndex, int destinationTaskIndex)
org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata	routeDataMovementEventToDestination(int sourceTaskIndex, int sourceOutputIndex, int destTaskIndex)
int	routeInputErrorEventToSource(int destinationTaskIndex, int destinationFailedInputIndex)
org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata	routeInputSourceTaskFailedEventToDestination(int sourceTaskIndex, int destinationTaskIndex)

Methods inherited from class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

getContext, routeDataMovementEventToDestination, routeInputErrorEventToSource, routeInputSourceTaskFailedEventToDestination

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FairShuffleEdgeManager

public FairShuffleEdgeManager(org.apache.tez.dag.api.EdgeManagerPluginContext context)

Method Detail

getNumDestinationTaskPhysicalInputs

public int getNumDestinationTaskPhysicalInputs(int destTaskIndex)

Specified by:

getNumDestinationTaskPhysicalInputs in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

getNumSourceTaskPhysicalOutputs

public int getNumSourceTaskPhysicalOutputs(int sourceTaskIndex)

Specified by:

getNumSourceTaskPhysicalOutputs in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

getNumDestinationConsumerTasks

public int getNumDestinationConsumerTasks(int sourceTaskIndex)

Specified by:

getNumDestinationConsumerTasks in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

initialize

public void initialize()

Specified by:

initialize in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

routeInputErrorEventToSource

public int routeInputErrorEventToSource(int destinationTaskIndex,
                                        int destinationFailedInputIndex)

Specified by:

routeInputErrorEventToSource in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

prepareForRouting

public void prepareForRouting()
                       throws Exception

Specified by:

prepareForRouting in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception

routeDataMovementEventToDestination

public org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata routeDataMovementEventToDestination(int sourceTaskIndex,
                                                                                                               int sourceOutputIndex,
                                                                                                               int destTaskIndex)
                                                                                                        throws Exception

Specified by:

routeDataMovementEventToDestination in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception

routeCompositeDataMovementEventToDestination

@Nullable
public org.apache.tez.dag.api.EdgeManagerPluginOnDemand.CompositeEventRouteMetadata routeCompositeDataMovementEventToDestination(int sourceTaskIndex,
                                                                                                                                           int destinationTaskIndex)

Specified by:

routeCompositeDataMovementEventToDestination in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

routeInputSourceTaskFailedEventToDestination

public org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata routeInputSourceTaskFailedEventToDestination(int sourceTaskIndex,
                                                                                                                        int destinationTaskIndex)
                                                                                                                 throws Exception

Specified by:

routeInputSourceTaskFailedEventToDestination in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception