org.apache.tez.runtime.library.cartesianproduct

Class CartesianProductEdgeManager

java.lang.Object

org.apache.tez.dag.api.EdgeManagerPlugin

org.apache.tez.dag.api.EdgeManagerPluginOnDemand

org.apache.tez.runtime.library.cartesianproduct.CartesianProductEdgeManager

public class CartesianProductEdgeManager
extends org.apache.tez.dag.api.EdgeManagerPluginOnDemand

This EM wrap a real edge manager implementation object. It choose whether it's partitioned or fair implementation according to the config. All method invocations are actually redirected to real implementation.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

org.apache.tez.dag.api.EdgeManagerPluginOnDemand.CompositeEventRouteMetadata, org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata

Constructor Summary

Constructors

Constructor and Description
CartesianProductEdgeManager(org.apache.tez.dag.api.EdgeManagerPluginContext context)

Method Summary

Modifier and Type	Method and Description
protected org.apache.tez.runtime.library.cartesianproduct.CartesianProductEdgeManagerReal	getEdgeManagerReal()
int	getNumDestinationConsumerTasks(int sourceTaskIndex)
int	getNumDestinationTaskPhysicalInputs(int destTaskId)
int	getNumSourceTaskPhysicalOutputs(int srcTaskId)
void	initialize()
void	prepareForRouting()
org.apache.tez.dag.api.EdgeManagerPluginOnDemand.CompositeEventRouteMetadata	routeCompositeDataMovementEventToDestination(int srcTaskId, int destTaskId)
org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata	routeDataMovementEventToDestination(int srcTaskId, int srcOutputId, int destTaskId)
int	routeInputErrorEventToSource(int destTaskId, int failedInputId)
org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata	routeInputSourceTaskFailedEventToDestination(int srcTaskId, int destTaskId)

Methods inherited from class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

getContext, routeDataMovementEventToDestination, routeInputErrorEventToSource, routeInputSourceTaskFailedEventToDestination

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CartesianProductEdgeManager

public CartesianProductEdgeManager(org.apache.tez.dag.api.EdgeManagerPluginContext context)

Method Detail

initialize

public void initialize()
                throws Exception

Specified by:

initialize in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception

getEdgeManagerReal

protected org.apache.tez.runtime.library.cartesianproduct.CartesianProductEdgeManagerReal getEdgeManagerReal()

prepareForRouting

public void prepareForRouting()
                       throws Exception

Specified by:

prepareForRouting in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception

routeInputErrorEventToSource

public int routeInputErrorEventToSource(int destTaskId,
                                        int failedInputId)
                                 throws Exception

Specified by:

routeInputErrorEventToSource in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception

routeDataMovementEventToDestination

@Nullable
public org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata routeDataMovementEventToDestination(int srcTaskId,
                                                                                                                         int srcOutputId,
                                                                                                                         int destTaskId)
                                                                                                                  throws Exception

Specified by:

routeDataMovementEventToDestination in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception

routeCompositeDataMovementEventToDestination

@Nullable
public org.apache.tez.dag.api.EdgeManagerPluginOnDemand.CompositeEventRouteMetadata routeCompositeDataMovementEventToDestination(int srcTaskId,
                                                                                                                                           int destTaskId)
                                                                                                                                    throws Exception

Specified by:

routeCompositeDataMovementEventToDestination in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception

routeInputSourceTaskFailedEventToDestination

@Nullable
public org.apache.tez.dag.api.EdgeManagerPluginOnDemand.EventRouteMetadata routeInputSourceTaskFailedEventToDestination(int srcTaskId,
                                                                                                                                  int destTaskId)
                                                                                                                           throws Exception

Specified by:

routeInputSourceTaskFailedEventToDestination in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

Throws:

Exception

getNumDestinationTaskPhysicalInputs

public int getNumDestinationTaskPhysicalInputs(int destTaskId)

Specified by:

getNumDestinationTaskPhysicalInputs in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

getNumSourceTaskPhysicalOutputs

public int getNumSourceTaskPhysicalOutputs(int srcTaskId)

Specified by:

getNumSourceTaskPhysicalOutputs in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand

getNumDestinationConsumerTasks

public int getNumDestinationConsumerTasks(int sourceTaskIndex)

Specified by:

getNumDestinationConsumerTasks in class org.apache.tez.dag.api.EdgeManagerPluginOnDemand