org.apache.tez.common

Class AsyncDispatcherConcurrent

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.service.CompositeService

org.apache.tez.common.AsyncDispatcherConcurrent

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.service.Service, org.apache.hadoop.yarn.event.Dispatcher

@InterfaceAudience.Private
public class AsyncDispatcherConcurrent
extends org.apache.hadoop.service.CompositeService
implements org.apache.hadoop.yarn.event.Dispatcher

A dispatcher that can schedule events concurrently. Uses a fixed size threadpool to schedule events. Events that have the same serializing hash will get scheduled on the same thread in the threadpool. This can be used to prevent concurrency issues for events that may not be independently processed.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.service.CompositeService

org.apache.hadoop.service.CompositeService.CompositeServiceShutdownHook

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

org.apache.hadoop.service.Service.STATE

Field Summary

Fields

Modifier and Type	Field and Description
protected Map<Class<? extends Enum>,AsyncDispatcherConcurrent>	eventDispatchers
protected Map<Class<? extends Enum>,org.apache.hadoop.yarn.event.EventHandler>	eventHandlers

Fields inherited from class org.apache.hadoop.service.CompositeService

STOP_ONLY_STARTED_SERVICES

Fields inherited from interface org.apache.hadoop.yarn.event.Dispatcher

DEFAULT_DISPATCHER_EXIT_ON_ERROR, DISPATCHER_EXIT_ON_ERROR_KEY

Method Summary

Methods

Modifier and Type	Method and Description
protected void	dispatch(org.apache.hadoop.yarn.event.Event event)
org.apache.hadoop.yarn.event.EventHandler	getEventHandler()
void	register(Class<? extends Enum> eventType, org.apache.hadoop.yarn.event.EventHandler handler) Add an EventHandler for events handled inline on this dispatcher
AsyncDispatcherConcurrent	registerAndCreateDispatcher(Class<? extends Enum> eventType, org.apache.hadoop.yarn.event.EventHandler handler, String dispatcherName, int numThreads) Add an EventHandler for events handled in their own dispatchers with given name and threads
void	registerWithExistingDispatcher(Class<? extends Enum> eventType, org.apache.hadoop.yarn.event.EventHandler handler, AsyncDispatcherConcurrent dispatcher)
protected void	serviceInit(org.apache.hadoop.conf.Configuration conf)
protected void	serviceStart()
protected void	serviceStop()
void	setDrainEventsOnStop()

Methods inherited from class org.apache.hadoop.service.CompositeService

addIfService, addService, getServices, removeService

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

eventHandlers

protected final Map<Class<? extends Enum>,org.apache.hadoop.yarn.event.EventHandler> eventHandlers

eventDispatchers

protected final Map<Class<? extends Enum>,AsyncDispatcherConcurrent> eventDispatchers

Method Detail

serviceInit

protected void serviceInit(org.apache.hadoop.conf.Configuration conf)
                    throws Exception

Overrides:

serviceInit in class org.apache.hadoop.service.CompositeService

Throws:

Exception

serviceStart

protected void serviceStart()
                     throws Exception

Overrides:

serviceStart in class org.apache.hadoop.service.CompositeService

Throws:

Exception

setDrainEventsOnStop

public void setDrainEventsOnStop()

serviceStop

protected void serviceStop()
                    throws Exception

Overrides:

serviceStop in class org.apache.hadoop.service.CompositeService

Throws:

Exception

dispatch

protected void dispatch(org.apache.hadoop.yarn.event.Event event)

register

public void register(Class<? extends Enum> eventType,
            org.apache.hadoop.yarn.event.EventHandler handler)

Add an EventHandler for events handled inline on this dispatcher

Specified by:

register in interface org.apache.hadoop.yarn.event.Dispatcher

registerAndCreateDispatcher

public AsyncDispatcherConcurrent registerAndCreateDispatcher(Class<? extends Enum> eventType,
                                                    org.apache.hadoop.yarn.event.EventHandler handler,
                                                    String dispatcherName,
                                                    int numThreads)

Add an EventHandler for events handled in their own dispatchers with given name and threads

registerWithExistingDispatcher

public void registerWithExistingDispatcher(Class<? extends Enum> eventType,
                                  org.apache.hadoop.yarn.event.EventHandler handler,
                                  AsyncDispatcherConcurrent dispatcher)

getEventHandler

public org.apache.hadoop.yarn.event.EventHandler getEventHandler()

Specified by:

getEventHandler in interface org.apache.hadoop.yarn.event.Dispatcher