org.apache.hadoop.hive.ql.exec.tez

Class TezSessionPoolManager

java.lang.Object

org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.AbstractTriggerValidator

org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager

All Implemented Interfaces:

TezSessionPoolSession.Manager

public class TezSessionPoolManager
extends TezSessionPoolSession.AbstractTriggerValidator
implements TezSessionPoolSession.Manager

This class is for managing multiple tez sessions particularly when HiveServer2 is being used to submit queries. In case the user specifies a queue explicitly, a new session is created on that queue and assigned to the session state.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	TezSessionPoolManager()

Method Summary

Modifier and Type	Method and Description
void	closeAndReopenExpiredSession(org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession oldSession) Closes a running (expired) pool session and reopens it.
static void	closeIfNotDefault(TezSessionState tezSessionState, boolean keepTmpDir)
void	closeNonDefaultSessions()
protected org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession	createSession(String sessionId, HiveConf conf)
void	destroy(TezSessionState tezSessionState) This is called only in extreme cases where even our retry of submit fails.
org.apache.hadoop.hive.ql.exec.tez.SessionExpirationTracker	getExpirationTracker()
static TezSessionPoolManager	getInstance() Note: this is not thread-safe.
TezSessionState	getSession(TezSessionState session, HiveConf conf, boolean doOpen, boolean llap)
void	initTriggers(HiveConf conf)
void	registerOpenSession(org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession session) Called by TezSessionPoolSession when opened.
TezSessionState	reopen(TezSessionState sessionState) Reopens the session that was found to not be running.
void	returnAfterUse(org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession session)
void	setupNonPool(HiveConf conf)
void	setupPool(HiveConf conf)
void	startPool(HiveConf conf, org.apache.hadoop.hive.metastore.api.WMFullResourcePlan resourcePlan)
void	stop()
void	unregisterOpenSession(org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession session) Called by TezSessionPoolSession when closed.
Collection<String>	updateTriggers(org.apache.hadoop.hive.metastore.api.WMFullResourcePlan appliedRp)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TezSessionPoolManager

protected TezSessionPoolManager()

Method Detail

getInstance

public static TezSessionPoolManager getInstance()

Note: this is not thread-safe.

startPool

public void startPool(HiveConf conf,
                      org.apache.hadoop.hive.metastore.api.WMFullResourcePlan resourcePlan)
               throws Exception

Throws:

Exception

setupPool

public void setupPool(HiveConf conf)
               throws Exception

Throws:

Exception

setupNonPool

public void setupNonPool(HiveConf conf)

initTriggers

public void initTriggers(HiveConf conf)

returnAfterUse

public void returnAfterUse(org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession session)
                    throws Exception

Specified by:

returnAfterUse in interface TezSessionPoolSession.Manager

Throws:

Exception

closeIfNotDefault

public static void closeIfNotDefault(TezSessionState tezSessionState,
                                     boolean keepTmpDir)
                              throws Exception

Throws:

Exception

stop

public void stop()
          throws Exception

Throws:

Exception

destroy

public void destroy(TezSessionState tezSessionState)
             throws Exception

This is called only in extreme cases where even our retry of submit fails. This method would close even default sessions and remove it from the queue.

Specified by:

destroy in interface TezSessionPoolSession.Manager

Parameters:

tezSessionState - the session to be closed

Throws:

Exception

createSession

protected org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession createSession(String sessionId,
                                                                                 HiveConf conf)

getSession

public TezSessionState getSession(TezSessionState session,
                                  HiveConf conf,
                                  boolean doOpen,
                                  boolean llap)
                           throws Exception

Throws:

Exception

reopen

public TezSessionState reopen(TezSessionState sessionState)
                       throws Exception

Reopens the session that was found to not be running.

Specified by:

reopen in interface TezSessionPoolSession.Manager

Throws:

Exception

closeNonDefaultSessions

public void closeNonDefaultSessions()
                             throws Exception

Throws:

Exception

closeAndReopenExpiredSession

public void closeAndReopenExpiredSession(org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession oldSession)
                                  throws Exception

Closes a running (expired) pool session and reopens it.

Throws:

Exception

registerOpenSession

public void registerOpenSession(org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession session)

Called by TezSessionPoolSession when opened.

Specified by:

registerOpenSession in interface TezSessionPoolSession.Manager

updateTriggers

public Collection<String> updateTriggers(org.apache.hadoop.hive.metastore.api.WMFullResourcePlan appliedRp)

unregisterOpenSession

public void unregisterOpenSession(org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession session)

Called by TezSessionPoolSession when closed.

Specified by:

unregisterOpenSession in interface TezSessionPoolSession.Manager

getExpirationTracker

public org.apache.hadoop.hive.ql.exec.tez.SessionExpirationTracker getExpirationTracker()