org.apache.hadoop.hbase.master.assignment

类 RegionTransitionProcedure

java.lang.Object

org.apache.hadoop.hbase.procedure2.Procedure<MasterProcedureEnv>

org.apache.hadoop.hbase.master.assignment.RegionTransitionProcedure

所有已实现的接口:

Comparable<Procedure<MasterProcedureEnv>>, TableProcedureInterface, RemoteProcedureDispatcher.RemoteProcedure<MasterProcedureEnv,ServerName>

直接已知子类:

AssignProcedure, UnassignProcedure

@InterfaceAudience.Private
public abstract class RegionTransitionProcedure
extends Procedure<MasterProcedureEnv>
implements TableProcedureInterface, RemoteProcedureDispatcher.RemoteProcedure<MasterProcedureEnv,ServerName>

Base class for the Assign and Unassign Procedure. Locking: Takes exclusive lock on the region being assigned/unassigned. Thus, there can only be one RegionTransitionProcedure per region running at a time (see MasterProcedureScheduler).

This procedure is asynchronous and responds to external events. The AssignmentManager will notify this procedure when the RS completes the operation and reports the transitioned state (see the Assign and Unassign class for more detail).

Procedures move from the REGION_TRANSITION_QUEUE state when they are first submitted, to the REGION_TRANSITION_DISPATCH state when the request to remote server is sent and the Procedure is suspended waiting on external event to be woken again. Once the external event is triggered, Procedure moves to the REGION_TRANSITION_FINISH state.

NOTE: AssignProcedure and UnassignProcedure should not be thought of as being asymmetric, at least currently.

• AssignProcedure moves through all the above described states and implements methods associated with each while UnassignProcedure starts at state REGION_TRANSITION_DISPATCH and state REGION_TRANSITION_QUEUE is not supported.
• When any step in AssignProcedure fails, failure handler AssignProcedure#handleFailure(MasterProcedureEnv, RegionStateNode) re-attempts the assignment by setting the procedure state to REGION_TRANSITION_QUEUE and forces assignment to a different target server by setting AssignProcedure.forceNewPlan. When the number of attempts reaches threshold configuration 'hbase.assignment.maximum.attempts', the procedure is aborted. For UnassignProcedure, similar re-attempts are intentionally not implemented. It is a 'one shot' procedure. See its class doc for how it handles failure.
• If we find a region in an 'unexpected' state, we'll complain and retry with backoff forever. The 'unexpected' state needs to be fixed either by another running Procedure or by operator intervention (Regions in 'unexpected' state indicates bug or unexpected transition type). For this to work, subclasses need to persist the 'attempt' counter kept in this class when they do serializeStateData and restore it inside their deserializeStateData, just as they do for regionInfo.

TODO: Considering it is a priority doing all we can to get make a region available as soon as possible, re-attempting with any target makes sense if specified target fails in case of AssignProcedure. For UnassignProcedure, our concern is preventing data loss on failed unassign. See class doc for explanation.

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.hbase.procedure2.Procedure

Procedure.LockState

从接口继承的嵌套类/接口 org.apache.hadoop.hbase.master.procedure.TableProcedureInterface

TableProcedureInterface.TableOperationType

字段概要

字段

限定符和类型	字段和说明
protected AtomicBoolean	aborted

从类继承的字段 org.apache.hadoop.hbase.procedure2.Procedure

NO_PROC_ID, NO_TIMEOUT

构造器概要

构造器

构造器和说明
RegionTransitionProcedure()
RegionTransitionProcedure(RegionInfo regionInfo, boolean override)

方法概要

限定符和类型	方法和说明
protected boolean	abort(MasterProcedureEnv env)
protected Procedure.LockState	acquireLock(MasterProcedureEnv env)
protected boolean	addToRemoteDispatcher(MasterProcedureEnv env, ServerName targetServer) Be careful!
protected void	bypass(MasterProcedureEnv env)
protected Procedure[]	execute(MasterProcedureEnv env)
protected abstract void	finishTransition(MasterProcedureEnv env, RegionStates.RegionStateNode regionNode)
protected int	getAttempt()
RegionInfo	getRegionInfo()
RegionStates.RegionStateNode	getRegionState(MasterProcedureEnv env)
abstract ServerName	getServer(MasterProcedureEnv env) Used by ServerCrashProcedure to see if this Assign/Unassign needs processing.
TableName	getTableName()
protected org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.RegionTransitionState	getTransitionState()
protected boolean	holdLock(MasterProcedureEnv env)
boolean	isMeta()
protected abstract boolean	isRollbackSupported(org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.RegionTransitionState state)
protected boolean	isServerOnline(MasterProcedureEnv env, RegionStates.RegionStateNode regionNode)
protected boolean	isServerOnline(MasterProcedureEnv env, ServerName serverName)
protected void	releaseLock(MasterProcedureEnv env)
abstract RemoteProcedureDispatcher.RemoteOperation	remoteCallBuild(MasterProcedureEnv env, ServerName serverName)
protected abstract boolean	remoteCallFailed(MasterProcedureEnv env, RegionStates.RegionStateNode regionNode, IOException exception)
boolean	remoteCallFailed(MasterProcedureEnv env, ServerName serverName, IOException exception)
void	remoteOperationCompleted(MasterProcedureEnv env)
void	remoteOperationFailed(MasterProcedureEnv env, RemoteProcedureException error)
protected abstract void	reportTransition(MasterProcedureEnv env, RegionStates.RegionStateNode regionNode, org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.RegionStateTransition.TransitionCode code, long seqId)
protected void	reportTransition(MasterProcedureEnv env, ServerName serverName, org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.RegionStateTransition.TransitionCode code, long seqId)
protected void	rollback(MasterProcedureEnv env)
protected void	setAttempt(int attempt) This setter is for subclasses to call in their Procedure.deserializeStateData(ProcedureStateSerializer) method.
protected void	setOverride(boolean override) This setter is for subclasses to call in their Procedure.deserializeStateData(ProcedureStateSerializer) method.
protected void	setRegionInfo(RegionInfo regionInfo) This setter is for subclasses to call in their Procedure.deserializeStateData(ProcedureStateSerializer) method.
protected boolean	setTimeoutFailure(MasterProcedureEnv env) At end of timeout, wake ourselves up so we run again.
protected boolean	shouldWaitClientAck(MasterProcedureEnv env)
protected abstract boolean	startTransition(MasterProcedureEnv env, RegionStates.RegionStateNode regionNode)
void	toStringClassDetails(StringBuilder sb)
protected void	toStringState(StringBuilder builder)
protected abstract boolean	updateTransition(MasterProcedureEnv env, RegionStates.RegionStateNode regionNode) Called when the Procedure is in the REGION_TRANSITION_DISPATCH state.
protected boolean	waitInitialized(MasterProcedureEnv env)

从类继承的方法 org.apache.hadoop.hbase.procedure2.Procedure

addStackIndex, afterReplay, beforeReplay, compareTo, completionCleanup, deserializeStateData, doExecute, doRollback, elapsedTime, getChildrenLatch, getException, getLastUpdate, getNonceKey, getOwner, getParentProcId, getProcedureMetrics, getProcId, getProcIdHashCode, getProcName, getResult, getRootProcedureId, getRootProcId, getStackIndexes, getState, getSubmittedTime, getTimeout, getTimeoutTimestamp, hasChildren, hasException, hasLock, hasOwner, hasParent, hasTimeout, haveSameParent, incChildrenLatch, isBypass, isFailed, isFinished, isInitializing, isLockedWhenLoading, isRunnable, isSuccess, isWaiting, isYieldAfterExecutionStep, removeStackIndex, serializeStateData, setAbortFailure, setChildrenLatch, setFailure, setFailure, setLastUpdate, setNonceKey, setOwner, setOwner, setParentProcId, setProcId, setResult, setRootProcId, setStackIndexes, setState, setSubmittedTime, setTimeout, skipPersistence, toString, toStringClass, toStringDetails, toStringSimpleSB, updateMetricsOnFinish, updateMetricsOnSubmit, updateTimestamp, wasExecuted

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

从接口继承的方法 org.apache.hadoop.hbase.master.procedure.TableProcedureInterface

getTableOperationType

字段详细资料

aborted

protected final AtomicBoolean aborted

构造器详细资料

RegionTransitionProcedure

public RegionTransitionProcedure()

RegionTransitionProcedure

public RegionTransitionProcedure(RegionInfo regionInfo,
                                 boolean override)

方法详细资料

getRegionInfo

public RegionInfo getRegionInfo()

setRegionInfo

protected void setRegionInfo(RegionInfo regionInfo)

This setter is for subclasses to call in their Procedure.deserializeStateData(ProcedureStateSerializer) method. Expectation is that subclasses will persist `regioninfo` in their Procedure.serializeStateData(ProcedureStateSerializer) method and then restore `regionInfo` on deserialization by calling this.

setOverride

protected void setOverride(boolean override)

This setter is for subclasses to call in their Procedure.deserializeStateData(ProcedureStateSerializer) method. Expectation is that subclasses will persist `override` in their Procedure.serializeStateData(ProcedureStateSerializer) method and then restore `override` on deserialization by calling this.

setAttempt

protected void setAttempt(int attempt)

This setter is for subclasses to call in their Procedure.deserializeStateData(ProcedureStateSerializer) method.

另请参阅:

setRegionInfo(RegionInfo)

getAttempt

protected int getAttempt()

getTableName

public TableName getTableName()

指定者:

getTableName 在接口中 TableProcedureInterface

返回:

the name of the table the procedure is operating on

isMeta

public boolean isMeta()

toStringClassDetails

public void toStringClassDetails(StringBuilder sb)

覆盖:

toStringClassDetails 在类中 Procedure<MasterProcedureEnv>

getRegionState

public RegionStates.RegionStateNode getRegionState(MasterProcedureEnv env)

getTransitionState

protected org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.RegionTransitionState getTransitionState()

startTransition

protected abstract boolean startTransition(MasterProcedureEnv env,
                                           RegionStates.RegionStateNode regionNode)
                                    throws IOException,
                                           ProcedureSuspendedException

抛出:

IOException

ProcedureSuspendedException

updateTransition

protected abstract boolean updateTransition(MasterProcedureEnv env,
                                            RegionStates.RegionStateNode regionNode)
                                     throws IOException,
                                            ProcedureSuspendedException

Called when the Procedure is in the REGION_TRANSITION_DISPATCH state. In here we do the RPC call to OPEN/CLOSE the region. The suspending of the thread so it sleeps until it gets update that the OPEN/CLOSE has succeeded is complicated. Read the implementations to learn more.

抛出:

IOException

ProcedureSuspendedException

finishTransition

protected abstract void finishTransition(MasterProcedureEnv env,
                                         RegionStates.RegionStateNode regionNode)
                                  throws IOException,
                                         ProcedureSuspendedException

抛出:

IOException

ProcedureSuspendedException

reportTransition

protected abstract void reportTransition(MasterProcedureEnv env,
                                         RegionStates.RegionStateNode regionNode,
                                         org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.RegionStateTransition.TransitionCode code,
                                         long seqId)
                                  throws UnexpectedStateException

抛出:

UnexpectedStateException

remoteCallBuild

public abstract RemoteProcedureDispatcher.RemoteOperation remoteCallBuild(MasterProcedureEnv env,
                                                                          ServerName serverName)

指定者:

remoteCallBuild 在接口中 RemoteProcedureDispatcher.RemoteProcedure<MasterProcedureEnv,ServerName>

remoteCallFailed

protected abstract boolean remoteCallFailed(MasterProcedureEnv env,
                                            RegionStates.RegionStateNode regionNode,
                                            IOException exception)

返回:

True if processing of fail is complete; the procedure will be woken from its suspend and we'll go back to running through procedure steps: otherwise if false we leave the procedure in suspended state.

remoteCallFailed

public boolean remoteCallFailed(MasterProcedureEnv env,
                                ServerName serverName,
                                IOException exception)

指定者:

remoteCallFailed 在接口中 RemoteProcedureDispatcher.RemoteProcedure<MasterProcedureEnv,ServerName>

addToRemoteDispatcher

protected boolean addToRemoteDispatcher(MasterProcedureEnv env,
                                        ServerName targetServer)

Be careful! At the end of this method, the procedure has either succeeded and this procedure has been set into a suspended state OR, we failed and this procedure has been put back on the scheduler ready for another worker to pick it up. In both cases, we need to exit the current Worker processing immediately!

返回:

True if we successfully dispatched the call and false if we failed; if failed, we need to roll back any setup done for the dispatch.

reportTransition

protected void reportTransition(MasterProcedureEnv env,
                                ServerName serverName,
                                org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.RegionStateTransition.TransitionCode code,
                                long seqId)
                         throws UnexpectedStateException

抛出:

UnexpectedStateException

isServerOnline

protected boolean isServerOnline(MasterProcedureEnv env,
                                 RegionStates.RegionStateNode regionNode)

isServerOnline

protected boolean isServerOnline(MasterProcedureEnv env,
                                 ServerName serverName)

toStringState

protected void toStringState(StringBuilder builder)

覆盖:

toStringState 在类中 Procedure<MasterProcedureEnv>

execute

protected Procedure[] execute(MasterProcedureEnv env)
                       throws ProcedureSuspendedException

指定者:

execute 在类中 Procedure<MasterProcedureEnv>

抛出:

ProcedureSuspendedException

setTimeoutFailure

protected boolean setTimeoutFailure(MasterProcedureEnv env)

At end of timeout, wake ourselves up so we run again.

覆盖:

setTimeoutFailure 在类中 Procedure<MasterProcedureEnv>

rollback

protected void rollback(MasterProcedureEnv env)

指定者:

rollback 在类中 Procedure<MasterProcedureEnv>

isRollbackSupported

protected abstract boolean isRollbackSupported(org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.RegionTransitionState state)

abort

protected boolean abort(MasterProcedureEnv env)

指定者:

abort 在类中 Procedure<MasterProcedureEnv>

waitInitialized

protected boolean waitInitialized(MasterProcedureEnv env)

覆盖:

waitInitialized 在类中 Procedure<MasterProcedureEnv>

acquireLock

protected Procedure.LockState acquireLock(MasterProcedureEnv env)

覆盖:

acquireLock 在类中 Procedure<MasterProcedureEnv>

releaseLock

protected void releaseLock(MasterProcedureEnv env)

覆盖:

releaseLock 在类中 Procedure<MasterProcedureEnv>

holdLock

protected boolean holdLock(MasterProcedureEnv env)

覆盖:

holdLock 在类中 Procedure<MasterProcedureEnv>

shouldWaitClientAck

protected boolean shouldWaitClientAck(MasterProcedureEnv env)

覆盖:

shouldWaitClientAck 在类中 Procedure<MasterProcedureEnv>

getServer

public abstract ServerName getServer(MasterProcedureEnv env)

Used by ServerCrashProcedure to see if this Assign/Unassign needs processing.

返回:

ServerName the Assign or Unassign is going against.

remoteOperationCompleted

public void remoteOperationCompleted(MasterProcedureEnv env)

指定者:

remoteOperationCompleted 在接口中 RemoteProcedureDispatcher.RemoteProcedure<MasterProcedureEnv,ServerName>

remoteOperationFailed

public void remoteOperationFailed(MasterProcedureEnv env,
                                  RemoteProcedureException error)

指定者:

remoteOperationFailed 在接口中 RemoteProcedureDispatcher.RemoteProcedure<MasterProcedureEnv,ServerName>

bypass

protected void bypass(MasterProcedureEnv env)

覆盖:

bypass 在类中 Procedure<MasterProcedureEnv>