org.apache.hadoop.hbase.coordination

类 ZkSplitLogWorkerCoordination

java.lang.Object

org.apache.hadoop.hbase.zookeeper.ZooKeeperListener

org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination

所有已实现的接口:

SplitLogWorkerCoordination

@InterfaceAudience.Private
public class ZkSplitLogWorkerCoordination
extends ZooKeeperListener
implements SplitLogWorkerCoordination

ZooKeeper based implementation of SplitLogWorkerCoordination It listen for changes in ZooKeeper and

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	ZkSplitLogWorkerCoordination.ZkSplitTaskDetails When ZK-based implementation wants to complete the task, it needs to know task znode and current znode cversion (needed for subsequent update operation).

从接口继承的嵌套类/接口 org.apache.hadoop.hbase.coordination.SplitLogWorkerCoordination

SplitLogWorkerCoordination.SplitTaskDetails

字段概要

字段

限定符和类型	字段和说明
protected AtomicInteger	tasksInProgress

从类继承的字段 org.apache.hadoop.hbase.zookeeper.ZooKeeperListener

watcher

从接口继承的字段 org.apache.hadoop.hbase.coordination.SplitLogWorkerCoordination

DEFAULT_MAX_SPLITTERS

构造器概要

构造器

构造器和说明
ZkSplitLogWorkerCoordination(ZkCoordinatedStateManager zkCoordinatedStateManager, ZooKeeperWatcher watcher)

方法概要

方法

限定符和类型	方法和说明
protected static int	attemptToOwnTask(boolean isFirstTime, ZooKeeperWatcher zkw, ServerName server, String task, org.apache.hadoop.hbase.protobuf.generated.ZooKeeperProtos.SplitLogTask.RecoveryMode mode, int taskZKVersion) Try to own the task by transitioning the zk node data from UNASSIGNED to OWNED.
void	endTask(SplitLogTask slt, AtomicLong ctr, SplitLogWorkerCoordination.SplitTaskDetails details) endTask() can fail and the only way to recover out of it is for the SplitLogManager to timeout the task node.
void	getDataSetWatchAsync()
org.apache.hadoop.hbase.protobuf.generated.ClusterStatusProtos.RegionStoreSequenceIds	getRegionFlushedSequenceId(String failedServerName, String key)
int	getTaskReadySeq() Used by unit tests to check how many tasks were processed
void	init(RegionServerServices server, org.apache.hadoop.conf.Configuration conf, SplitLogWorker.TaskExecutor splitExecutor, SplitLogWorker worker) Override setter from SplitLogWorkerCoordination
boolean	isReady() Check whether the log splitter is ready to supply tasks
boolean	isStop()
void	markCorrupted(org.apache.hadoop.fs.Path rootDir, String name, org.apache.hadoop.fs.FileSystem fs) marks log file as corrupted
void	nodeChildrenChanged(String path) Override handler from ZooKeeperListener
void	nodeDataChanged(String path) Override handler from ZooKeeperListener
void	registerListener() set the listener for task changes.
void	removeListener() remove the listener for task changes.
void	stopProcessingTasks() called when Coordination should stop processing tasks and exit
void	taskLoop() Wait for tasks to become available at /hbase/splitlog zknode.

从类继承的方法 org.apache.hadoop.hbase.zookeeper.ZooKeeperListener

getWatcher, nodeCreated, nodeDeleted

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

tasksInProgress

protected final AtomicInteger tasksInProgress

构造器详细资料

ZkSplitLogWorkerCoordination

public ZkSplitLogWorkerCoordination(ZkCoordinatedStateManager zkCoordinatedStateManager,
                            ZooKeeperWatcher watcher)

方法详细资料

nodeChildrenChanged

public void nodeChildrenChanged(String path)

Override handler from ZooKeeperListener

覆盖:

nodeChildrenChanged 在类中 ZooKeeperListener

nodeDataChanged

public void nodeDataChanged(String path)

Override handler from ZooKeeperListener

覆盖:

nodeDataChanged 在类中 ZooKeeperListener

init

public void init(RegionServerServices server,
        org.apache.hadoop.conf.Configuration conf,
        SplitLogWorker.TaskExecutor splitExecutor,
        SplitLogWorker worker)

Override setter from SplitLogWorkerCoordination

指定者:

init 在接口中 SplitLogWorkerCoordination

参数:

server - instance of RegionServerServices to work with

conf - is current configuration.

splitExecutor - split executor from SplitLogWorker

worker - instance of SplitLogWorker

getDataSetWatchAsync

public void getDataSetWatchAsync()

attemptToOwnTask

protected static int attemptToOwnTask(boolean isFirstTime,
                   ZooKeeperWatcher zkw,
                   ServerName server,
                   String task,
                   org.apache.hadoop.hbase.protobuf.generated.ZooKeeperProtos.SplitLogTask.RecoveryMode mode,
                   int taskZKVersion)

Try to own the task by transitioning the zk node data from UNASSIGNED to OWNED.

This method is also used to periodically heartbeat the task progress by transitioning the node from OWNED to OWNED.

参数:

isFirstTime - shows whther it's the first attempt.

zkw - zk wathcer

server - name

task - to own

taskZKVersion - version of the task in zk

返回:

non-negative integer value when task can be owned by current region server otherwise -1

taskLoop

public void taskLoop()
              throws InterruptedException

Wait for tasks to become available at /hbase/splitlog zknode. Grab a task one at a time. This policy puts an upper-limit on the number of simultaneous log splitting that could be happening in a cluster.

Synchronization using taskReadyLock ensures that it will try to grab every task that has been put up

指定者:

taskLoop 在接口中 SplitLogWorkerCoordination

抛出:

InterruptedException

markCorrupted

public void markCorrupted(org.apache.hadoop.fs.Path rootDir,
                 String name,
                 org.apache.hadoop.fs.FileSystem fs)

从接口复制的说明: SplitLogWorkerCoordination

marks log file as corrupted

指定者:

markCorrupted 在接口中 SplitLogWorkerCoordination

参数:

rootDir - where to find the log

name - of the log

fs - file system

isReady

public boolean isReady()
                throws InterruptedException

从接口复制的说明: SplitLogWorkerCoordination

Check whether the log splitter is ready to supply tasks

指定者:

isReady 在接口中 SplitLogWorkerCoordination

返回:

false if there is no tasks

抛出:

InterruptedException - if the SplitLogWorker was stopped

getTaskReadySeq

public int getTaskReadySeq()

从接口复制的说明: SplitLogWorkerCoordination

Used by unit tests to check how many tasks were processed

指定者:

getTaskReadySeq 在接口中 SplitLogWorkerCoordination

返回:

number of tasks

registerListener

public void registerListener()

从接口复制的说明: SplitLogWorkerCoordination

set the listener for task changes. Implementation specific

指定者:

registerListener 在接口中 SplitLogWorkerCoordination

removeListener

public void removeListener()

从接口复制的说明: SplitLogWorkerCoordination

remove the listener for task changes. Implementation specific

指定者:

removeListener 在接口中 SplitLogWorkerCoordination

stopProcessingTasks

public void stopProcessingTasks()

从接口复制的说明: SplitLogWorkerCoordination

called when Coordination should stop processing tasks and exit

指定者:

stopProcessingTasks 在接口中 SplitLogWorkerCoordination

isStop

public boolean isStop()

指定者:

isStop 在接口中 SplitLogWorkerCoordination

返回:

the current value of exitWorker

getRegionFlushedSequenceId

public org.apache.hadoop.hbase.protobuf.generated.ClusterStatusProtos.RegionStoreSequenceIds getRegionFlushedSequenceId(String failedServerName,
                                                                                                               String key)
                                                                                                                 throws IOException

指定者:

getRegionFlushedSequenceId 在接口中 SplitLogWorkerCoordination

抛出:

IOException

endTask

public void endTask(SplitLogTask slt,
           AtomicLong ctr,
           SplitLogWorkerCoordination.SplitTaskDetails details)

endTask() can fail and the only way to recover out of it is for the SplitLogManager to timeout the task node.

指定者:

endTask 在接口中 SplitLogWorkerCoordination

参数:

slt -

ctr -

details - details about log split task (specific to coordination engine being used).