org.apache.hadoop.hbase.replication

类 ReplicationQueuesZKImpl

java.lang.Object

org.apache.hadoop.hbase.replication.ReplicationStateZKBase

org.apache.hadoop.hbase.replication.ReplicationQueuesZKImpl

所有已实现的接口:

ReplicationQueues

@InterfaceAudience.Private
public class ReplicationQueuesZKImpl
extends ReplicationStateZKBase
implements ReplicationQueues

This class provides an implementation of the ReplicationQueues interface using Zookeeper. The base znode that this class works at is the myQueuesZnode. The myQueuesZnode contains a list of all outstanding WAL files on this region server that need to be replicated. The myQueuesZnode is the regionserver name (a concatenation of the region server’s hostname, client port and start code). For example: /hbase/replication/rs/hostname.example.org,6020,1234 Within this znode, the region server maintains a set of WAL replication queues. These queues are represented by child znodes named using there give queue id. For example: /hbase/replication/rs/hostname.example.org,6020,1234/1 /hbase/replication/rs/hostname.example.org,6020,1234/2 Each queue has one child znode for every WAL that still needs to be replicated. The value of these WAL child znodes is the latest position that has been replicated. This position is updated every time a WAL entry is replicated. For example: /hbase/replication/rs/hostname.example.org,6020,1234/1/23522342.23422 [VALUE: 254]

字段概要

字段

限定符和类型	字段和说明
static String	RS_LOCK_ZNODE Name of znode we use to lock during failover

从类继承的字段 org.apache.hadoop.hbase.replication.ReplicationStateZKBase

abortable, conf, DISABLED_ZNODE_BYTES, ENABLED_ZNODE_BYTES, hfileRefsZNode, ourClusterKey, peerStateNodeName, peersZNode, queuesZNode, replicationZNode, tableCFsNodeName, zookeeper, ZOOKEEPER_ZNODE_REPLICATION_HFILE_REFS_DEFAULT, ZOOKEEPER_ZNODE_REPLICATION_HFILE_REFS_KEY

构造器概要

构造器

构造器和说明
ReplicationQueuesZKImpl(ZooKeeperWatcher zk, org.apache.hadoop.conf.Configuration conf, Abortable abortable)

方法概要

方法

限定符和类型	方法和说明
void	addHFileRefs(String peerId, List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs) Add new hfile references to the queue.
void	addLog(String queueId, String filename) Add a new WAL file to the given queue.
void	addPeerToHFileRefs(String peerId) Add a peer to hfile reference queue if peer does not exist.
boolean	checkLockExists(String znode)
Pair<String,SortedSet<String>>	claimQueue(String regionserver, String queueId) Take ownership for the queue identified by queueId and belongs to a dead region server.
List<String>	getAllQueues() Get a list of all queues for this region server.
List<String>	getListOfReplicators() Get a list of all region servers that have outstanding replication queues.
String	getLockZNode(String znode)
long	getLogPosition(String queueId, String filename) Get the current position for a specific WAL in a given queue.
List<String>	getLogsInQueue(String queueId) Get a list of all WALs in the given queue.
List<String>	getUnClaimedQueueIds(String regionserver) Get queueIds from a dead region server, whose queues has not been claimed by other region servers.
void	init(String serverName) Initialize the region server replication queue interface.
boolean	isThisOurRegionServer(String regionserver) Checks if the provided znode is the same as this region server's
boolean	isThisOurZnode(String znode) Checks if the provided znode is the same as this region server's
boolean	lockOtherRS(String znode) Try to set a lock in another region server's znode.
void	removeAllQueues() Remove all replication queues for this region server.
void	removeHFileRefs(String peerId, List<String> files) Remove hfile references from the queue.
void	removeLog(String queueId, String filename) Remove an WAL file from the given queue.
void	removePeerFromHFileRefs(String peerId) Remove a peer from hfile reference queue.
void	removeQueue(String queueId) Remove a replication queue.
void	removeReplicatorIfQueueIsEmpty(String regionserver) Remove the znode of region server if the queue is empty.
void	setLogPosition(String queueId, String filename, long position) Set the current position for a specific WAL in a given queue.

从类继承的方法 org.apache.hadoop.hbase.replication.ReplicationStateZKBase

getListOfReplicatorsZK, getPeerNode, getPeerStateNode, getTableCFsNode, isPeerPath, peerExists, toByteArray

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

RS_LOCK_ZNODE

public static final String RS_LOCK_ZNODE

Name of znode we use to lock during failover

另请参阅:

常量字段值

构造器详细资料

ReplicationQueuesZKImpl

public ReplicationQueuesZKImpl(ZooKeeperWatcher zk,
                       org.apache.hadoop.conf.Configuration conf,
                       Abortable abortable)

方法详细资料

init

public void init(String serverName)
          throws ReplicationException

从接口复制的说明: ReplicationQueues

Initialize the region server replication queue interface.

指定者:

init 在接口中 ReplicationQueues

参数:

serverName - The server name of the region server that owns the replication queues this interface manages.

抛出:

ReplicationException

getListOfReplicators

public List<String> getListOfReplicators()
                                  throws ReplicationException

从接口复制的说明: ReplicationQueues

Get a list of all region servers that have outstanding replication queues. These servers could be alive, dead or from a previous run of the cluster.

指定者:

getListOfReplicators 在接口中 ReplicationQueues

返回:

a list of server names

抛出:

ReplicationException

removeQueue

public void removeQueue(String queueId)

从接口复制的说明: ReplicationQueues

Remove a replication queue.

指定者:

removeQueue 在接口中 ReplicationQueues

参数:

queueId - a String that identifies the queue.

addLog

public void addLog(String queueId,
          String filename)
            throws ReplicationException

从接口复制的说明: ReplicationQueues

Add a new WAL file to the given queue. If the queue does not exist it is created.

指定者:

addLog 在接口中 ReplicationQueues

参数:

queueId - a String that identifies the queue.

filename - name of the WAL

抛出:

ReplicationException

removeLog

public void removeLog(String queueId,
             String filename)

从接口复制的说明: ReplicationQueues

Remove an WAL file from the given queue.

指定者:

removeLog 在接口中 ReplicationQueues

参数:

queueId - a String that identifies the queue.

filename - name of the WAL

setLogPosition

public void setLogPosition(String queueId,
                  String filename,
                  long position)

从接口复制的说明: ReplicationQueues

Set the current position for a specific WAL in a given queue.

指定者:

setLogPosition 在接口中 ReplicationQueues

参数:

queueId - a String that identifies the queue

filename - name of the WAL

position - the current position in the file

getLogPosition

public long getLogPosition(String queueId,
                  String filename)
                    throws ReplicationException

从接口复制的说明: ReplicationQueues

Get the current position for a specific WAL in a given queue.

指定者:

getLogPosition 在接口中 ReplicationQueues

参数:

queueId - a String that identifies the queue

filename - name of the WAL

返回:

the current position in the file

抛出:

ReplicationException

isThisOurZnode

public boolean isThisOurZnode(String znode)

从接口复制的说明: ReplicationQueues

Checks if the provided znode is the same as this region server's

指定者:

isThisOurZnode 在接口中 ReplicationQueues

参数:

znode - to check

返回:

if this is this rs's znode

removeAllQueues

public void removeAllQueues()

从接口复制的说明: ReplicationQueues

Remove all replication queues for this region server.

指定者:

removeAllQueues 在接口中 ReplicationQueues

getLogsInQueue

public List<String> getLogsInQueue(String queueId)

从接口复制的说明: ReplicationQueues

Get a list of all WALs in the given queue.

指定者:

getLogsInQueue 在接口中 ReplicationQueues

参数:

queueId - a String that identifies the queue

返回:

a list of WALs, null if this region server is dead and has no outstanding queues

getAllQueues

public List<String> getAllQueues()

从接口复制的说明: ReplicationQueues

Get a list of all queues for this region server.

指定者:

getAllQueues 在接口中 ReplicationQueues

返回:

a list of queueIds, null if this region server is dead and has no outstanding queues

isThisOurRegionServer

public boolean isThisOurRegionServer(String regionserver)

从接口复制的说明: ReplicationQueues

Checks if the provided znode is the same as this region server's

指定者:

isThisOurRegionServer 在接口中 ReplicationQueues

参数:

regionserver - the id of the region server

返回:

if this is this rs's znode

getUnClaimedQueueIds

public List<String> getUnClaimedQueueIds(String regionserver)

从接口复制的说明: ReplicationQueues

Get queueIds from a dead region server, whose queues has not been claimed by other region servers.

指定者:

getUnClaimedQueueIds 在接口中 ReplicationQueues

返回:

empty if the queue exists but no children, null if the queue does not exist.

claimQueue

public Pair<String,SortedSet<String>> claimQueue(String regionserver,
                                        String queueId)

从接口复制的说明: ReplicationQueues

Take ownership for the queue identified by queueId and belongs to a dead region server.

指定者:

claimQueue 在接口中 ReplicationQueues

参数:

regionserver - the id of the dead region server

queueId - the id of the queue

返回:

the new PeerId and A SortedSet of WALs in its queue, and null if no unclaimed queue.

removeReplicatorIfQueueIsEmpty

public void removeReplicatorIfQueueIsEmpty(String regionserver)

从接口复制的说明: ReplicationQueues

Remove the znode of region server if the queue is empty.

指定者:

removeReplicatorIfQueueIsEmpty 在接口中 ReplicationQueues

lockOtherRS

public boolean lockOtherRS(String znode)

Try to set a lock in another region server's znode.

参数:

znode - the server names of the other server

返回:

true if the lock was acquired, false in every other cases

getLockZNode

public String getLockZNode(String znode)

checkLockExists

public boolean checkLockExists(String znode)
                        throws org.apache.zookeeper.KeeperException

抛出:

org.apache.zookeeper.KeeperException

addHFileRefs

public void addHFileRefs(String peerId,
                List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)
                  throws ReplicationException

从接口复制的说明: ReplicationQueues

Add new hfile references to the queue.

指定者:

addHFileRefs 在接口中 ReplicationQueues

参数:

peerId - peer cluster id to which the hfiles need to be replicated

pairs - list of pairs of { HFile location in staging dir, HFile path in region dir which will be added in the queue }

抛出:

ReplicationException - if fails to add a hfile reference

removeHFileRefs

public void removeHFileRefs(String peerId,
                   List<String> files)

从接口复制的说明: ReplicationQueues

Remove hfile references from the queue.

指定者:

removeHFileRefs 在接口中 ReplicationQueues

参数:

peerId - peer cluster id from which this hfile references needs to be removed

files - list of hfile references to be removed

addPeerToHFileRefs

public void addPeerToHFileRefs(String peerId)
                        throws ReplicationException

从接口复制的说明: ReplicationQueues

Add a peer to hfile reference queue if peer does not exist.

指定者:

addPeerToHFileRefs 在接口中 ReplicationQueues

参数:

peerId - peer cluster id to be added

抛出:

ReplicationException - if fails to add a peer id to hfile reference queue

removePeerFromHFileRefs

public void removePeerFromHFileRefs(String peerId)

从接口复制的说明: ReplicationQueues

Remove a peer from hfile reference queue.

指定者:

removePeerFromHFileRefs 在接口中 ReplicationQueues

参数:

peerId - peer cluster id to be removed