org.apache.hadoop.hbase.replication.regionserver

类 ReplicationSource

java.lang.Object

java.lang.Thread

org.apache.hadoop.hbase.replication.regionserver.ReplicationSource

所有已实现的接口:

Runnable, ReplicationSourceInterface

@InterfaceAudience.Private
public class ReplicationSource
extends Thread
implements ReplicationSourceInterface

Class that handles the source of a replication stream. Currently does not handle more than 1 slave For each slave cluster it selects a random number of peers using a replication ratio. For example, if replication ration = 0.1 and slave cluster has 100 region servers, 10 will be selected.

A stream is considered down when we cannot contact a region server on the peer cluster for more than 55 seconds by default.

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	ReplicationSource.LogsComparator Comparator used to compare logs together based on their start time
class	ReplicationSource.ReplicationSourceShipperThread
static class	ReplicationSource.WorkerState

从类继承的嵌套类/接口 java.lang.Thread

Thread.State, Thread.UncaughtExceptionHandler

字段概要

从类继承的字段 java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

构造器概要

构造器

构造器和说明
ReplicationSource()

方法概要

方法

限定符和类型	方法和说明
void	addHFileRefs(TableName tableName, byte[] family, List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs) Add hfile names to the queue to be replicated.
void	enqueueLog(org.apache.hadoop.fs.Path log) Add a log to the list of logs to replicate
org.apache.hadoop.fs.Path	getCurrentPath() Get the current log that's replicated
org.apache.hadoop.fs.Path	getLastLoggedPath()
long	getLastLoggedPosition()
String	getPeerClusterId() Get the id that the source is replicating to.
String	getPeerClusterZnode() Get the id that the source is replicating to
MetricsSource	getSourceMetrics() Get the associated metrics.
String	getStats() Get a string representation of the current statistics for this source
void	init(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, ReplicationSourceManager manager, ReplicationQueues replicationQueues, ReplicationPeers replicationPeers, Stoppable stopper, String peerClusterZnode, UUID clusterId, ReplicationEndpoint replicationEndpoint, MetricsSource metrics) Instantiation method used by region servers
protected boolean	isPeerEnabled() check whether the peer is enabled or not
void	run()
protected boolean	sleepForRetries(String msg, int sleepMultiplier) Do the sleeping logic
void	startup() Start the replication
void	terminate(String reason) End the replication
void	terminate(String reason, Exception cause) End the replication
void	terminate(String reason, Exception cause, boolean join)

从类继承的方法 java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

从类继承的方法 java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

构造器详细资料

ReplicationSource

public ReplicationSource()

方法详细资料

init

public void init(org.apache.hadoop.conf.Configuration conf,
        org.apache.hadoop.fs.FileSystem fs,
        ReplicationSourceManager manager,
        ReplicationQueues replicationQueues,
        ReplicationPeers replicationPeers,
        Stoppable stopper,
        String peerClusterZnode,
        UUID clusterId,
        ReplicationEndpoint replicationEndpoint,
        MetricsSource metrics)
          throws IOException

Instantiation method used by region servers

指定者:

init 在接口中 ReplicationSourceInterface

参数:

conf - configuration to use

fs - file system to use

manager - replication manager to ping to

stopper - the atomic boolean to use to stop the regionserver

peerClusterZnode - the name of our znode

clusterId - unique UUID for the cluster

replicationEndpoint - the replication endpoint implementation

metrics - metrics for replication source

抛出:

IOException

enqueueLog

public void enqueueLog(org.apache.hadoop.fs.Path log)

从接口复制的说明: ReplicationSourceInterface

Add a log to the list of logs to replicate

指定者:

enqueueLog 在接口中 ReplicationSourceInterface

参数:

log - path to the log to replicate

addHFileRefs

public void addHFileRefs(TableName tableName,
                byte[] family,
                List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)
                  throws ReplicationException

从接口复制的说明: ReplicationSourceInterface

Add hfile names to the queue to be replicated.

指定者:

addHFileRefs 在接口中 ReplicationSourceInterface

参数:

tableName - Name of the table these files belongs to

family - Name of the family these files belong to

pairs - list of pairs of { HFile location in staging dir, HFile path in region dir which will be added in the queue for replication}

抛出:

ReplicationException - If failed to add hfile references

run

public void run()

指定者:

run 在接口中 Runnable

覆盖:

run 在类中 Thread

sleepForRetries

protected boolean sleepForRetries(String msg,
                      int sleepMultiplier)

Do the sleeping logic

参数:

msg - Why we sleep

sleepMultiplier - by how many times the default sleeping time is augmented

返回:

True if sleepMultiplier is < maxRetriesMultiplier

isPeerEnabled

protected boolean isPeerEnabled()

check whether the peer is enabled or not

返回:

true if the peer is enabled, otherwise false

startup

public void startup()

从接口复制的说明: ReplicationSourceInterface

Start the replication

指定者:

startup 在接口中 ReplicationSourceInterface

terminate

public void terminate(String reason)

从接口复制的说明: ReplicationSourceInterface

End the replication

指定者:

terminate 在接口中 ReplicationSourceInterface

参数:

reason - why it's terminating

terminate

public void terminate(String reason,
             Exception cause)

从接口复制的说明: ReplicationSourceInterface

End the replication

指定者:

terminate 在接口中 ReplicationSourceInterface

参数:

reason - why it's terminating

cause - the error that's causing it

terminate

public void terminate(String reason,
             Exception cause,
             boolean join)

getPeerClusterZnode

public String getPeerClusterZnode()

从接口复制的说明: ReplicationSourceInterface

Get the id that the source is replicating to

指定者:

getPeerClusterZnode 在接口中 ReplicationSourceInterface

返回:

peer cluster id

getPeerClusterId

public String getPeerClusterId()

从接口复制的说明: ReplicationSourceInterface

Get the id that the source is replicating to.

指定者:

getPeerClusterId 在接口中 ReplicationSourceInterface

返回:

peer cluster id

getCurrentPath

public org.apache.hadoop.fs.Path getCurrentPath()

从接口复制的说明: ReplicationSourceInterface

Get the current log that's replicated

指定者:

getCurrentPath 在接口中 ReplicationSourceInterface

返回:

the current log

getLastLoggedPath

public org.apache.hadoop.fs.Path getLastLoggedPath()

getLastLoggedPosition

public long getLastLoggedPosition()

getStats

public String getStats()

从接口复制的说明: ReplicationSourceInterface

Get a string representation of the current statistics for this source

指定者:

getStats 在接口中 ReplicationSourceInterface

返回:

printable stats

getSourceMetrics

public MetricsSource getSourceMetrics()

从接口复制的说明: ReplicationSourceInterface

Get the associated metrics.

指定者:

getSourceMetrics 在接口中 ReplicationSourceInterface

返回:

The metrics for this source.