ReplicationSource (Apache HBase

java.lang.Object
- org.apache.hadoop.hbase.replication.regionserver.ReplicationSource

所有已实现的接口:

ReplicationSourceInterface

直接已知子类:

RecoveredReplicationSource
```
@InterfaceAudience.Private
public class ReplicationSource
extends Object
implements ReplicationSourceInterface
```
Class that handles the source of a replication stream. Currently does not handle more than 1 slave For each slave cluster it selects a random number of peers using a replication ratio. For example, if replication ration = 0.1 and slave cluster has 100 region servers, 10 will be selected.
A stream is considered down when we cannot contact a region server on the peer cluster for more than 55 seconds by default.

嵌套类概要

嵌套类
限定符和类型类和说明

static class ReplicationSource.LogsComparator
Comparator used to compare logs together based on their start time

嵌套类
限定符和类型	类和说明
`static class`	`ReplicationSource.LogsComparator` Comparator used to compare logs together based on their start time

字段概要

字段
限定符和类型	字段和说明
`protected org.apache.hadoop.conf.Configuration`	`conf`
`static int`	`DEFAULT_WAIT_ON_ENDPOINT_SECONDS`
`protected org.apache.hadoop.fs.FileSystem`	`fs`
`protected ReplicationSourceManager`	`manager`
`protected String`	`queueId`
`protected int`	`queueSizePerGroup`
`protected ReplicationQueueStorage`	`queueStorage`
`protected ReplicationPeer`	`replicationPeer`
`protected ReplicationQueueInfo`	`replicationQueueInfo`
`protected Server`	`server`
`static String`	`WAIT_ON_ENDPOINT_SECONDS`
`protected WALEntryFilter`	`walEntryFilter`
`protected ConcurrentHashMap<String,ReplicationSourceShipper>`	`workerThreads`

构造器概要

构造器
构造器和说明

ReplicationSource()

构造器
构造器和说明
`ReplicationSource()`

方法概要

所有方法实例方法具体方法
限定符和类型	方法和说明
`void`	`addHFileRefs(TableName tableName, byte[] family, List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)` Add hfile names to the queue to be replicated.
`protected ReplicationSourceShipper`	`createNewShipper(String walGroupId, PriorityBlockingQueue<org.apache.hadoop.fs.Path> queue)`
`void`	`enqueueLog(org.apache.hadoop.fs.Path log)` Add a log to the list of logs to replicate
`org.apache.hadoop.fs.Path`	`getCurrentPath()` Get the current log that's replicated
`String`	`getPeerId()` Get the id that the source is replicating to.
`String`	`getQueueId()` Get the queue id that the source is replicating to
`ReplicationEndpoint`	`getReplicationEndpoint()`
`ServerName`	`getServerWALsBelongTo()` The queue of WALs only belong to one region server.
`ReplicationSourceManager`	`getSourceManager()`
`MetricsSource`	`getSourceMetrics()`
`String`	`getStats()` Get a string representation of the current statistics for this source
`WALFileLengthProvider`	`getWALFileLengthProvider()`
`Map<String,ReplicationStatus>`	`getWalGroupStatus()` get the stat of replication for each wal group.
`void`	`init(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, ReplicationSourceManager manager, ReplicationQueueStorage queueStorage, ReplicationPeer replicationPeer, Server server, String queueId, UUID clusterId, WALFileLengthProvider walFileLengthProvider, MetricsSource metrics)` Instantiation method used by region servers
`boolean`	`isPeerEnabled()` check whether the peer is enabled or not
`boolean`	`isSourceActive()`
`void`	`postShipEdits(List<WAL.Entry> entries, int batchSize)` Call this after the shipper thread ship some entries to peer cluster.
`protected boolean`	`sleepForRetries(String msg, int sleepMultiplier)` Do the sleeping logic
`void`	`startup()` Start the replication
`void`	`terminate(String reason)` End the replication
`void`	`terminate(String reason, Exception cause)` End the replication
`void`	`terminate(String reason, Exception cause, boolean join)`
`void`	`tryThrottle(int batchSize)` Try to throttle when the peer config with a bandwidth
`protected void`	`uncaughtException(Thread t, Throwable e)`

从类继承的方法 java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceInterface
isRecovered

- 字段详细资料
  - queueSizePerGroup
```
protected int queueSizePerGroup
```
  - queueStorage
```
protected ReplicationQueueStorage queueStorage
```
  - replicationPeer
```
protected ReplicationPeer replicationPeer
```
  - conf
```
protected org.apache.hadoop.conf.Configuration conf
```
  - replicationQueueInfo
```
protected ReplicationQueueInfo replicationQueueInfo
```
  - manager
```
protected ReplicationSourceManager manager
```
  - server
```
protected Server server
```
  - fs
```
protected org.apache.hadoop.fs.FileSystem fs
```
  - queueId
```
protected String queueId
```
  - walEntryFilter
```
protected volatile WALEntryFilter walEntryFilter
```
  - workerThreads
```
protected final ConcurrentHashMap<String,ReplicationSourceShipper> workerThreads
```
  - WAIT_ON_ENDPOINT_SECONDS
```
public static final String WAIT_ON_ENDPOINT_SECONDS
```
    另请参阅:
    
    常量字段值
  - DEFAULT_WAIT_ON_ENDPOINT_SECONDS
```
public static final int DEFAULT_WAIT_ON_ENDPOINT_SECONDS
```
    另请参阅:
    
    常量字段值
- 构造器详细资料
  - ReplicationSource
```
public ReplicationSource()
```
- 方法详细资料
  - init
```
public void init(org.apache.hadoop.conf.Configuration conf,
                 org.apache.hadoop.fs.FileSystem fs,
                 ReplicationSourceManager manager,
                 ReplicationQueueStorage queueStorage,
                 ReplicationPeer replicationPeer,
                 Server server,
                 String queueId,
                 UUID clusterId,
                 WALFileLengthProvider walFileLengthProvider,
                 MetricsSource metrics)
          throws IOException
```
    Instantiation method used by region servers
    
    指定者:
    
    init 在接口中 ReplicationSourceInterface
    
    参数:
    
    conf - configuration to use
    
    fs - file system to use
    
    manager - replication manager to ping to
    
    server - the server for this region server
    
    queueId - the id of our replication queue
    
    clusterId - unique UUID for the cluster
    
    metrics - metrics for replication source
    
    抛出:
    
    IOException
  - enqueueLog
```
public void enqueueLog(org.apache.hadoop.fs.Path log)
```
    从接口复制的说明: ReplicationSourceInterface
    
    Add a log to the list of logs to replicate
    
    指定者:
    
    enqueueLog 在接口中 ReplicationSourceInterface
    
    参数:
    
    log - path to the log to replicate
  - addHFileRefs
```
public void addHFileRefs(TableName tableName,
                         byte[] family,
                         List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)
                  throws ReplicationException
```
    从接口复制的说明: ReplicationSourceInterface
    
    Add hfile names to the queue to be replicated.
    
    指定者:
    
    addHFileRefs 在接口中 ReplicationSourceInterface
    
    参数:
    
    tableName - Name of the table these files belongs to
    
    family - Name of the family these files belong to
    
    pairs - list of pairs of { HFile location in staging dir, HFile path in region dir which will be added in the queue for replication}
    
    抛出:
    
    ReplicationException - If failed to add hfile references
  - getWalGroupStatus
```
public Map<String,ReplicationStatus> getWalGroupStatus()
```
    从接口复制的说明: ReplicationSourceInterface
    
    get the stat of replication for each wal group.
    
    指定者:
    
    getWalGroupStatus 在接口中 ReplicationSourceInterface
    
    返回:
    
    stat of replication
  - createNewShipper
```
protected ReplicationSourceShipper createNewShipper(String walGroupId,
                                                    PriorityBlockingQueue<org.apache.hadoop.fs.Path> queue)
```
  - uncaughtException
```
protected final void uncaughtException(Thread t,
                                       Throwable e)
```
  - getReplicationEndpoint
```
public ReplicationEndpoint getReplicationEndpoint()
```
    指定者:
    
    getReplicationEndpoint 在接口中 ReplicationSourceInterface
    
    返回:
    
    the replication endpoint used by this replication source
  - getSourceManager
```
public ReplicationSourceManager getSourceManager()
```
    指定者:
    
    getSourceManager 在接口中 ReplicationSourceInterface
    
    返回:
    
    the replication source manager
  - tryThrottle
```
public void tryThrottle(int batchSize)
                 throws InterruptedException
```
    从接口复制的说明: ReplicationSourceInterface
    
    Try to throttle when the peer config with a bandwidth
    
    指定者:
    
    tryThrottle 在接口中 ReplicationSourceInterface
    
    参数:
    
    batchSize - entries size will be pushed
    
    抛出:
    
    InterruptedException
  - sleepForRetries
```
protected boolean sleepForRetries(String msg,
                                  int sleepMultiplier)
```
    Do the sleeping logic
    
    参数:
    
    msg - Why we sleep
    
    sleepMultiplier - by how many times the default sleeping time is augmented
    
    返回:
    
    True if sleepMultiplier is < maxRetriesMultiplier
  - isPeerEnabled
```
public boolean isPeerEnabled()
```
    check whether the peer is enabled or not
    
    指定者:
    
    isPeerEnabled 在接口中 ReplicationSourceInterface
    
    返回:
    
    true if the peer is enabled, otherwise false
  - startup
```
public void startup()
```
    从接口复制的说明: ReplicationSourceInterface
    
    Start the replication
    
    指定者:
    
    startup 在接口中 ReplicationSourceInterface
  - terminate
```
public void terminate(String reason)
```
    从接口复制的说明: ReplicationSourceInterface
    
    End the replication
    
    指定者:
    
    terminate 在接口中 ReplicationSourceInterface
    
    参数:
    
    reason - why it's terminating
  - terminate
```
public void terminate(String reason,
                      Exception cause)
```
    从接口复制的说明: ReplicationSourceInterface
    
    End the replication
    
    指定者:
    
    terminate 在接口中 ReplicationSourceInterface
    
    参数:
    
    reason - why it's terminating
    
    cause - the error that's causing it
  - terminate
```
public void terminate(String reason,
                      Exception cause,
                      boolean join)
```
  - getQueueId
```
public String getQueueId()
```
    从接口复制的说明: ReplicationSourceInterface
    
    Get the queue id that the source is replicating to
    
    指定者:
    
    getQueueId 在接口中 ReplicationSourceInterface
    
    返回:
    
    queue id
  - getPeerId
```
public String getPeerId()
```
    从接口复制的说明: ReplicationSourceInterface
    
    Get the id that the source is replicating to.
    
    指定者:
    
    getPeerId 在接口中 ReplicationSourceInterface
    
    返回:
    
    peer id
  - getCurrentPath
```
public org.apache.hadoop.fs.Path getCurrentPath()
```
    从接口复制的说明: ReplicationSourceInterface
    
    Get the current log that's replicated
    
    指定者:
    
    getCurrentPath 在接口中 ReplicationSourceInterface
    
    返回:
    
    the current log
  - isSourceActive
```
public boolean isSourceActive()
```
    指定者:
    
    isSourceActive 在接口中 ReplicationSourceInterface
    
    返回:
    
    active or not
  - getStats
```
public String getStats()
```
    从接口复制的说明: ReplicationSourceInterface
    
    Get a string representation of the current statistics for this source
    
    指定者:
    
    getStats 在接口中 ReplicationSourceInterface
    
    返回:
    
    printable stats
  - getSourceMetrics
```
public MetricsSource getSourceMetrics()
```
    指定者:
    
    getSourceMetrics 在接口中 ReplicationSourceInterface
    
    返回:
    
    metrics of this replication source
  - postShipEdits
```
public void postShipEdits(List<WAL.Entry> entries,
                          int batchSize)
```
    从接口复制的说明: ReplicationSourceInterface
    
    Call this after the shipper thread ship some entries to peer cluster.
    
    指定者:
    
    postShipEdits 在接口中 ReplicationSourceInterface
    
    参数:
    
    entries - pushed
    
    batchSize - entries size pushed
  - getWALFileLengthProvider
```
public WALFileLengthProvider getWALFileLengthProvider()
```
    指定者:
    
    getWALFileLengthProvider 在接口中 ReplicationSourceInterface
    
    返回:
    
    the wal file length provider
  - getServerWALsBelongTo
```
public ServerName getServerWALsBelongTo()
```
    从接口复制的说明: ReplicationSourceInterface
    
    The queue of WALs only belong to one region server. This will return the server name which all WALs belong to.
    
    指定者:
    
    getServerWALsBelongTo 在接口中 ReplicationSourceInterface
    
    返回:
    
    the server name which all WALs belong to

类 ReplicationSource

嵌套类概要

字段概要

构造器概要

方法概要

从类继承的方法 java.lang.Object

从接口继承的方法 org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceInterface

字段详细资料

queueSizePerGroup

queueStorage

replicationPeer

conf

replicationQueueInfo

manager

server

fs

queueId

walEntryFilter

workerThreads

WAIT_ON_ENDPOINT_SECONDS

DEFAULT_WAIT_ON_ENDPOINT_SECONDS

构造器详细资料

ReplicationSource

方法详细资料

init

enqueueLog

addHFileRefs

getWalGroupStatus

createNewShipper

uncaughtException

getReplicationEndpoint

getSourceManager

tryThrottle

sleepForRetries

isPeerEnabled

startup

terminate

terminate

terminate

getQueueId

getPeerId

getCurrentPath

isSourceActive

getStats

getSourceMetrics

postShipEdits

getWALFileLengthProvider

getServerWALsBelongTo