org.apache.hadoop.hbase.replication.regionserver

类 Replication

java.lang.Object

org.apache.hadoop.hbase.regionserver.wal.WALActionsListener.Base

org.apache.hadoop.hbase.replication.regionserver.Replication

所有已实现的接口:

ReplicationService, ReplicationSinkService, ReplicationSourceService, WALActionsListener

@InterfaceAudience.Private
public class Replication
extends WALActionsListener.Base
implements ReplicationSourceService, ReplicationSinkService

Gateway to Replication. Used by HRegionServer.

嵌套类概要

从接口继承的嵌套类/接口 org.apache.hadoop.hbase.regionserver.wal.WALActionsListener

WALActionsListener.Base

构造器概要

构造器

构造器和说明
Replication() Empty constructor
Replication(Server server, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path logDir, org.apache.hadoop.fs.Path oldLogDir) Instantiate the replication management (if rep is enabled).

方法概要

方法

限定符和类型	方法和说明
static void	decorateMasterConfiguration(org.apache.hadoop.conf.Configuration conf) This method modifies the master's configuration in order to inject replication-related features
static void	decorateRegionServerConfiguration(org.apache.hadoop.conf.Configuration conf) This method modifies the region server's configuration in order to inject replication-related features
ReplicationSourceManager	getReplicationManager() Get the replication sources manager
WALActionsListener	getWALActionsListener() Returns a WALObserver for the service.
void	initialize(Server server, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path logDir, org.apache.hadoop.fs.Path oldLogDir) Initializes the replication service object.
static boolean	isReplication(org.apache.hadoop.conf.Configuration c)
static boolean	isReplicationForBulkLoadDataEnabled(org.apache.hadoop.conf.Configuration c)
void	join() Join with the replication threads
void	postLogRoll(org.apache.hadoop.fs.Path oldPath, org.apache.hadoop.fs.Path newPath) The WAL has been rolled.
void	preLogRoll(org.apache.hadoop.fs.Path oldPath, org.apache.hadoop.fs.Path newPath) The WAL is going to be rolled.
ReplicationLoad	refreshAndGetReplicationLoad() Refresh and Get ReplicationLoad
void	replicateLogEntries(List<org.apache.hadoop.hbase.protobuf.generated.AdminProtos.WALEntry> entries, CellScanner cells, String replicationClusterId, String sourceBaseNamespaceDirPath, String sourceHFileArchiveDirPath) Carry on the list of log entries down to the sink
static void	scopeWALEdits(HTableDescriptor htd, WALKey logKey, WALEdit logEdit, org.apache.hadoop.conf.Configuration conf, ReplicationSourceManager replicationManager) Utility method used to set the correct scopes on each log key.
void	startReplicationService() If replication is enabled and this cluster is a master, it starts
void	stopReplicationService() Stops replication service.
void	visitLogEntryBeforeWrite(HTableDescriptor htd, WALKey logKey, WALEdit logEdit)

从类继承的方法 org.apache.hadoop.hbase.regionserver.wal.WALActionsListener.Base

logCloseRequested, logRollRequested, postAppend, postLogArchive, postSync, preLogArchive, visitLogEntryBeforeWrite

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

Replication

public Replication(Server server,
           org.apache.hadoop.fs.FileSystem fs,
           org.apache.hadoop.fs.Path logDir,
           org.apache.hadoop.fs.Path oldLogDir)
            throws IOException

Instantiate the replication management (if rep is enabled).

参数:

server - Hosting server

fs - handle to the filesystem

logDir -

oldLogDir - directory where logs are archived

抛出:

IOException

Replication

public Replication()

Empty constructor

方法详细资料

initialize

public void initialize(Server server,
              org.apache.hadoop.fs.FileSystem fs,
              org.apache.hadoop.fs.Path logDir,
              org.apache.hadoop.fs.Path oldLogDir)
                throws IOException

从接口复制的说明: ReplicationService

Initializes the replication service object.

指定者:

initialize 在接口中 ReplicationService

抛出:

IOException

isReplication

public static boolean isReplication(org.apache.hadoop.conf.Configuration c)

参数:

c - Configuration to look at

返回:

True if replication is enabled.

isReplicationForBulkLoadDataEnabled

public static boolean isReplicationForBulkLoadDataEnabled(org.apache.hadoop.conf.Configuration c)

参数:

c - Configuration to look at

返回:

True if replication for bulk load data is enabled.

getWALActionsListener

public WALActionsListener getWALActionsListener()

从接口复制的说明: ReplicationSourceService

Returns a WALObserver for the service. This is needed to observe log rolls and log archival events.

指定者:

getWALActionsListener 在接口中 ReplicationSourceService

stopReplicationService

public void stopReplicationService()

Stops replication service.

指定者:

stopReplicationService 在接口中 ReplicationService

join

public void join()

Join with the replication threads

replicateLogEntries

public void replicateLogEntries(List<org.apache.hadoop.hbase.protobuf.generated.AdminProtos.WALEntry> entries,
                       CellScanner cells,
                       String replicationClusterId,
                       String sourceBaseNamespaceDirPath,
                       String sourceHFileArchiveDirPath)
                         throws IOException

Carry on the list of log entries down to the sink

指定者:

replicateLogEntries 在接口中 ReplicationSinkService

参数:

entries - list of entries to replicate

cells - The data -- the cells -- that entries describes (the entries do not contain the Cells we are replicating; they are passed here on the side in this CellScanner).

replicationClusterId - Id which will uniquely identify source cluster FS client configurations in the replication configuration directory

sourceBaseNamespaceDirPath - Path that point to the source cluster base namespace directory required for replicating hfiles

sourceHFileArchiveDirPath - Path that point to the source cluster hfile archive directory

抛出:

IOException

startReplicationService

public void startReplicationService()
                             throws IOException

If replication is enabled and this cluster is a master, it starts

指定者:

startReplicationService 在接口中 ReplicationService

抛出:

IOException

getReplicationManager

public ReplicationSourceManager getReplicationManager()

Get the replication sources manager

返回:

the manager if replication is enabled, else returns false

visitLogEntryBeforeWrite

public void visitLogEntryBeforeWrite(HTableDescriptor htd,
                            WALKey logKey,
                            WALEdit logEdit)
                              throws IOException

指定者:

visitLogEntryBeforeWrite 在接口中 WALActionsListener

覆盖:

visitLogEntryBeforeWrite 在类中 WALActionsListener.Base

logEdit - TODO: Retire this in favor of WALActionsListener.visitLogEntryBeforeWrite(HRegionInfo, WALKey, WALEdit) It only exists to get scope when replicating. Scope should be in the WALKey and not need us passing in a htd.

抛出:

IOException - If failed to parse the WALEdit

scopeWALEdits

public static void scopeWALEdits(HTableDescriptor htd,
                 WALKey logKey,
                 WALEdit logEdit,
                 org.apache.hadoop.conf.Configuration conf,
                 ReplicationSourceManager replicationManager)
                          throws IOException

Utility method used to set the correct scopes on each log key. Doesn't set a scope on keys from compaction WAL edits and if the scope is local.

参数:

htd - Descriptor used to find the scope to use

logKey - Key that may get scoped according to its edits

logEdit - Edits used to lookup the scopes

replicationManager - Manager used to add bulk load events hfile references

抛出:

IOException - If failed to parse the WALEdit

preLogRoll

public void preLogRoll(org.apache.hadoop.fs.Path oldPath,
              org.apache.hadoop.fs.Path newPath)
                throws IOException

从接口复制的说明: WALActionsListener

The WAL is going to be rolled. The oldPath can be null if this is the first log file from the regionserver.

指定者:

preLogRoll 在接口中 WALActionsListener

覆盖:

preLogRoll 在类中 WALActionsListener.Base

参数:

oldPath - the path to the old wal

newPath - the path to the new wal

抛出:

IOException

postLogRoll

public void postLogRoll(org.apache.hadoop.fs.Path oldPath,
               org.apache.hadoop.fs.Path newPath)
                 throws IOException

从接口复制的说明: WALActionsListener

The WAL has been rolled. The oldPath can be null if this is the first log file from the regionserver.

指定者:

postLogRoll 在接口中 WALActionsListener

覆盖:

postLogRoll 在类中 WALActionsListener.Base

参数:

oldPath - the path to the old wal

newPath - the path to the new wal

抛出:

IOException

decorateMasterConfiguration

public static void decorateMasterConfiguration(org.apache.hadoop.conf.Configuration conf)

This method modifies the master's configuration in order to inject replication-related features

参数:

conf -

decorateRegionServerConfiguration

public static void decorateRegionServerConfiguration(org.apache.hadoop.conf.Configuration conf)

This method modifies the region server's configuration in order to inject replication-related features

参数:

conf - region server configurations

refreshAndGetReplicationLoad

public ReplicationLoad refreshAndGetReplicationLoad()

从接口复制的说明: ReplicationService

Refresh and Get ReplicationLoad

指定者:

refreshAndGetReplicationLoad 在接口中 ReplicationService