org.apache.hadoop.hbase.replication.regionserver

Class HBaseInterClusterReplicationEndpoint

java.lang.Object

org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService

org.apache.hadoop.hbase.replication.BaseReplicationEndpoint

org.apache.hadoop.hbase.replication.HBaseReplicationEndpoint

org.apache.hadoop.hbase.replication.regionserver.HBaseInterClusterReplicationEndpoint

All Implemented Interfaces:

Abortable, ReplicationEndpoint, ReplicationPeerConfigListener, org.apache.hbase.thirdparty.com.google.common.util.concurrent.Service

@InterfaceAudience.Private
public class HBaseInterClusterReplicationEndpoint
extends HBaseReplicationEndpoint

A ReplicationEndpoint implementation for replicating to another HBase cluster. For the slave cluster it selects a random number of peers using a replication ratio. For example, if replication ration = 0.1 and slave cluster has 100 region servers, 10 will be selected.

A stream is considered down when we cannot contact a region server on the peer cluster for more than 55 seconds by default.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.replication.HBaseReplicationEndpoint

HBaseReplicationEndpoint.PeerRegionServerListener

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.replication.ReplicationEndpoint

ReplicationEndpoint.Context, ReplicationEndpoint.ReplicateContext

Nested classes/interfaces inherited from interface org.apache.hbase.thirdparty.com.google.common.util.concurrent.Service

org.apache.hbase.thirdparty.com.google.common.util.concurrent.Service.Listener, org.apache.hbase.thirdparty.com.google.common.util.concurrent.Service.State

Field Summary

Fields

Modifier and Type	Field and Description
static String	REPLICATION_DROP_ON_DELETED_COLUMN_FAMILY_KEY Drop edits for CFs that been deleted from the replication source and target
static String	REPLICATION_DROP_ON_DELETED_TABLE_KEY Drop edits for tables that been deleted from the replication source and target

Fields inherited from class org.apache.hadoop.hbase.replication.BaseReplicationEndpoint

ctx, REPLICATION_WALENTRYFILTER_CONFIG_KEY

Constructor Summary

Constructors

Constructor and Description
HBaseInterClusterReplicationEndpoint()

Method Summary

Modifier and Type	Method and Description
protected Connection	createConnection(org.apache.hadoop.conf.Configuration conf)
protected ReplicationSinkManager	createReplicationSinkManager(Connection conn)
protected Callable<Integer>	createReplicator(List<WAL.Entry> entries, int batchIndex, int timeout)
protected void	doStop()
void	init(ReplicationEndpoint.Context context) Initialize the replication endpoint with the given context.
static boolean	isNoSuchColumnFamilyException(Throwable io) Check if there's an NoSuchColumnFamilyException in the caused by stacktrace.
protected boolean	isPeerEnabled()
static boolean	isTableNotFoundException(Throwable io) Check if there's an TableNotFoundException in the caused by stacktrace.
boolean	replicate(ReplicationEndpoint.ReplicateContext replicateContext) Do the shipping logic
protected int	replicateEntries(List<WAL.Entry> entries, int batchIndex, int timeout)

Methods inherited from class org.apache.hadoop.hbase.replication.HBaseReplicationEndpoint

abort, disconnect, doStart, fetchSlavesAddresses, getLastRegionServerUpdate, getPeerUUID, getRegionServers, getZkw, isAborted, reconnect, setRegionServers, start, stop

Methods inherited from class org.apache.hadoop.hbase.replication.BaseReplicationEndpoint

canReplicateToSameCluster, getNamespaceTableCfWALEntryFilter, getScopeWALEntryFilter, getWALEntryfilter, isStarting, peerConfigUpdated

Methods inherited from class org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService

addListener, awaitRunning, awaitRunning, awaitRunning, awaitTerminated, awaitTerminated, awaitTerminated, doCancelStart, failureCause, isRunning, notifyFailed, notifyStarted, notifyStopped, startAsync, state, stopAsync, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.Abortable

abort

Methods inherited from interface org.apache.hadoop.hbase.replication.ReplicationEndpoint

awaitRunning, awaitRunning, awaitTerminated, awaitTerminated, failureCause, isRunning

Field Detail

REPLICATION_DROP_ON_DELETED_TABLE_KEY

public static final String REPLICATION_DROP_ON_DELETED_TABLE_KEY

Drop edits for tables that been deleted from the replication source and target

See Also:

Constant Field Values

REPLICATION_DROP_ON_DELETED_COLUMN_FAMILY_KEY

public static final String REPLICATION_DROP_ON_DELETED_COLUMN_FAMILY_KEY

Drop edits for CFs that been deleted from the replication source and target

See Also:

Constant Field Values

Constructor Detail

HBaseInterClusterReplicationEndpoint

public HBaseInterClusterReplicationEndpoint()

Method Detail

createConnection

protected Connection createConnection(org.apache.hadoop.conf.Configuration conf)
                               throws IOException

Throws:

IOException

createReplicationSinkManager

protected ReplicationSinkManager createReplicationSinkManager(Connection conn)

init

public void init(ReplicationEndpoint.Context context)
          throws IOException

Description copied from interface: ReplicationEndpoint

Initialize the replication endpoint with the given context.

Specified by:

init in interface ReplicationEndpoint

Overrides:

init in class BaseReplicationEndpoint

Parameters:

context - replication context

Throws:

IOException - error occur when initialize the endpoint.

isTableNotFoundException

public static boolean isTableNotFoundException(Throwable io)

Check if there's an TableNotFoundException in the caused by stacktrace.

isNoSuchColumnFamilyException

public static boolean isNoSuchColumnFamilyException(Throwable io)

Check if there's an NoSuchColumnFamilyException in the caused by stacktrace.

replicate

public boolean replicate(ReplicationEndpoint.ReplicateContext replicateContext)

Do the shipping logic

Parameters:

replicateContext - a context where WAL entries and other parameters can be obtained.

isPeerEnabled

protected boolean isPeerEnabled()

doStop

protected void doStop()

Overrides:

doStop in class HBaseReplicationEndpoint

replicateEntries

protected int replicateEntries(List<WAL.Entry> entries,
                               int batchIndex,
                               int timeout)
                        throws IOException

Throws:

IOException

createReplicator

protected Callable<Integer> createReplicator(List<WAL.Entry> entries,
                                             int batchIndex,
                                             int timeout)