org.apache.hadoop.hbase.replication.regionserver

Class ReplicationSink

java.lang.Object

org.apache.hadoop.hbase.replication.regionserver.ReplicationSink

@InterfaceAudience.Private
public class ReplicationSink
extends Object

This class is responsible for replicating the edits coming from another cluster.

This replication process is currently waiting for the edits to be applied before the method can return. This means that the replication of edits is synchronized (after reading from WALs in ReplicationSource) and that a single region server cannot receive edits from two sources at the same time

This class uses the native HBase client in order to replicate entries.

TODO make this class more like ReplicationSource wrt log handling

Constructor Summary

Constructors

Constructor and Description
ReplicationSink(org.apache.hadoop.conf.Configuration conf, RegionServerCoprocessorHost rsServerHost) Create a sink for replication

Method Summary

Modifier and Type	Method and Description
MetricsSink	getSinkMetrics() Get replication Sink Metrics
String	getStats() Get a string representation of this sink's metrics
void	replicateEntries(List<org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.WALEntry> entries, CellScanner cells, String replicationClusterId, String sourceBaseNamespaceDirPath, String sourceHFileArchiveDirPath) Replicate this array of entries directly into the local cluster using the native client.
void	stopReplicationSinkServices() stop the thread pool executor.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ReplicationSink

public ReplicationSink(org.apache.hadoop.conf.Configuration conf,
                       RegionServerCoprocessorHost rsServerHost)
                throws IOException

Create a sink for replication

Parameters:

conf - conf object

Throws:

IOException - thrown when HDFS goes bad or bad file name

Method Detail

replicateEntries

public void replicateEntries(List<org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.WALEntry> entries,
                             CellScanner cells,
                             String replicationClusterId,
                             String sourceBaseNamespaceDirPath,
                             String sourceHFileArchiveDirPath)
                      throws IOException

Replicate this array of entries directly into the local cluster using the native client. Only operates against raw protobuf type saving on a conversion from pb to pojo.

Parameters:

entries - WAL entries to be replicated.

cells - cell scanner for iteration.

replicationClusterId - Id which will uniquely identify source cluster FS client configurations in the replication configuration directory

sourceBaseNamespaceDirPath - Path that point to the source cluster base namespace directory

sourceHFileArchiveDirPath - Path that point to the source cluster hfile archive directory

Throws:

IOException - If failed to replicate the data

stopReplicationSinkServices

public void stopReplicationSinkServices()

stop the thread pool executor. It is called when the regionserver is stopped.

getStats

public String getStats()

Get a string representation of this sink's metrics

Returns:

string with the total replicated edits count and the date of the last edit that was applied

getSinkMetrics

public MetricsSink getSinkMetrics()

Get replication Sink Metrics