org.apache.accumulo.master.replication

Class SequentialWorkAssigner

java.lang.Object

org.apache.accumulo.master.replication.DistributedWorkQueueWorkAssigner

org.apache.accumulo.master.replication.SequentialWorkAssigner

All Implemented Interfaces:

WorkAssigner

public class SequentialWorkAssigner
extends DistributedWorkQueueWorkAssigner

Creates work in ZK which is filename.serialized_ReplicationTarget => filename, but replicates files in the order in which they were created.

The intent is to ensure that WALs are replayed in the same order on the peer in which they were applied on the primary.

Field Summary

Fields inherited from class org.apache.accumulo.master.replication.DistributedWorkQueueWorkAssigner

conf, conn, maxQueueSize, workQueue, zooCache

Constructor Summary

Constructors

Constructor and Description
SequentialWorkAssigner()
SequentialWorkAssigner(AccumuloConfiguration conf, Connector conn)

Method Summary

Modifier and Type	Method and Description
protected void	cleanupFinishedWork() Iterate over the queued work to remove entries that have been completed.
String	getName()
protected Map<String,Map<String,String>>	getQueuedWork()
protected Set<String>	getQueuedWork(ReplicationTarget target)
protected int	getQueueSize()
protected void	initializeQueuedWork() Initialize the queuedWork set with the work already sent out
protected boolean	queueWork(org.apache.hadoop.fs.Path path, ReplicationTarget target) Queue the given work for the target
protected void	removeQueuedWork(ReplicationTarget target, String queueKey) Remove the given work from the internal state
protected void	setQueuedWork(Map<String,Map<String,String>> queuedWork)
protected boolean	shouldQueueWork(ReplicationTarget target)

Methods inherited from class org.apache.accumulo.master.replication.DistributedWorkQueueWorkAssigner

assignWork, configure, createWork, getConf, getConnector, getMaxQueueSize, getWorkQueue, getZooCache, initializeWorkQueue, isWorkRequired, setConf, setConnector, setMaxQueueSize, setWorkQueue, setZooCache

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SequentialWorkAssigner

public SequentialWorkAssigner()

SequentialWorkAssigner

public SequentialWorkAssigner(AccumuloConfiguration conf,
                              Connector conn)

Method Detail

getName

public String getName()

getQueuedWork

protected Map<String,Map<String,String>> getQueuedWork()

setQueuedWork

protected void setQueuedWork(Map<String,Map<String,String>> queuedWork)

initializeQueuedWork

protected void initializeQueuedWork()

Initialize the queuedWork set with the work already sent out

Specified by:

initializeQueuedWork in class DistributedWorkQueueWorkAssigner

cleanupFinishedWork

protected void cleanupFinishedWork()

Iterate over the queued work to remove entries that have been completed.

Specified by:

cleanupFinishedWork in class DistributedWorkQueueWorkAssigner

getQueueSize

protected int getQueueSize()

Specified by:

getQueueSize in class DistributedWorkQueueWorkAssigner

Returns:

the size of the queued work

shouldQueueWork

protected boolean shouldQueueWork(ReplicationTarget target)

Specified by:

shouldQueueWork in class DistributedWorkQueueWorkAssigner

Returns:

Can replication work for the given ReplicationTarget be submitted to be worked on.

queueWork

protected boolean queueWork(org.apache.hadoop.fs.Path path,
                            ReplicationTarget target)

Description copied from class: DistributedWorkQueueWorkAssigner

Queue the given work for the target

Specified by:

queueWork in class DistributedWorkQueueWorkAssigner

Parameters:

path - File to replicate

target - Target for the work

Returns:

True if the work was queued, false otherwise

getQueuedWork

protected Set<String> getQueuedWork(ReplicationTarget target)

Specified by:

getQueuedWork in class DistributedWorkQueueWorkAssigner

Parameters:

target - Target for the work

Returns:

Queued work for the given target

removeQueuedWork

protected void removeQueuedWork(ReplicationTarget target,
                                String queueKey)

Description copied from class: DistributedWorkQueueWorkAssigner

Remove the given work from the internal state

Specified by:

removeQueuedWork in class DistributedWorkQueueWorkAssigner