org.apache.hudi.utilities.deltastreamer

Class HoodieDeltaStreamer.AsyncCompactService

java.lang.Object

org.apache.hudi.utilities.deltastreamer.AbstractDeltaStreamerService

org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.AsyncCompactService

All Implemented Interfaces:

Serializable

Enclosing class:

HoodieDeltaStreamer

public static class HoodieDeltaStreamer.AsyncCompactService
extends AbstractDeltaStreamerService

Async Compactor Service tha runs in separate thread. Currently, only one compactor is allowed to run at any time.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.hudi.utilities.deltastreamer.AbstractDeltaStreamerService

log

Constructor Summary

Constructors

Constructor and Description
AsyncCompactService(org.apache.spark.api.java.JavaSparkContext jssc, HoodieWriteClient client)

Method Summary

Modifier and Type	Method and Description
void	enqueuePendingCompaction(HoodieInstant instant) Enqueues new Pending compaction
protected Pair<CompletableFuture,ExecutorService>	startService() Start Compaction Service
void	waitTillPendingCompactionsReducesTo(int numPendingCompactions) Wait till outstanding pending compactions reduces to the passed in value

Methods inherited from class org.apache.hudi.utilities.deltastreamer.AbstractDeltaStreamerService

start

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AsyncCompactService

public AsyncCompactService(org.apache.spark.api.java.JavaSparkContext jssc,
                           HoodieWriteClient client)

Method Detail

enqueuePendingCompaction

public void enqueuePendingCompaction(HoodieInstant instant)

Enqueues new Pending compaction

waitTillPendingCompactionsReducesTo

public void waitTillPendingCompactionsReducesTo(int numPendingCompactions)
                                         throws InterruptedException

Wait till outstanding pending compactions reduces to the passed in value

Parameters:

numPendingCompactions - Maximum pending compactions allowed

Throws:

InterruptedException

startService

protected Pair<CompletableFuture,ExecutorService> startService()

Start Compaction Service

Specified by:

startService in class AbstractDeltaStreamerService

Returns: