org.apache.gobblin.runtime.api

Interface SpecConsumer<V>

public interface SpecConsumer<V>

A communication socket (receiving side for this class) for each SpecExecutor to receive spec to execute from Orchestrator. Implementation of this interface should specify communication channel (e.g. Kafka, REST, etc.)

Method Summary

Modifier and Type	Method and Description
Future<? extends List<org.apache.commons.lang3.tuple.Pair<SpecExecutor.Verb,V>>>	changedSpecs() List of newly changed Specs for execution on SpecExecutor.
default void	commit(Spec spec) A commit method to allow the consumer to checkpoint state on successful consumption of a Spec.

Method Detail

changedSpecs

Future<? extends List<org.apache.commons.lang3.tuple.Pair<SpecExecutor.Verb,V>>> changedSpecs()

List of newly changed Specs for execution on SpecExecutor.

commit

default void commit(Spec spec)
             throws IOException

A commit method to allow the consumer to checkpoint state on successful consumption of a Spec.

Throws:

IOException