org.apache.gobblin.fork

Class Forker

java.lang.Object

org.apache.gobblin.fork.Forker

public class Forker
extends Object

Forks a RecordStreamWithMetadata into multiple branches specified by a ForkOperator. Each forked stream is a mirror of the original stream.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Forker.ForkedStream<D,S> An object containing the forked streams and a ConnectableFlowable used to connect the stream when all streams have been subscribed to.

Constructor Summary

Constructors

Constructor and Description
Forker()

Method Summary

Modifier and Type	Method and Description
<D,S> Forker.ForkedStream<D,S>	forkStream(RecordStreamWithMetadata<D,S> inputStream, ForkOperator<S,D> forkOperator, WorkUnitState workUnitState) Obtain the Forker.ForkedStream for the input RecordStreamWithMetadata and ForkOperator.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Forker

public Forker()

Method Detail

forkStream

public <D,S> Forker.ForkedStream<D,S> forkStream(RecordStreamWithMetadata<D,S> inputStream,
                                                 ForkOperator<S,D> forkOperator,
                                                 WorkUnitState workUnitState)
                                          throws Exception

Obtain the Forker.ForkedStream for the input RecordStreamWithMetadata and ForkOperator.

Parameters:

inputStream - input Flowable of records.

forkOperator - ForkOperator specifying the fork behavior.

workUnitState - work unit configuration.

Returns:

a Forker.ForkedStream with the forked streams.

Throws:

Exception - if the ForkOperator throws any exceptions.