org.apache.gobblin.fork

Interface ForkOperator<S,D>

Type Parameters:

S - schema data type

D - data record data type

All Superinterfaces:

AutoCloseable, Closeable

public interface ForkOperator<S,D>
extends Closeable

An interface for fork operators that convert one input data record into multiple records. So essentially this operator forks one input data stream into multiple data streams. This interface allows user to plugin their fork logic.

Method Summary

Modifier and Type	Method and Description
List<Boolean>	forkDataRecord(WorkUnitState workUnitState, D input) Get a list of Booleans indicating if the record should go to each branch.
List<Boolean>	forkSchema(WorkUnitState workUnitState, S input) Get a list of Booleans indicating if the schema should go to each branch.
int	getBranches(WorkUnitState workUnitState) Get the number of branches after the fork.
void	init(WorkUnitState workUnitState) Initialize this ForkOperator.

Methods inherited from interface java.io.Closeable

close

Method Detail

init

void init(WorkUnitState workUnitState)
   throws Exception

Initialize this ForkOperator.

Parameters:

workUnitState - WorkUnitState carrying the configuration

Throws:

Exception

getBranches

int getBranches(WorkUnitState workUnitState)

Get the number of branches after the fork.

Parameters:

workUnitState - WorkUnitState carrying the configuration

Returns:

number of branches after the fork

forkSchema

List<Boolean> forkSchema(WorkUnitState workUnitState,
                         S input)

Get a list of Booleans indicating if the schema should go to each branch.

Parameters:

workUnitState - WorkUnitState carrying the configuration

input - input schema

Returns:

list of Booleans

forkDataRecord

List<Boolean> forkDataRecord(WorkUnitState workUnitState,
                             D input)

Get a list of Booleans indicating if the record should go to each branch.

Parameters:

workUnitState - WorkUnitState carrying the configuration

input - input data record

Returns:

list of Booleans