org.apache.gobblin.source.workunit

Class BasicWorkUnitStream

java.lang.Object

org.apache.gobblin.source.workunit.BasicWorkUnitStream

All Implemented Interfaces:

WorkUnitStream

public class BasicWorkUnitStream
extends Object
implements WorkUnitStream

A basic implementation of WorkUnitStream.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BasicWorkUnitStream.Builder

Method Summary

Modifier and Type	Method and Description
WorkUnitStream	filter(com.google.common.base.Predicate<WorkUnit> predicate) Apply a filtering function to this stream.
Collection<WorkUnit>	getMaterializedWorkUnitCollection() Get a materialized collection of the WorkUnits in this stream.
Iterator<WorkUnit>	getWorkUnits()
WorkUnitStream	transform(com.google.common.base.Function<WorkUnit,WorkUnit> function) Apply a transformation function to this stream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.gobblin.source.workunit.WorkUnitStream

isFiniteStream, isSafeToMaterialize

Method Detail

getWorkUnits

public Iterator<WorkUnit> getWorkUnits()

Specified by:

getWorkUnits in interface WorkUnitStream

Returns:

Iterator of WorkUnits.

transform

public WorkUnitStream transform(com.google.common.base.Function<WorkUnit,WorkUnit> function)

Apply a transformation function to this stream.

Specified by:

transform in interface WorkUnitStream

filter

public WorkUnitStream filter(com.google.common.base.Predicate<WorkUnit> predicate)

Apply a filtering function to this stream.

Specified by:

filter in interface WorkUnitStream

getMaterializedWorkUnitCollection

public Collection<WorkUnit> getMaterializedWorkUnitCollection()

Get a materialized collection of the WorkUnits in this stream. Note this call will fail if WorkUnitStream.isSafeToMaterialize() is false.

Specified by:

getMaterializedWorkUnitCollection in interface WorkUnitStream