org.apache.gobblin.records

Class RecordStreamWithMetadata<D,S>

java.lang.Object

org.apache.gobblin.records.RecordStreamWithMetadata<D,S>

Type Parameters:

D - type of record.

S - type of schema.

public class RecordStreamWithMetadata<D,S>
extends Object

A stream of records along with metadata (e.g. Schema).

Constructor Summary

Constructors

Constructor and Description
RecordStreamWithMetadata()

Method Summary

Modifier and Type	Method and Description
<DO> RecordStreamWithMetadata<DO,S>	mapRecords(java.util.function.Function<RecordEnvelope<D>,RecordEnvelope<DO>> transform) Apply the input mapping function to RecordEnvelopes, while letting other kinds of StreamEntity to pass through.
<DO> RecordStreamWithMetadata<DO,S>	mapStream(java.util.function.Function<? super io.reactivex.Flowable<StreamEntity<D>>,? extends io.reactivex.Flowable<StreamEntity<DO>>> transform)
<DO> RecordStreamWithMetadata<DO,S>	withRecordStream(io.reactivex.Flowable<StreamEntity<DO>> newRecordStream)
<DO,SO> RecordStreamWithMetadata<DO,SO>	withRecordStream(io.reactivex.Flowable<StreamEntity<DO>> newRecordStream, GlobalMetadata<SO> newGlobalMetadata)
<DO,SO> RecordStreamWithMetadata<DO,SO>	withRecordStream(io.reactivex.Flowable<StreamEntity<DO>> newRecordStream, SO newSchema) Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RecordStreamWithMetadata

public RecordStreamWithMetadata()

Method Detail

withRecordStream

public <DO> RecordStreamWithMetadata<DO,S> withRecordStream(io.reactivex.Flowable<StreamEntity<DO>> newRecordStream)

Returns:

a new RecordStreamWithMetadata with a different recordStream but same schema.

withRecordStream

@Deprecated
public <DO,SO> RecordStreamWithMetadata<DO,SO> withRecordStream(io.reactivex.Flowable<StreamEntity<DO>> newRecordStream,
                                                                            SO newSchema)

Deprecated.

Returns:

a new RecordStreamWithMetadata with a different recordStream and globalMetadata.

withRecordStream

public <DO,SO> RecordStreamWithMetadata<DO,SO> withRecordStream(io.reactivex.Flowable<StreamEntity<DO>> newRecordStream,
                                                                GlobalMetadata<SO> newGlobalMetadata)

Returns:

a new RecordStreamWithMetadata with a different recordStream and globalMetadata.

mapStream

public <DO> RecordStreamWithMetadata<DO,S> mapStream(java.util.function.Function<? super io.reactivex.Flowable<StreamEntity<D>>,? extends io.reactivex.Flowable<StreamEntity<DO>>> transform)

Returns:

a new RecordStreamWithMetadata with a different recordStream but same schema using a lambda expression on the stream.

mapRecords

public <DO> RecordStreamWithMetadata<DO,S> mapRecords(java.util.function.Function<RecordEnvelope<D>,RecordEnvelope<DO>> transform)

Apply the input mapping function to RecordEnvelopes, while letting other kinds of StreamEntity to pass through.