org.apache.beam.sdk.extensions.avro.io

Class AvroIO.Parse<T>

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<T>>

org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse<T>

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

AvroIO

public abstract static class AvroIO.Parse<T>
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<T>>

Implementation of AvroIO.parseGenericRecords(org.apache.beam.sdk.transforms.SerializableFunction<org.apache.avro.generic.GenericRecord, T>).

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor and Description
Parse()

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.values.PCollection<T>	expand(org.apache.beam.sdk.values.PBegin input)
AvroIO.Parse<T>	from(java.lang.String filepattern) Reads from the given filename or filepattern.
AvroIO.Parse<T>	from(org.apache.beam.sdk.options.ValueProvider<java.lang.String> filepattern) Like from(String).
void	populateDisplayData(org.apache.beam.sdk.transforms.display.DisplayData.Builder builder)
AvroIO.Parse<T>	watchForNewFiles(org.joda.time.Duration pollInterval, org.apache.beam.sdk.transforms.Watch.Growth.TerminationCondition<java.lang.String,?> terminationCondition) Like AvroIO.Read.watchForNewFiles(org.joda.time.Duration, org.apache.beam.sdk.transforms.Watch.Growth.TerminationCondition<java.lang.String, ?>, boolean).
AvroIO.Parse<T>	withCoder(org.apache.beam.sdk.coders.Coder<T> coder) Sets a coder for the result of the parse function.
AvroIO.Parse<T>	withEmptyMatchTreatment(org.apache.beam.sdk.io.fs.EmptyMatchTreatment treatment) Like AvroIO.Read.withEmptyMatchTreatment(org.apache.beam.sdk.io.fs.EmptyMatchTreatment).
AvroIO.Parse<T>	withHintMatchesManyFiles() Like AvroIO.Read.withHintMatchesManyFiles().
AvroIO.Parse<T>	withMatchConfiguration(org.apache.beam.sdk.io.FileIO.MatchConfiguration configuration) Sets the FileIO.MatchConfiguration.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Parse

public Parse()

Method Detail

from

public AvroIO.Parse<T> from(java.lang.String filepattern)

Reads from the given filename or filepattern.

from

public AvroIO.Parse<T> from(org.apache.beam.sdk.options.ValueProvider<java.lang.String> filepattern)

Like from(String).

withMatchConfiguration

public AvroIO.Parse<T> withMatchConfiguration(org.apache.beam.sdk.io.FileIO.MatchConfiguration configuration)

Sets the FileIO.MatchConfiguration.

withEmptyMatchTreatment

public AvroIO.Parse<T> withEmptyMatchTreatment(org.apache.beam.sdk.io.fs.EmptyMatchTreatment treatment)

Like AvroIO.Read.withEmptyMatchTreatment(org.apache.beam.sdk.io.fs.EmptyMatchTreatment).

watchForNewFiles

public AvroIO.Parse<T> watchForNewFiles(org.joda.time.Duration pollInterval,
                                        org.apache.beam.sdk.transforms.Watch.Growth.TerminationCondition<java.lang.String,?> terminationCondition)

Like AvroIO.Read.watchForNewFiles(org.joda.time.Duration, org.apache.beam.sdk.transforms.Watch.Growth.TerminationCondition<java.lang.String, ?>, boolean).

withCoder

public AvroIO.Parse<T> withCoder(org.apache.beam.sdk.coders.Coder<T> coder)

Sets a coder for the result of the parse function.

withHintMatchesManyFiles

public AvroIO.Parse<T> withHintMatchesManyFiles()

Like AvroIO.Read.withHintMatchesManyFiles().

expand

public org.apache.beam.sdk.values.PCollection<T> expand(org.apache.beam.sdk.values.PBegin input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<T>>

populateDisplayData

public void populateDisplayData(org.apache.beam.sdk.transforms.display.DisplayData.Builder builder)

Specified by:

populateDisplayData in interface org.apache.beam.sdk.transforms.display.HasDisplayData

Overrides:

populateDisplayData in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<T>>