A C D E F G H I L N O P R S T U V W
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- addLogicalTypeConversions(GenericData) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
- apply(Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.GenericDatumFactory
- apply(Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.ReflectDatumFactory
- apply(Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.SpecificDatumFactory
- apply(Schema) - Method in interface org.apache.beam.sdk.extensions.avro.io.AvroSink.DatumWriterFactory
- apply(Schema, Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.GenericDatumFactory
- apply(Schema, Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.ReflectDatumFactory
- apply(Schema, Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.SpecificDatumFactory
- apply(Schema, Schema) - Method in interface org.apache.beam.sdk.extensions.avro.io.AvroSource.DatumReaderFactory
- AVRO_CODER_URN - Static variable in class org.apache.beam.sdk.extensions.avro.AvroGenericCoderRegistrar
- AvroCoder<T> - Class in org.apache.beam.sdk.extensions.avro.coders
-
A
Coderusing Avro binary format. - AvroCoder(Class<T>, Schema) - Constructor for class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
- AvroCoder(Class<T>, Schema, boolean) - Constructor for class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
- AvroCoder(AvroDatumFactory<T>, Schema) - Constructor for class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
- AvroConvertType(boolean) - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.AvroConvertType
- AvroDatumFactory<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
Create
DatumReaderandDatumWriterfor given schemas. - AvroDatumFactory(Class<T>) - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
- AvroDatumFactory.GenericDatumFactory - Class in org.apache.beam.sdk.extensions.avro.io
-
Specialized
AvroDatumFactoryforGenericRecord. - AvroDatumFactory.ReflectDatumFactory<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
Specialized
AvroDatumFactoryfor java classes transforming to avro through reflection. - AvroDatumFactory.SpecificDatumFactory<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
Specialized
AvroDatumFactoryforSpecificRecord. - AvroGenericCoder - Class in org.apache.beam.sdk.extensions.avro.coders
-
AvroCoder specialisation for GenericRecord, needed for cross-language transforms.
- AvroGenericCoderRegistrar - Class in org.apache.beam.sdk.extensions.avro
-
Coder registrar for AvroGenericCoder.
- AvroGenericCoderRegistrar() - Constructor for class org.apache.beam.sdk.extensions.avro.AvroGenericCoderRegistrar
- AvroGenericCoderTranslator - Class in org.apache.beam.sdk.extensions.avro
-
Coder translator for AvroGenericCoder.
- AvroGenericCoderTranslator() - Constructor for class org.apache.beam.sdk.extensions.avro.AvroGenericCoderTranslator
- AvroIO - Class in org.apache.beam.sdk.extensions.avro.io
-
PTransforms for reading and writing Avro files. - AvroIO.Parse<T> - Class in org.apache.beam.sdk.extensions.avro.io
- AvroIO.ParseAll<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
Deprecated.See
AvroIO.parseAllGenericRecords(SerializableFunction)for details. - AvroIO.ParseFiles<T> - Class in org.apache.beam.sdk.extensions.avro.io
- AvroIO.Read<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
Implementation of
AvroIO.read(java.lang.Class<T>)andAvroIO.readGenericRecords(org.apache.avro.Schema). - AvroIO.ReadAll<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
Deprecated.See
AvroIO.readAll(Class)for details. - AvroIO.ReadFiles<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
Implementation of
AvroIO.readFiles(java.lang.Class<T>). - AvroIO.RecordFormatter<ElementT> - Interface in org.apache.beam.sdk.extensions.avro.io
-
Deprecated.Users can achieve the same by providing this transform in a
ParDobefore using write in AvroIOAvroIO.write(Class). - AvroIO.Sink<ElementT> - Class in org.apache.beam.sdk.extensions.avro.io
- AvroIO.TypedWrite<UserT,DestinationT,OutputT> - Class in org.apache.beam.sdk.extensions.avro.io
-
Implementation of
AvroIO.write(java.lang.Class<T>). - AvroIO.Write<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
This class is used as the default return value of
AvroIO.write(java.lang.Class<T>) - AvroJavaTimeConversions - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
-
Avro 1.8 ships with joda time conversions only.
- AvroJavaTimeConversions() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions
- AvroJavaTimeConversions.DateConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJavaTimeConversions.LocalTimestampMicros - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJavaTimeConversions.LocalTimestampMicrosConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJavaTimeConversions.LocalTimestampMillis - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJavaTimeConversions.LocalTimestampMillisConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJavaTimeConversions.TimeMicrosConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJavaTimeConversions.TimeMillisConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJavaTimeConversions.TimestampMicrosConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJavaTimeConversions.TimestampMillisConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJodaTimeConversions - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
-
Avro 1.8 & 1.9 ship joda time conversions.
- AvroJodaTimeConversions() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions
- AvroJodaTimeConversions.DateConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJodaTimeConversions.LossyTimeMicrosConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJodaTimeConversions.LossyTimestampMicrosConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJodaTimeConversions.TimeConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJodaTimeConversions.TimeMicrosConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJodaTimeConversions.TimestampConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroJodaTimeConversions.TimestampMicrosConversion - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroPayloadSerializerProvider - Class in org.apache.beam.sdk.extensions.avro.schemas.io.payloads
- AvroPayloadSerializerProvider() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.io.payloads.AvroPayloadSerializerProvider
- AvroReader(AvroSource<T>) - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroSource.AvroReader
-
Reads Avro records of type
Tfrom the specified source. - AvroRecordSchema - Class in org.apache.beam.sdk.extensions.avro.schemas
-
A
SchemaProviderfor AVRO generated SpecificRecords and POJOs. - AvroRecordSchema() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.AvroRecordSchema
- AvroSchemaInformationProvider - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroSchemaInformationProvider() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroSchemaInformationProvider
- AvroSchemaIOProvider - Class in org.apache.beam.sdk.extensions.avro.io
-
An implementation of
SchemaIOProviderfor reading and writing Avro files withAvroIO. - AvroSchemaIOProvider() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroSchemaIOProvider
- AvroSink<UserT,DestinationT,OutputT> - Class in org.apache.beam.sdk.extensions.avro.io
-
A
FileBasedSinkfor Avro files. - AvroSink.DatumWriterFactory<T> - Interface in org.apache.beam.sdk.extensions.avro.io
- AvroSource<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
Do not use in pipelines directly: most users should use
AvroIO.Read. - AvroSource.AvroReader<T> - Class in org.apache.beam.sdk.extensions.avro.io
-
A
BlockBasedSource.BlockBasedReaderfor reading blocks from Avro files. - AvroSource.DatumReaderFactory<T> - Interface in org.apache.beam.sdk.extensions.avro.io
- AvroUtils - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
-
Utils to convert AVRO records to Beam rows.
- AvroUtils.AvroConvertType - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroUtils.AvroConvertValueForGetter - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroUtils.AvroConvertValueForSetter - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
- AvroUtils.FixedBytesField - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
-
Wrapper for fixed byte fields.
- AvroUtils.TypeWithNullability - Class in org.apache.beam.sdk.extensions.avro.schemas.utils
C
- configurationSchema() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSchemaIOProvider
-
Returns the expected schema of the configuration object.
- constantDestinations(FileBasedSink.FilenamePolicy, Schema, Map<String, Object>, CodecFactory, SerializableFunction<UserT, OutputT>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Returns a
DynamicAvroDestinationsthat always returns the sameFileBasedSink.FilenamePolicy, schema, metadata, and codec. - constantDestinations(FileBasedSink.FilenamePolicy, Schema, Map<String, Object>, CodecFactory, SerializableFunction<UserT, OutputT>, AvroSink.DatumWriterFactory<OutputT>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Returns a
DynamicAvroDestinationsthat always returns the sameFileBasedSink.FilenamePolicy, schema, metadata, and codec. - convertAvroFieldStrict(Object, Schema, Schema.FieldType) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Strict conversion from AVRO to Beam, strict because it doesn't do widening or narrowing during conversion.
- convertDefault(TypeDescriptor<?>) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.AvroConvertType
- convertDefault(TypeDescriptor<?>) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.AvroConvertValueForGetter
- convertDefault(TypeDescriptor<?>) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.AvroConvertValueForSetter
- create(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.TypeWithNullability
- createForSubrangeOfFile(String, long, long) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
-
Deprecated.Used by Dataflow worker
- createForSubrangeOfFile(MatchResult.Metadata, long, long) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
- createWriteOperation() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSink
D
- DateConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.DateConversion
- DateConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.DateConversion
- decode(InputStream) - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
- DynamicAvroDestinations<UserT,DestinationT,OutputT> - Class in org.apache.beam.sdk.extensions.avro.io
-
A specialization of
FileBasedSink.DynamicDestinationsforAvroIO. - DynamicAvroDestinations() - Constructor for class org.apache.beam.sdk.extensions.avro.io.DynamicAvroDestinations
E
- encode(T, OutputStream) - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
- equals(Object) - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
- equals(Object) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
- expand(PBegin) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
- expand(PBegin) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
- expand(PCollection<String>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.
- expand(PCollection<String>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadAll
-
Deprecated.
- expand(PCollection<FileIO.ReadableFile>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseFiles
- expand(PCollection<FileIO.ReadableFile>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
- expand(PCollection<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- expand(PCollection<UserT>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
F
- fieldValueGetters(TypeDescriptor<T>, Schema) - Method in class org.apache.beam.sdk.extensions.avro.schemas.AvroRecordSchema
- fieldValueTypeInformations(TypeDescriptor<?>, Schema) - Method in class org.apache.beam.sdk.extensions.avro.schemas.AvroRecordSchema
- flush() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Sink
- formatRecord(ElementT, Schema) - Method in interface org.apache.beam.sdk.extensions.avro.io.AvroIO.RecordFormatter
-
Deprecated.
- from(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
-
Reads from the given filename or filepattern.
- from(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
- from(String) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
- from(String, Row, Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSchemaIOProvider
-
Produce a SchemaIO given a String representing the data's location, the schema of the data that resides there, and some IO-specific configuration object.
- from(MatchResult.Metadata) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
- from(ValueProvider<String>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
- from(ValueProvider<String>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
Reads from the given filename or filepattern.
- from(ValueProvider<String>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
-
Reads from the given file name or pattern ("glob").
- fromAvroType(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.FixedBytesField
-
Create a
AvroUtils.FixedBytesFieldfrom an AVRO type. - fromBeamFieldType(Schema.FieldType) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.FixedBytesField
-
Create a
AvroUtils.FixedBytesFieldfrom a BeamSchema.FieldType. - fromComponents(List<Coder<?>>, byte[], CoderTranslation.TranslationContext) - Method in class org.apache.beam.sdk.extensions.avro.AvroGenericCoderTranslator
- fromInt(Integer, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.DateConversion
- fromInt(Integer, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMillisConversion
- fromInt(Integer, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.DateConversion
- fromInt(Integer, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeConversion
- fromLong(Long, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMicrosConversion
- fromLong(Long, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMillisConversion
- fromLong(Long, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMicrosConversion
- fromLong(Long, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMicrosConversion
- fromLong(Long, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMillisConversion
- fromLong(Long, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeMicrosConversion
- fromLong(Long, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampConversion
- fromLong(Long, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampMicrosConversion
G
- generic() - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
-
Returns an
AvroDatumFactoryinstance for GenericRecord. - generic(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the Avro schema. - GenericDatumFactory() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.GenericDatumFactory
- getAvroBytesToRowFunction(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns a function mapping encoded AVRO
GenericRecords to BeamRows. - getCodec(DestinationT) - Method in class org.apache.beam.sdk.extensions.avro.io.DynamicAvroDestinations
-
Return an AVRO codec for a given destination.
- getCoderProvider() - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns a
CoderProviderwhich uses theAvroCoderif possible for all types. - getCoderTranslators() - Method in class org.apache.beam.sdk.extensions.avro.AvroGenericCoderRegistrar
- getCoderURNs() - Method in class org.apache.beam.sdk.extensions.avro.AvroGenericCoderRegistrar
- getComponents(AvroGenericCoder) - Method in class org.apache.beam.sdk.extensions.avro.AvroGenericCoderTranslator
- getConvertedSchemaInformation(Schema, TypeDescriptor<T>) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroSchemaInformationProvider
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.DateConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMicrosConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMillisConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMicrosConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMillisConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMicrosConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMillisConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.DateConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeMicrosConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampConversion
- getConvertedType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampMicrosConversion
- getCreator(TypeDescriptor<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Get an object creator for an AVRO-generated SpecificRecord.
- getCurrentBlock() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource.AvroReader
- getCurrentBlockOffset() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource.AvroReader
- getCurrentBlockSize() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource.AvroReader
- getCurrentSource() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource.AvroReader
- getDatumFactory() - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns the datum factory used for encoding/decoding.
- getDatumWriterFactory(DestinationT) - Method in class org.apache.beam.sdk.extensions.avro.io.DynamicAvroDestinations
-
Return a
AvroSink.DatumWriterFactoryfor a given destination. - getDynamicDestinations() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSink
- getEncodedTypeDescriptor() - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
- getFactory() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.AvroConvertValueForGetter
- getFactory() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.AvroConvertValueForSetter
- getFieldTypes(TypeDescriptor<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Get field types for an AVRO-generated SpecificRecord or a POJO.
- getFromRowFunction(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
- getGenericRecordToRowFunction(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns a function mapping AVRO
GenericRecords to BeamRows for use inPCollection.setSchema(org.apache.beam.sdk.schemas.Schema, org.apache.beam.sdk.values.TypeDescriptor<T>, org.apache.beam.sdk.transforms.SerializableFunction<T, org.apache.beam.sdk.values.Row>, org.apache.beam.sdk.transforms.SerializableFunction<org.apache.beam.sdk.values.Row, T>). - getGetters(TypeDescriptor<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Get generated getters for an AVRO-generated SpecificRecord or a POJO.
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.DateConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMicrosConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMillisConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMicrosConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMillisConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMicrosConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMillisConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.DateConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeMicrosConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampConversion
- getLogicalTypeName() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampMicrosConversion
- getMetadata(DestinationT) - Method in class org.apache.beam.sdk.extensions.avro.io.DynamicAvroDestinations
-
Return AVRO file metadata for a given destination.
- getOutputCoder() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
- getPayload(AvroGenericCoder) - Method in class org.apache.beam.sdk.extensions.avro.AvroGenericCoderTranslator
- getRecommendedSchema() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.DateConversion
- getRecommendedSchema() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMicrosConversion
- getRecommendedSchema() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMillisConversion
- getRecommendedSchema() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMicrosConversion
- getRecommendedSchema() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMillisConversion
- getRecommendedSchema() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMicrosConversion
- getRecommendedSchema() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMillisConversion
- getRowToAvroBytesFunction(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns a function mapping Beam
Rows to encoded AVROGenericRecords. - getRowToGenericRecordFunction(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns a function mapping Beam
Rows to AVROGenericRecords for use inPCollection.setSchema(org.apache.beam.sdk.schemas.Schema, org.apache.beam.sdk.values.TypeDescriptor<T>, org.apache.beam.sdk.transforms.SerializableFunction<T, org.apache.beam.sdk.values.Row>, org.apache.beam.sdk.transforms.SerializableFunction<org.apache.beam.sdk.values.Row, T>). - getSchema() - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns the schema used by this coder.
- getSchema(DestinationT) - Method in class org.apache.beam.sdk.extensions.avro.io.DynamicAvroDestinations
-
Return an AVRO schema for a given destination.
- getSchema(Class<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
- getSerializer(Schema, Map<String, Object>) - Method in class org.apache.beam.sdk.extensions.avro.schemas.io.payloads.AvroPayloadSerializerProvider
- getSize() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.FixedBytesField
-
Get the size.
- getSplitPointsRemaining() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource.AvroReader
- getToRowFunction(Class<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
- getType() - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns the type this coder encodes/decodes.
- getType() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
-
Returns the type for the datum factory.
- getType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.TypeWithNullability
H
- hashCode() - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
- hashCode() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
I
- identifier() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSchemaIOProvider
-
Returns an id that uniquely represents this IO.
- identifier() - Method in class org.apache.beam.sdk.extensions.avro.schemas.io.payloads.AvroPayloadSerializerProvider
- INSTANCE - Static variable in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.GenericDatumFactory
- isBounded() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSchemaIOProvider
- isNullable() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.TypeWithNullability
L
- LocalTimestampMicrosConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMicrosConversion
- LocalTimestampMillisConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMillisConversion
- LossyTimeMicrosConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.LossyTimeMicrosConversion
- LossyTimestampMicrosConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.LossyTimestampMicrosConversion
N
- nullable - Variable in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.TypeWithNullability
O
- of(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element class. - of(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
-
Returns an
AvroDatumFactoryinstance for the provided element type. - of(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.ReflectDatumFactory
- of(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.SpecificDatumFactory
- of(Class<T>, boolean) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the given class, respecting whether to use Avro's Reflect* or Specific* suite for encoding and decoding. - of(Class<T>, boolean) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
-
Returns an
AvroDatumFactoryinstance for the provided element type respecting Avro's Reflect* or Specific* suite for encoding and decoding. - of(Class<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type using the provided Avro schema - of(Class<T>, Schema, boolean) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type using the provided Avro schema, respecting whether to use Avro's Reflect* or Specific* suite for encoding and decoding. - of(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroGenericCoderinstance for the Avro schema. - of(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroGenericCoder
- of(AvroDatumFactory<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the providedAvroDatumFactoryusing the provided Avro schema. - of(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type. - of(TypeDescriptor<T>, boolean) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type, respecting whether to use Avro's Reflect* or Specific* suite for encoding and decoding. - open(WritableByteChannel) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Sink
- org.apache.beam.sdk.extensions.avro - package org.apache.beam.sdk.extensions.avro
-
Defines
Schemaand other classes for representing schema'd data in aPipelineusing Apache Avro. - org.apache.beam.sdk.extensions.avro.coders - package org.apache.beam.sdk.extensions.avro.coders
-
Defines
Codersto specify how data is encoded to and decoded from byte strings using Apache Avro. - org.apache.beam.sdk.extensions.avro.io - package org.apache.beam.sdk.extensions.avro.io
-
Defines transforms for reading and writing Avro storage format.
- org.apache.beam.sdk.extensions.avro.schemas - package org.apache.beam.sdk.extensions.avro.schemas
-
Defines
Schemaand other classes for representing schema'd data in aPipelineusing Apache Avro. - org.apache.beam.sdk.extensions.avro.schemas.io.payloads - package org.apache.beam.sdk.extensions.avro.schemas.io.payloads
-
Provides abstractions for schema-aware AvroIO.
- org.apache.beam.sdk.extensions.avro.schemas.utils - package org.apache.beam.sdk.extensions.avro.schemas.utils
-
Defines utilities for deailing with schemas using Apache Avro.
P
- Parse() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
- ParseAll() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.
- parseAllGenericRecords(SerializableFunction<GenericRecord, T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Deprecated.You can achieve The functionality of
AvroIO.parseAllGenericRecords(SerializableFunction)usingFileIOmatching plusAvroIO.parseFilesGenericRecords(SerializableFunction)()}. This is the preferred method to make composition explicit.AvroIO.ParseAllwill not receive upgrades and will be removed in a future version of Beam. - ParseFiles() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseFiles
- parseFilesGenericRecords(SerializableFunction<GenericRecord, T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Like
AvroIO.parseGenericRecords(SerializableFunction), but reads eachFileIO.ReadableFilein the inputPCollection. - parseGenericRecords(SerializableFunction<GenericRecord, T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Reads Avro file(s) containing records of an unspecified schema and converting each record to a custom type.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseFiles
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadAll
-
Deprecated.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
R
- read(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Reads records of the given type from an Avro file (or multiple Avro files matching a pattern).
- Read() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
- readAll(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Deprecated.You can achieve The functionality of
AvroIO.readAll(java.lang.Class<T>)usingFileIOmatching plusAvroIO.readFiles(Class). This is the preferred method to make composition explicit.AvroIO.ReadAllwill not receive upgrades and will be removed in a future version of Beam. - ReadAll() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadAll
-
Deprecated.
- readAllGenericRecords(String) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Deprecated.You can achieve The functionality of
AvroIO.readAllGenericRecords(String)usingFileIOmatching plusAvroIO.readFilesGenericRecords(String). This is the preferred method to make composition explicit.AvroIO.ReadAllwill not receive upgrades and will be removed in a future version of Beam. - readAllGenericRecords(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Deprecated.You can achieve The functionality of
AvroIO.readAllGenericRecords(Schema)usingFileIOmatching plusAvroIO.readFilesGenericRecords(Schema). This is the preferred method to make composition explicit.AvroIO.ReadAllwill not receive upgrades and will be removed in a future version of Beam. - readFiles(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Like
AvroIO.read(java.lang.Class<T>), but reads each file in aPCollectionofFileIO.ReadableFile, returned byFileIO.readMatches(). - ReadFiles() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
- readFilesGenericRecords(String) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Like
AvroIO.readGenericRecords(String), but forFileIO.ReadableFilecollections. - readFilesGenericRecords(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Like
AvroIO.readGenericRecords(Schema), but for aPCollectionofFileIO.ReadableFile, for example, returned byFileIO.readMatches(). - readGenericRecords(String) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Reads Avro file(s) containing records of the specified schema.
- readGenericRecords(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Reads Avro file(s) containing records of the specified schema.
- readNextBlock() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource.AvroReader
- reflect(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type respecting Avro's Reflect* suite for encoding and decoding. - reflect(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
-
Returns an
AvroDatumFactoryinstance for the provided element type respecting Avro's Reflect* suite for encoding and decoding. - reflect(Class<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type respecting Avro's Reflect* suite for encoding and decoding. - reflect(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type respecting Avro's Reflect* suite for encoding and decoding. - ReflectDatumFactory(Class<T>) - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.ReflectDatumFactory
- requiresDataSchema() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSchemaIOProvider
S
- schemaCoder(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns an
SchemaCoderinstance for the provided element class. - schemaCoder(Class<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns an
SchemaCoderinstance for the provided element type using the provided Avro schema. - schemaCoder(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns an
SchemaCoderinstance for the Avro schema. - schemaCoder(AvroCoder<T>) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns an
SchemaCoderinstance based on the provided AvroCoder for the element type. - schemaCoder(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Returns an
SchemaCoderinstance for the provided element type. - schemaFor(TypeDescriptor<T>) - Method in class org.apache.beam.sdk.extensions.avro.schemas.AvroRecordSchema
- schemaTypeCreator(TypeDescriptor<?>, Schema) - Method in class org.apache.beam.sdk.extensions.avro.schemas.AvroRecordSchema
- sink(Class<ElementT>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
A
AvroIO.Sinkfor use withFileIO.write()andFileIO.writeDynamic(), writing elements of the given generated class, likeAvroIO.write(Class). - sink(String) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
A
AvroIO.Sinkfor use withFileIO.write()andFileIO.writeDynamic(), writing elements with a given (common) schema, likeAvroIO.writeGenericRecords(String). - sink(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
A
AvroIO.Sinkfor use withFileIO.write()andFileIO.writeDynamic(), writing elements with a given (common) schema, likeAvroIO.writeGenericRecords(Schema). - Sink() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroIO.Sink
- sinkViaGenericRecords(Schema, AvroIO.RecordFormatter<ElementT>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Deprecated.RecordFormatter will be removed in future versions.
- specific(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type respecting Avro's Specific* suite for encoding and decoding. - specific(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
-
Returns an
AvroDatumFactoryinstance for the provided element type respecting Avro's Specific* suite for encoding and decoding. - specific(Class<T>, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type respecting Avro's Specific* suite for encoding and decoding. - specific(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Returns an
AvroCoderinstance for the provided element type respecting Avro's Specific* suite for encoding and decoding. - SpecificDatumFactory(Class<T>) - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory.SpecificDatumFactory
- startReading(ReadableByteChannel) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource.AvroReader
T
- TimeConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeConversion
- TimeMicrosConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMicrosConversion
- TimeMicrosConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeMicrosConversion
- TimeMillisConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMillisConversion
- TimestampConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampConversion
- TimestampMicrosConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMicrosConversion
- TimestampMicrosConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampMicrosConversion
- TimestampMillisConversion() - Constructor for class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMillisConversion
- to(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Writes to file(s) with the given output prefix.
- to(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- to(DynamicAvroDestinations<T, ?, T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
-
Deprecated.Use
FileIO.write()orFileIO.writeDynamic()instead. - to(DynamicAvroDestinations<UserT, NewDestinationT, OutputT>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Deprecated.Use
FileIO.write()orFileIO.writeDynamic()instead. - to(FileBasedSink.FilenamePolicy) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Writes to files named according to the given
FileBasedSink.FilenamePolicy. - to(FileBasedSink.FilenamePolicy) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- to(ResourceId) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Writes to file(s) with the given output prefix.
- to(ResourceId) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- to(ValueProvider<String>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
- to(ValueProvider<String>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- toAvroField(Schema.Field, String) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Get Avro Field from Beam Field.
- toAvroSchema(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
- toAvroSchema(Schema, String, String) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Converts a Beam Schema into an AVRO schema.
- toAvroType(String, String) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.FixedBytesField
-
Convert to an AVRO type.
- toBeamField(Schema.Field) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Get Beam Field from avro Field.
- toBeamRowStrict(GenericRecord, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Strict conversion from AVRO to Beam, strict because it doesn't do widening or narrowing during conversion.
- toBeamSchema(Class<?>) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Converts AVRO schema to Beam row schema.
- toBeamSchema(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Converts AVRO schema to Beam row schema.
- toBeamType() - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.FixedBytesField
-
Convert to a Beam type.
- toGenericRecord(Row) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Convert from a Beam Row to an AVRO GenericRecord.
- toGenericRecord(Row, Schema) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils
-
Convert from a Beam Row to an AVRO GenericRecord.
- toInt(LocalDate, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.DateConversion
- toInt(LocalTime, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMillisConversion
- toInt(LocalDate, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.DateConversion
- toInt(LocalTime, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimeConversion
- toLong(Instant, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMicrosConversion
- toLong(Instant, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimestampMillisConversion
- toLong(LocalDateTime, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMicrosConversion
- toLong(LocalDateTime, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMillisConversion
- toLong(LocalTime, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.TimeMicrosConversion
- toLong(DateTime, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.LossyTimestampMicrosConversion
- toLong(DateTime, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.TimestampConversion
- toLong(LocalTime, Schema, LogicalType) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJodaTimeConversions.LossyTimeMicrosConversion
- toResource(ValueProvider<ResourceId>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
- toResource(ValueProvider<ResourceId>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- type - Variable in class org.apache.beam.sdk.extensions.avro.io.AvroDatumFactory
- type - Variable in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.TypeWithNullability
- TypedWrite() - Constructor for class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
U
- useReflectApi() - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
-
Deprecated.kept for backward API compatibility only.
V
- validate() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
- validate(Schema) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMicros
- validate(Schema) - Method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroJavaTimeConversions.LocalTimestampMillis
- verifyDeterministic() - Method in class org.apache.beam.sdk.extensions.avro.coders.AvroCoder
W
- watchForNewFiles(Duration, Watch.Growth.TerminationCondition<String, ?>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
- watchForNewFiles(Duration, Watch.Growth.TerminationCondition<String, ?>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.
- watchForNewFiles(Duration, Watch.Growth.TerminationCondition<String, ?>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
Same as
AvroIO.Read.watchForNewFiles(Duration, TerminationCondition, boolean)withmatchUpdatedFiles=false. - watchForNewFiles(Duration, Watch.Growth.TerminationCondition<String, ?>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadAll
-
Deprecated.
- watchForNewFiles(Duration, Watch.Growth.TerminationCondition<String, ?>, boolean) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.
- watchForNewFiles(Duration, Watch.Growth.TerminationCondition<String, ?>, boolean) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
Continuously watches for new files matching the filepattern, polling it at the given interval, until the given termination condition is reached.
- withBadRecordErrorHandler(ErrorHandler<BadRecord, ?>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
See
FileIO.Write.withBadRecordErrorHandler(ErrorHandler)for details on usage. - withBeamSchemas(boolean) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
If set to true, a Beam schema will be inferred from the AVRO schema.
- withBeamSchemas(boolean) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadAll
-
Deprecated.If set to true, a Beam schema will be inferred from the AVRO schema.
- withBeamSchemas(boolean) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
-
If set to true, a Beam schema will be inferred from the AVRO schema.
- withCodec(CodecFactory) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Sink
-
Specifies to use the given
CodecFactoryfor each generated file. - withCodec(CodecFactory) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Writes to Avro file(s) compressed using specified codec.
- withCodec(CodecFactory) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withCoder(Coder<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
-
Sets a coder for the result of the parse function.
- withCoder(Coder<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.Specifies the coder for the result of the
parseFn. - withCoder(Coder<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseFiles
-
Specifies the coder for the result of the
parseFn. - withCoder(Coder<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
Sets a coder for the result of the read function.
- withCoder(Coder<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
-
Sets a coder for the result of the read function.
- withCoder(Coder<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
-
Specifies the coder for the result of the
AvroSource. - withDatumReaderFactory(AvroSource.DatumReaderFactory<?>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
-
Sets a custom
AvroSource.DatumReaderFactoryfor reading. - withDatumReaderFactory(AvroSource.DatumReaderFactory<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
Sets a custom
AvroSource.DatumReaderFactoryfor reading. - withDatumReaderFactory(AvroSource.DatumReaderFactory<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
-
Sets a custom
AvroSource.DatumReaderFactoryfor reading. - withDatumWriterFactory(AvroSink.DatumWriterFactory<ElementT>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Sink
-
Sets a custom
AvroSource.DatumReaderFactoryfor writing. - withDatumWriterFactory(AvroSink.DatumWriterFactory<OutputT>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Specifies a
AvroSink.DatumWriterFactoryto use for creatingDatumWriterinstances. - withDatumWriterFactory(AvroSink.DatumWriterFactory<T>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withDesiredBundleSizeBytes(long) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.Set a value for the bundle size for parallel reads.
- withDesiredBundleSizeBytes(long) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseFiles
-
Set a value for the bundle size for parallel reads.
- withDesiredBundleSizeBytes(long) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadAll
-
Deprecated.Set a value for the bundle size for parallel reads.
- withDesiredBundleSizeBytes(long) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
-
Set a value for the bundle size for parallel reads.
- withEmptyMatchTreatment(EmptyMatchTreatment) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
- withEmptyMatchTreatment(EmptyMatchTreatment) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.
- withEmptyMatchTreatment(EmptyMatchTreatment) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
Configures whether or not a filepattern matching no files is allowed.
- withEmptyMatchTreatment(EmptyMatchTreatment) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadAll
-
Deprecated.
- withEmptyMatchTreatment(EmptyMatchTreatment) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
- withFileExceptionHandler(ReadAllViaFileBasedSource.ReadFileRangesFnExceptionHandler) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseFiles
-
Specifies if exceptions should be logged only for streaming pipelines.
- withFileExceptionHandler(ReadAllViaFileBasedSource.ReadFileRangesFnExceptionHandler) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
-
Specifies if exceptions should be logged only for streaming pipelines.
- withFormatFunction(SerializableFunction<UserT, OutputT>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Specifies a format function to convert
AvroIO.TypedWriteto the output type. - withHintMatchesManyFiles() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
- withHintMatchesManyFiles() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
Hints that the filepattern specified in
AvroIO.Read.from(String)matches a very large number of files. - withMatchConfiguration(FileIO.MatchConfiguration) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Parse
-
Sets the
FileIO.MatchConfiguration. - withMatchConfiguration(FileIO.MatchConfiguration) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseAll
-
Deprecated.Sets the
FileIO.MatchConfiguration. - withMatchConfiguration(FileIO.MatchConfiguration) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Read
-
Sets the
FileIO.MatchConfiguration. - withMatchConfiguration(FileIO.MatchConfiguration) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadAll
-
Deprecated.Sets the
FileIO.MatchConfiguration. - withMetadata(Map<String, Object>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Sink
-
Specifies to put the given metadata into each generated file.
- withMetadata(Map<String, Object>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Writes to Avro file(s) with the specified metadata.
- withMetadata(Map<String, Object>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withMinBundleSize(long) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
-
Sets the minimum bundle size.
- withNoSpilling() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
See
WriteFiles.withNoSpilling(). - withNumShards(int) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Configures the number of output shards produced overall (when using unwindowed writes) or per-window (when using windowed writes).
- withNumShards(int) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withOutputFilenames() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
-
Specify that output filenames are wanted.
- withoutSharding() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Forces a single file as output and empty shard name template.
- withoutSharding() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withParseFn(SerializableFunction<GenericRecord, X>, Coder<X>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
-
Reads
GenericRecordof unspecified schema and maps them to instances of a custom type using the givenparseFnand encoded using the given coder. - withSchema(Class<X>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
-
Reads files containing records of the given class.
- withSchema(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
-
Reads files containing records that conform to the given schema.
- withSchema(Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Sets the output schema.
- withSchema(Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withSchema(Schema) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroSource
- withShardNameTemplate(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Uses the given
ShardNameTemplatefor naming output files. - withShardNameTemplate(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withSize(int) - Static method in class org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils.FixedBytesField
-
Create a
AvroUtils.FixedBytesFieldwith the specified size. - withSuffix(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Configures the filename suffix for written files.
- withSuffix(String) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withSyncInterval(int) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Sets the approximate number of uncompressed bytes to write in each block for the AVRO container format.
- withSyncInterval(int) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withTempDirectory(ResourceId) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Set the base directory used to generate temporary files.
- withTempDirectory(ResourceId) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withTempDirectory(ValueProvider<ResourceId>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Set the base directory used to generate temporary files.
- withTempDirectory(ValueProvider<ResourceId>) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- withUsesReshuffle(boolean) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ParseFiles
-
Specifies if a Reshuffle should run before file reads occur.
- withUsesReshuffle(boolean) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.ReadFiles
-
Specifies if a Reshuffle should run before file reads occur.
- withWindowedWrites() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.TypedWrite
-
Preserves windowing of input elements and writes them to files based on the element's window.
- withWindowedWrites() - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Write
- write(ElementT) - Method in class org.apache.beam.sdk.extensions.avro.io.AvroIO.Sink
- write(Class<T>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Writes a
PCollectionto an Avro file (or multiple Avro files matching a sharding pattern). - writeCustomType() - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Deprecated.Use
AvroIO.writeCustomType(Class)instead and provide the custom record class - writeCustomType(Class<OutputT>) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
A
PTransformthat writes aPCollectionto an avro file (or multiple avro files matching a sharding pattern), with each element of the input collection encoded into its own record of type OutputT. - writeCustomTypeToGenericRecords() - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Similar to
AvroIO.writeCustomType(), but specialized for the case where the output type isGenericRecord. - writeGenericRecords(String) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Writes Avro records of the specified schema.
- writeGenericRecords(Schema) - Static method in class org.apache.beam.sdk.extensions.avro.io.AvroIO
-
Writes Avro records of the specified schema.
All Classes All Packages