org.apache.beam.sdk.io.gcp.pubsub

Class PubsubIO.Write<T>

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<PCollection<T>,PDone>

org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write<T>

All Implemented Interfaces:

Serializable, HasDisplayData

Enclosing class:

PubsubIO

public abstract static class PubsubIO.Write<T>
extends PTransform<PCollection<T>,PDone>

Implementation of PubsubIO.write().

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	PubsubIO.Write.PubsubBoundedWriter Writer to Pubsub which batches messages from bounded collections.

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name

Constructor Summary

Constructors

Constructor and Description
Write()

Method Summary

Modifier and Type	Method and Description
PDone	expand(PCollection<T> input)
void	populateDisplayData(DisplayData.Builder builder)
PubsubIO.Write<T>	to(String topic) Publishes to the specified topic.
PubsubIO.Write<T>	to(ValueProvider<String> topic) Like topic() but with a ValueProvider.
PubsubIO.Write<T>	withIdAttribute(String idAttribute) Writes to Pub/Sub, adding each record's unique identifier to the published messages in an attribute with the specified name.
PubsubIO.Write<T>	withTimestampAttribute(String timestampAttribute) Writes to Pub/Sub and adds each record's timestamp to the published messages in an attribute with the specified name.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, toString, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Write

public Write()

Method Detail

to

public PubsubIO.Write<T> to(String topic)

Publishes to the specified topic.

See PubsubIO.PubsubTopic.fromPath(String) for more details on the format of the topic string.

to

public PubsubIO.Write<T> to(ValueProvider<String> topic)

Like topic() but with a ValueProvider.

withTimestampAttribute

public PubsubIO.Write<T> withTimestampAttribute(String timestampAttribute)

Writes to Pub/Sub and adds each record's timestamp to the published messages in an attribute with the specified name. The value of the attribute will be a number representing the number of milliseconds since the Unix epoch. For example, if using the Joda time classes, Instant.Instant(long) can be used to parse this value.

If the output from this sink is being read by another Beam pipeline, then PubsubIO.Read.withTimestampAttribute(String) can be used to ensure the other source reads these timestamps from the appropriate attribute.

withIdAttribute

public PubsubIO.Write<T> withIdAttribute(String idAttribute)

Writes to Pub/Sub, adding each record's unique identifier to the published messages in an attribute with the specified name. The value of the attribute is an opaque string.

If the the output from this sink is being read by another Beam pipeline, then PubsubIO.Read.withIdAttribute(String) can be used to ensure that* the other source reads these unique identifiers from the appropriate attribute.

expand

public PDone expand(PCollection<T> input)

Specified by:

expand in class PTransform<PCollection<T>,PDone>

populateDisplayData

public void populateDisplayData(DisplayData.Builder builder)

Specified by:

populateDisplayData in interface HasDisplayData

Overrides:

populateDisplayData in class PTransform<PCollection<T>,PDone>