org.apache.beam.sdk.io.gcp.bigquery

Class StreamingInserts<DestinationT>

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<PCollection<KV<DestinationT,com.google.api.services.bigquery.model.TableRow>>,WriteResult>

org.apache.beam.sdk.io.gcp.bigquery.StreamingInserts<DestinationT>

All Implemented Interfaces:

Serializable, HasDisplayData

public class StreamingInserts<DestinationT>
extends PTransform<PCollection<KV<DestinationT,com.google.api.services.bigquery.model.TableRow>>,WriteResult>

PTransform that performs streaming BigQuery write. To increase consistency, it leverages BigQuery's best effort de-dup mechanism.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name

Constructor Summary

Constructors

Constructor and Description
StreamingInserts(BigQueryIO.Write.CreateDisposition createDisposition, DynamicDestinations<?,DestinationT> dynamicDestinations) Constructor.

Method Summary

Modifier and Type	Method and Description
WriteResult	expand(PCollection<KV<DestinationT,com.google.api.services.bigquery.model.TableRow>> input)
StreamingInserts<DestinationT>	withInsertRetryPolicy(InsertRetryPolicy retryPolicy) Specify a retry policy for failed inserts.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, populateDisplayData, toString, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

StreamingInserts

public StreamingInserts(BigQueryIO.Write.CreateDisposition createDisposition,
                        DynamicDestinations<?,DestinationT> dynamicDestinations)

Constructor.

Method Detail

withInsertRetryPolicy

public StreamingInserts<DestinationT> withInsertRetryPolicy(InsertRetryPolicy retryPolicy)

Specify a retry policy for failed inserts.

expand

public WriteResult expand(PCollection<KV<DestinationT,com.google.api.services.bigquery.model.TableRow>> input)

Specified by:

expand in class PTransform<PCollection<KV<DestinationT,com.google.api.services.bigquery.model.TableRow>>,WriteResult>