org.apache.beam.sdk.io.gcp.bigquery

Class StreamingWriteTables

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<TableDestination,com.google.api.services.bigquery.model.TableRow>>,WriteResult>

org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteTables

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class StreamingWriteTables
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<TableDestination,com.google.api.services.bigquery.model.TableRow>>,WriteResult>

This transform takes in key-value pairs of TableRow entries and the TableDestination it should be written to. The BigQuery streaming-write service is used to stream these writes to the appropriate table.

This transform assumes that all destination tables already exist by the time it sees a write for that table.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name

Constructor Summary

Constructors

Constructor and Description
StreamingWriteTables()

Method Summary

Modifier and Type	Method and Description
WriteResult	expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<TableDestination,com.google.api.services.bigquery.model.TableRow>> input)

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, populateDisplayData, toString, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

StreamingWriteTables

public StreamingWriteTables()

Method Detail

expand

public WriteResult expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<TableDestination,com.google.api.services.bigquery.model.TableRow>> input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<TableDestination,com.google.api.services.bigquery.model.TableRow>>,WriteResult>