org.apache.beam.sdk.io.gcp.bigtable

Class BigtableIO.Read

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

BigtableIO

@Experimental(value=SOURCE_SINK)
public abstract static class BigtableIO.Read
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

A PTransform that reads from Google Cloud Bigtable. See the class-level Javadoc on BigtableIO for more information.

See Also:

BigtableIO, Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name

Constructor Summary

Constructors

Constructor and Description
Read()

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>	expand(org.apache.beam.sdk.values.PBegin input)
com.google.cloud.bigtable.config.BigtableOptions	getBigtableOptions() Deprecated. will be replaced by bigtable options configurator.
abstract java.util.List<org.apache.beam.sdk.io.range.ByteKeyRange>	getKeyRanges() Returns the range of keys that will be read from the table.
java.lang.String	getTableId() Returns the table being read from.
void	populateDisplayData(org.apache.beam.sdk.transforms.display.DisplayData.Builder builder)
java.lang.String	toString()
void	validate(org.apache.beam.sdk.options.PipelineOptions options)
BigtableIO.Read	withBigtableOptions(com.google.cloud.bigtable.config.BigtableOptions.Builder optionsBuilder) Deprecated. will be replaced by bigtable options configurator.
BigtableIO.Read	withBigtableOptions(com.google.cloud.bigtable.config.BigtableOptions options) Deprecated. will be replaced by bigtable options configurator.
BigtableIO.Read	withBigtableOptionsConfigurator(org.apache.beam.sdk.transforms.SerializableFunction<com.google.cloud.bigtable.config.BigtableOptions.Builder,com.google.cloud.bigtable.config.BigtableOptions.Builder> configurator) Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance with customized options provided by given configurator.
BigtableIO.Read	withInstanceId(java.lang.String instanceId) Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.
BigtableIO.Read	withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> instanceId) Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.
BigtableIO.Read	withKeyRange(org.apache.beam.sdk.io.range.ByteKeyRange keyRange) Returns a new BigtableIO.Read that will read only rows in the specified range.
BigtableIO.Read	withKeyRanges(java.util.List<org.apache.beam.sdk.io.range.ByteKeyRange> keyRanges) Returns a new BigtableIO.Read that will read only rows in the specified ranges.
BigtableIO.Read	withoutValidation() Disables validation that the table being read from exists.
BigtableIO.Read	withProjectId(java.lang.String projectId) Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.
BigtableIO.Read	withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> projectId) Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.
BigtableIO.Read	withRowFilter(com.google.bigtable.v2.RowFilter filter) Returns a new BigtableIO.Read that will filter the rows read from Cloud Bigtable using the given row filter.
BigtableIO.Read	withTableId(java.lang.String tableId) Returns a new BigtableIO.Read that will read from the specified table.
BigtableIO.Read	withTableId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> tableId) Returns a new BigtableIO.Read that will read from the specified table.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Read

public Read()

Method Detail

getKeyRanges

@Nullable
public abstract java.util.List<org.apache.beam.sdk.io.range.ByteKeyRange> getKeyRanges()

Returns the range of keys that will be read from the table.

getTableId

@Nullable
public java.lang.String getTableId()

Returns the table being read from.

getBigtableOptions

@Deprecated
 @Nullable
public com.google.cloud.bigtable.config.BigtableOptions getBigtableOptions()

Deprecated. will be replaced by bigtable options configurator.

Returns the Google Cloud Bigtable instance being read from, and other parameters.

withProjectId

public BigtableIO.Read withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> projectId)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.

Does not modify this object.

withProjectId

public BigtableIO.Read withProjectId(java.lang.String projectId)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.

Does not modify this object.

withInstanceId

public BigtableIO.Read withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> instanceId)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.

Does not modify this object.

withInstanceId

public BigtableIO.Read withInstanceId(java.lang.String instanceId)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.

Does not modify this object.

withTableId

public BigtableIO.Read withTableId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> tableId)

Returns a new BigtableIO.Read that will read from the specified table.

Does not modify this object.

withTableId

public BigtableIO.Read withTableId(java.lang.String tableId)

Returns a new BigtableIO.Read that will read from the specified table.

Does not modify this object.

withBigtableOptions

@Deprecated
public BigtableIO.Read withBigtableOptions(com.google.cloud.bigtable.config.BigtableOptions options)

Deprecated. will be replaced by bigtable options configurator.

WARNING: Should be used only to specify additional parameters for connection to the Cloud Bigtable, instanceId and projectId should be provided over withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) and withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) respectively.

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>), and using any other specified customizations.

Does not modify this object.

withBigtableOptions

@Deprecated
public BigtableIO.Read withBigtableOptions(com.google.cloud.bigtable.config.BigtableOptions.Builder optionsBuilder)

Deprecated. will be replaced by bigtable options configurator.

WARNING: Should be used only to specify additional parameters for connection to the Cloud Bigtable, instanceId and projectId should be provided over withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) and withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) respectively.

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by the given options, and using any other specified customizations.

Clones the given BigtableOptions builder so that any further changes will have no effect on the returned BigtableIO.Read.

Does not modify this object.

withBigtableOptionsConfigurator

public BigtableIO.Read withBigtableOptionsConfigurator(org.apache.beam.sdk.transforms.SerializableFunction<com.google.cloud.bigtable.config.BigtableOptions.Builder,com.google.cloud.bigtable.config.BigtableOptions.Builder> configurator)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance with customized options provided by given configurator.

WARNING: instanceId and projectId should not be provided here and should be provided over withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) and withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>).

Does not modify this object.

withRowFilter

public BigtableIO.Read withRowFilter(com.google.bigtable.v2.RowFilter filter)

Returns a new BigtableIO.Read that will filter the rows read from Cloud Bigtable using the given row filter.

Does not modify this object.

withKeyRange

public BigtableIO.Read withKeyRange(org.apache.beam.sdk.io.range.ByteKeyRange keyRange)

Returns a new BigtableIO.Read that will read only rows in the specified range.

Does not modify this object.

withKeyRanges

public BigtableIO.Read withKeyRanges(java.util.List<org.apache.beam.sdk.io.range.ByteKeyRange> keyRanges)

Returns a new BigtableIO.Read that will read only rows in the specified ranges. Ranges must not overlap.

Does not modify this object.

withoutValidation

public BigtableIO.Read withoutValidation()

Disables validation that the table being read from exists.

expand

public org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row> expand(org.apache.beam.sdk.values.PBegin input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

validate

public void validate(org.apache.beam.sdk.options.PipelineOptions options)

Overrides:

validate in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

populateDisplayData

public void populateDisplayData(org.apache.beam.sdk.transforms.display.DisplayData.Builder builder)

Specified by:

populateDisplayData in interface org.apache.beam.sdk.transforms.display.HasDisplayData

Overrides:

populateDisplayData in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

toString

public java.lang.String toString()

Overrides:

toString in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>