org.apache.beam.sdk.io.gcp.bigtable

Class BigtableIO.Read

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

BigtableIO

public abstract static class BigtableIO.Read
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

A PTransform that reads from Google Cloud Bigtable. See the class-level Javadoc on BigtableIO for more information.

See Also:

BigtableIO, Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor and Description
Read()

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>	expand(org.apache.beam.sdk.values.PBegin input)
@Nullable com.google.cloud.bigtable.config.BigtableOptions	getBigtableOptions() Deprecated. read options are configured directly on BigtableIO.read(). Use populateDisplayData(DisplayData.Builder) to view the current configurations.
@Nullable java.lang.String	getTableId() Returns the table being read from.
void	populateDisplayData(org.apache.beam.sdk.transforms.display.DisplayData.Builder builder)
java.lang.String	toString()
void	validate(org.apache.beam.sdk.options.PipelineOptions options)
BigtableIO.Read	withAppProfileId(java.lang.String appProfileId) Returns a new BigtableIO.Read that will read using the specified app profile id.
BigtableIO.Read	withAppProfileId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> appProfileId) Returns a new BigtableIO.Read that will read using the specified app profile id.
BigtableIO.Read	withAttemptTimeout(org.joda.time.Duration timeout) Returns a new BigtableIO.Read with the attempt timeout.
BigtableIO.Read	withBigtableOptions(com.google.cloud.bigtable.config.BigtableOptions.Builder optionsBuilder) Deprecated. please set the configurations directly: BigtableIO.read().withProjectId(projectId).withInstanceId(instanceId).withTableId(tableId) and set credentials in PipelineOptions.
BigtableIO.Read	withBigtableOptions(com.google.cloud.bigtable.config.BigtableOptions options) Deprecated. please set the configurations directly: BigtableIO.read().withProjectId(projectId).withInstanceId(instanceId).withTableId(tableId) and set credentials in PipelineOptions.
BigtableIO.Read	withBigtableOptionsConfigurator(org.apache.beam.sdk.transforms.SerializableFunction<com.google.cloud.bigtable.config.BigtableOptions.Builder,com.google.cloud.bigtable.config.BigtableOptions.Builder> configurator) Deprecated. please set the configurations directly: BigtableIO.read().withProjectId(projectId).withInstanceId(instanceId).withTableId(tableId) and set credentials in PipelineOptions.
BigtableIO.Read	withEmulator(java.lang.String emulatorHost) Returns a new BigtableIO.Read that will use an official Bigtable emulator.
BigtableIO.Read	withInstanceId(java.lang.String instanceId) Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.
BigtableIO.Read	withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> instanceId) Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.
BigtableIO.Read	withKeyRange(org.apache.beam.sdk.io.range.ByteKeyRange keyRange) Returns a new BigtableIO.Read that will read only rows in the specified range.
BigtableIO.Read	withKeyRanges(java.util.List<org.apache.beam.sdk.io.range.ByteKeyRange> keyRanges) Returns a new BigtableIO.Read that will read only rows in the specified ranges.
BigtableIO.Read	withKeyRanges(org.apache.beam.sdk.options.ValueProvider<java.util.List<org.apache.beam.sdk.io.range.ByteKeyRange>> keyRanges) Returns a new BigtableIO.Read that will read only rows in the specified ranges.
BigtableIO.Read	withMaxBufferElementCount(@Nullable java.lang.Integer maxBufferElementCount) Returns a new BigtableIO.Read that will break up read requests into smaller batches.
BigtableIO.Read	withOperationTimeout(org.joda.time.Duration timeout) Returns a new BigtableIO.Read with the operation timeout.
BigtableIO.Read	withoutValidation() Disables validation that the table being read from exists.
BigtableIO.Read	withProjectId(java.lang.String projectId) Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.
BigtableIO.Read	withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> projectId) Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.
BigtableIO.Read	withRowFilter(com.google.bigtable.v2.RowFilter filter) Returns a new BigtableIO.Read that will filter the rows read from Cloud Bigtable using the given row filter.
BigtableIO.Read	withRowFilter(org.apache.beam.sdk.options.ValueProvider<com.google.bigtable.v2.RowFilter> filter) Returns a new BigtableIO.Read that will filter the rows read from Cloud Bigtable using the given row filter.
BigtableIO.Read	withTableId(java.lang.String tableId) Returns a new BigtableIO.Read that will read from the specified table.
BigtableIO.Read	withTableId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> tableId) Returns a new BigtableIO.Read that will read from the specified table.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, setResourceHints, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Read

public Read()

Method Detail

getTableId

public @Nullable java.lang.String getTableId()

Returns the table being read from.

getBigtableOptions

@Deprecated
public @Nullable com.google.cloud.bigtable.config.BigtableOptions getBigtableOptions()

Deprecated. read options are configured directly on BigtableIO.read(). Use populateDisplayData(DisplayData.Builder) to view the current configurations.

Returns the Google Cloud Bigtable instance being read from, and other parameters.

withProjectId

public BigtableIO.Read withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> projectId)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.

Does not modify this object.

withProjectId

public BigtableIO.Read withProjectId(java.lang.String projectId)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.

Does not modify this object.

withInstanceId

public BigtableIO.Read withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> instanceId)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.

Does not modify this object.

withInstanceId

public BigtableIO.Read withInstanceId(java.lang.String instanceId)

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.

Does not modify this object.

withTableId

public BigtableIO.Read withTableId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> tableId)

Returns a new BigtableIO.Read that will read from the specified table.

Does not modify this object.

withTableId

public BigtableIO.Read withTableId(java.lang.String tableId)

Returns a new BigtableIO.Read that will read from the specified table.

Does not modify this object.

withAppProfileId

public BigtableIO.Read withAppProfileId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> appProfileId)

Returns a new BigtableIO.Read that will read using the specified app profile id.

Does not modify this object.

withAppProfileId

public BigtableIO.Read withAppProfileId(java.lang.String appProfileId)

Returns a new BigtableIO.Read that will read using the specified app profile id.

Does not modify this object.

withBigtableOptions

@Deprecated
public BigtableIO.Read withBigtableOptions(com.google.cloud.bigtable.config.BigtableOptions options)

Deprecated. please set the configurations directly: BigtableIO.read().withProjectId(projectId).withInstanceId(instanceId).withTableId(tableId) and set credentials in PipelineOptions.

WARNING: Should be used only to specify additional parameters for connection to the Cloud Bigtable, instanceId and projectId should be provided over withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) and withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) respectively.

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>), and using any other specified customizations.

Does not modify this object.

withBigtableOptions

@Deprecated
public BigtableIO.Read withBigtableOptions(com.google.cloud.bigtable.config.BigtableOptions.Builder optionsBuilder)

Deprecated. please set the configurations directly: BigtableIO.read().withProjectId(projectId).withInstanceId(instanceId).withTableId(tableId) and set credentials in PipelineOptions.

WARNING: Should be used only to specify additional parameters for connection to the Cloud Bigtable, instanceId and projectId should be provided over withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) and withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) respectively.

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by the given options, and using any other specified customizations.

Clones the given BigtableOptions builder so that any further changes will have no effect on the returned BigtableIO.Read.

Does not modify this object.

withBigtableOptionsConfigurator

@Deprecated
public BigtableIO.Read withBigtableOptionsConfigurator(org.apache.beam.sdk.transforms.SerializableFunction<com.google.cloud.bigtable.config.BigtableOptions.Builder,com.google.cloud.bigtable.config.BigtableOptions.Builder> configurator)

Deprecated. please set the configurations directly: BigtableIO.read().withProjectId(projectId).withInstanceId(instanceId).withTableId(tableId) and set credentials in PipelineOptions.

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance with customized options provided by given configurator.

WARNING: instanceId and projectId should not be provided here and should be provided over withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) and withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>).

Does not modify this object.

withRowFilter

public BigtableIO.Read withRowFilter(org.apache.beam.sdk.options.ValueProvider<com.google.bigtable.v2.RowFilter> filter)

Returns a new BigtableIO.Read that will filter the rows read from Cloud Bigtable using the given row filter.

Does not modify this object.

withRowFilter

public BigtableIO.Read withRowFilter(com.google.bigtable.v2.RowFilter filter)

Returns a new BigtableIO.Read that will filter the rows read from Cloud Bigtable using the given row filter.

Does not modify this object.

withMaxBufferElementCount

public BigtableIO.Read withMaxBufferElementCount(@Nullable java.lang.Integer maxBufferElementCount)

Returns a new BigtableIO.Read that will break up read requests into smaller batches. This function will switch the base BigtableIO.Reader class to using the SegmentReader. If null is passed, this behavior will be disabled and the stream reader will be used.

Does not modify this object.

When we have a builder, we initialize the value. When they call the method then we override the value

withKeyRange

public BigtableIO.Read withKeyRange(org.apache.beam.sdk.io.range.ByteKeyRange keyRange)

Returns a new BigtableIO.Read that will read only rows in the specified range.

Does not modify this object.

withKeyRanges

public BigtableIO.Read withKeyRanges(org.apache.beam.sdk.options.ValueProvider<java.util.List<org.apache.beam.sdk.io.range.ByteKeyRange>> keyRanges)

Returns a new BigtableIO.Read that will read only rows in the specified ranges. Ranges must not overlap.

Does not modify this object.

withKeyRanges

public BigtableIO.Read withKeyRanges(java.util.List<org.apache.beam.sdk.io.range.ByteKeyRange> keyRanges)

Returns a new BigtableIO.Read that will read only rows in the specified ranges. Ranges must not overlap.

Does not modify this object.

withoutValidation

public BigtableIO.Read withoutValidation()

Disables validation that the table being read from exists.

withEmulator

public BigtableIO.Read withEmulator(java.lang.String emulatorHost)

Returns a new BigtableIO.Read that will use an official Bigtable emulator.

This is used for testing.

withAttemptTimeout

public BigtableIO.Read withAttemptTimeout(org.joda.time.Duration timeout)

Returns a new BigtableIO.Read with the attempt timeout. Attempt timeout controls the timeout for each remote call.

Does not modify this object.

withOperationTimeout

public BigtableIO.Read withOperationTimeout(org.joda.time.Duration timeout)

Returns a new BigtableIO.Read with the operation timeout. Operation timeout has ultimate control over how long the logic should keep trying the remote call until it gives up completely.

Does not modify this object.

expand

public org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row> expand(org.apache.beam.sdk.values.PBegin input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

validate

public void validate(org.apache.beam.sdk.options.PipelineOptions options)

Overrides:

validate in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

populateDisplayData

public void populateDisplayData(org.apache.beam.sdk.transforms.display.DisplayData.Builder builder)

Specified by:

populateDisplayData in interface org.apache.beam.sdk.transforms.display.HasDisplayData

Overrides:

populateDisplayData in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>

toString

public final java.lang.String toString()

Overrides:

toString in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>>