Skip navigation links
A B C D E F G I M O P R S W 

A

AttributeValueCoder - Class in org.apache.beam.sdk.io.aws.dynamodb
A Coder that serializes and deserializes the AttributeValue objects.
AttributeValueCoderProviderRegistrar - Class in org.apache.beam.sdk.io.aws.dynamodb
A CoderProviderRegistrar for standard types used with DynamoDBIO.
AttributeValueCoderProviderRegistrar() - Constructor for class org.apache.beam.sdk.io.aws.dynamodb.AttributeValueCoderProviderRegistrar
 
AwsClientsProvider - Interface in org.apache.beam.sdk.io.aws.dynamodb
Provides instances of AWS clients.
AwsClientsProvider - Interface in org.apache.beam.sdk.io.aws.sns
Provides instances of AWS clients.
AwsCoders - Class in org.apache.beam.sdk.io.aws.coders
Coders for common AWS SDK objects.
AwsModule - Class in org.apache.beam.sdk.io.aws.options
A Jackson Module that registers a JsonSerializer and JsonDeserializer for AWSCredentialsProvider and some subclasses.
AwsModule() - Constructor for class org.apache.beam.sdk.io.aws.options.AwsModule
 
AwsOptions - Interface in org.apache.beam.sdk.io.aws.options
Options used to configure Amazon Web Services specific options such as credentials and region.
AwsOptions.AwsUserCredentialsFactory - Class in org.apache.beam.sdk.io.aws.options
Attempts to load AWS credentials.
AwsOptions.ClientConfigurationFactory - Class in org.apache.beam.sdk.io.aws.options
Default AWS client configuration.
AwsPipelineOptionsRegistrar - Class in org.apache.beam.sdk.io.aws.options
A registrar containing the default AWS options.
AwsPipelineOptionsRegistrar() - Constructor for class org.apache.beam.sdk.io.aws.options.AwsPipelineOptionsRegistrar
 
AwsUserCredentialsFactory() - Constructor for class org.apache.beam.sdk.io.aws.options.AwsOptions.AwsUserCredentialsFactory
 

B

BasicDynamoDBProvider - Class in org.apache.beam.sdk.io.aws.dynamodb
Basic implementation of AwsClientsProvider used by default in DynamoDBIO.

C

CLIENT_EXECUTION_TIMEOUT - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
ClientConfigurationFactory() - Constructor for class org.apache.beam.sdk.io.aws.options.AwsOptions.ClientConfigurationFactory
 
CONNECTION_MAX_IDLE_TIME - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
CONNECTION_TIME_TO_LIVE - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
CONNECTION_TIMEOUT - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
create(int, Duration) - Static method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.RetryConfiguration
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws.options.AwsOptions.AwsUserCredentialsFactory
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws.options.AwsOptions.ClientConfigurationFactory
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws.options.S3Options.S3UploadBufferSizeBytesFactory
 
create(int, Duration) - Static method in class org.apache.beam.sdk.io.aws.sns.SnsIO.RetryConfiguration
 
createBuilder(S3Options) - Method in interface org.apache.beam.sdk.io.aws.options.S3ClientBuilderFactory
 
createBuilder(S3Options) - Method in class org.apache.beam.sdk.io.aws.s3.DefaultS3ClientBuilderFactory
 
createDynamoDB() - Method in interface org.apache.beam.sdk.io.aws.dynamodb.AwsClientsProvider
 
createDynamoDB() - Method in class org.apache.beam.sdk.io.aws.dynamodb.BasicDynamoDBProvider
 
createSnsPublisher() - Method in interface org.apache.beam.sdk.io.aws.sns.AwsClientsProvider
 

D

decode(InputStream) - Method in class org.apache.beam.sdk.io.aws.dynamodb.AttributeValueCoder
 
defaultPublishResult() - Static method in class org.apache.beam.sdk.io.aws.sns.PublishResultCoders
Returns a new PublishResult coder which by default serializes only the messageId.
DefaultS3ClientBuilderFactory - Class in org.apache.beam.sdk.io.aws.s3
Construct AmazonS3ClientBuilder with default values of S3 client properties like path style access, accelerated mode, etc.
DefaultS3ClientBuilderFactory() - Constructor for class org.apache.beam.sdk.io.aws.s3.DefaultS3ClientBuilderFactory
 
DynamoDBIO - Class in org.apache.beam.sdk.io.aws.dynamodb
PTransforms to read/write from/to Amazon DynamoDB.
DynamoDBIO() - Constructor for class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO
 
DynamoDBIO.Read<T> - Class in org.apache.beam.sdk.io.aws.dynamodb
Read data from DynamoDB and return ScanResult.
DynamoDBIO.RetryConfiguration - Class in org.apache.beam.sdk.io.aws.dynamodb
A POJO encapsulating a configuration for retry behavior when issuing requests to DynamoDB.
DynamoDBIO.Write<T> - Class in org.apache.beam.sdk.io.aws.dynamodb
Write a PCollection data into DynamoDB.

E

encode(AttributeValue, OutputStream) - Method in class org.apache.beam.sdk.io.aws.dynamodb.AttributeValueCoder
 
expand(PBegin) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
 
expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Write
 
expand(PCollection<PublishRequest>) - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
 
expand(PBegin) - Method in class org.apache.beam.sdk.io.aws.sqs.SqsIO.Read
 
expand(PCollection<SendMessageRequest>) - Method in class org.apache.beam.sdk.io.aws.sqs.SqsIO.Write
 

F

fromOptions(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws.s3.S3FileSystemRegistrar
 
fullPublishResult() - Static method in class org.apache.beam.sdk.io.aws.sns.PublishResultCoders
Returns a new PublishResult coder which serializes the sdkResponseMetadata and sdkHttpMetadata, including the HTTP response headers.
fullPublishResultWithoutHeaders() - Static method in class org.apache.beam.sdk.io.aws.sns.PublishResultCoders
Returns a new PublishResult coder which serializes the sdkResponseMetadata and sdkHttpMetadata, but does not include the HTTP response headers.

G

getAwsCredentialsProvider() - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
The credential instance that should be used to authenticate against AWS services.
getAwsHttpClientConfiguration() - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
The client configuration instance that should be used to configure AWS service clients.
getAwsRegion() - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
AWS region used by the AWS client.
getAwsServiceEndpoint() - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
The AWS service endpoint used by the AWS client.
getClientConfiguration() - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
The client configuration instance that should be used to configure AWS service clients.
getCloudWatchClient() - Method in interface org.apache.beam.sdk.io.aws.dynamodb.AwsClientsProvider
 
getCloudWatchClient() - Method in class org.apache.beam.sdk.io.aws.dynamodb.BasicDynamoDBProvider
 
getCloudWatchClient() - Method in interface org.apache.beam.sdk.io.aws.sns.AwsClientsProvider
 
getCoderProviders() - Method in class org.apache.beam.sdk.io.aws.dynamodb.AttributeValueCoderProviderRegistrar
 
getCoderProviders() - Method in class org.apache.beam.sdk.io.aws.sns.SnsCoderProviderRegistrar
 
getPipelineOptions() - Method in class org.apache.beam.sdk.io.aws.options.AwsPipelineOptionsRegistrar
 
getS3ClientFactoryClass() - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
getS3StorageClass() - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
getS3ThreadPoolSize() - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
getS3UploadBufferSizeBytes() - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
getSSEAlgorithm() - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
getSSEAwsKeyManagementParams() - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
getSSECustomerKey() - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 

I

items() - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
 

M

MAX_CONNECTIONS - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
MINIMUM_UPLOAD_BUFFER_SIZE_BYTES - Static variable in class org.apache.beam.sdk.io.aws.options.S3Options.S3UploadBufferSizeBytesFactory
 

O

of() - Static method in class org.apache.beam.sdk.io.aws.dynamodb.AttributeValueCoder
 
org.apache.beam.sdk.io.aws.coders - package org.apache.beam.sdk.io.aws.coders
Defines common coders for Amazon Web Services.
org.apache.beam.sdk.io.aws.dynamodb - package org.apache.beam.sdk.io.aws.dynamodb
Defines IO connectors for Amazon Web Services DynamoDB.
org.apache.beam.sdk.io.aws.options - package org.apache.beam.sdk.io.aws.options
Defines PipelineOptions for configuring pipeline execution for Amazon Web Services components.
org.apache.beam.sdk.io.aws.s3 - package org.apache.beam.sdk.io.aws.s3
Defines IO connectors for Amazon Web Services S3.
org.apache.beam.sdk.io.aws.sns - package org.apache.beam.sdk.io.aws.sns
Defines IO connectors for Amazon Web Services SNS.
org.apache.beam.sdk.io.aws.sqs - package org.apache.beam.sdk.io.aws.sqs
Defines IO connectors for Amazon Web Services SQS.

P

PROXY_HOST - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
PROXY_PASSWORD - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
PROXY_PORT - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
PROXY_USERNAME - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
PublishResultCoders - Class in org.apache.beam.sdk.io.aws.sns
Coders for SNS PublishResult.

R

read() - Static method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO
 
Read() - Constructor for class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
 
read() - Static method in class org.apache.beam.sdk.io.aws.sqs.SqsIO
 
Read() - Constructor for class org.apache.beam.sdk.io.aws.sqs.SqsIO.Read
 
REQUEST_TIMEOUT - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
responseMetadata() - Static method in class org.apache.beam.sdk.io.aws.coders.AwsCoders
Returns a new coder for ResponseMetadata.
RetryConfiguration() - Constructor for class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.RetryConfiguration
 
RetryConfiguration() - Constructor for class org.apache.beam.sdk.io.aws.sns.SnsIO.RetryConfiguration
 

S

S3ClientBuilderFactory - Interface in org.apache.beam.sdk.io.aws.options
Construct AmazonS3ClientBuilder from S3 pipeline options.
S3FileSystemRegistrar - Class in org.apache.beam.sdk.io.aws.s3
AutoService registrar for the S3FileSystem.
S3FileSystemRegistrar() - Constructor for class org.apache.beam.sdk.io.aws.s3.S3FileSystemRegistrar
 
S3Options - Interface in org.apache.beam.sdk.io.aws.options
Options used to configure Amazon Web Services S3.
S3Options.S3UploadBufferSizeBytesFactory - Class in org.apache.beam.sdk.io.aws.options
Provide the default s3 upload buffer size in bytes: 64MB if more than 512MB in RAM are available and 5MB otherwise.
S3UploadBufferSizeBytesFactory() - Constructor for class org.apache.beam.sdk.io.aws.options.S3Options.S3UploadBufferSizeBytesFactory
 
sdkHttpMetadata() - Static method in class org.apache.beam.sdk.io.aws.coders.AwsCoders
Returns a new coder for SdkHttpMetadata.
sdkHttpMetadataWithoutHeaders() - Static method in class org.apache.beam.sdk.io.aws.coders.AwsCoders
Returns a new coder for SdkHttpMetadata that does not serialize the response headers.
setAwsCredentialsProvider(AWSCredentialsProvider) - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
 
setAwsHttpClientConfiguration(ClientConfiguration) - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
 
setAwsRegion(String) - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
 
setAwsServiceEndpoint(String) - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
 
setClientConfiguration(ClientConfiguration) - Method in interface org.apache.beam.sdk.io.aws.options.AwsOptions
 
setS3ClientFactoryClass(Class<? extends S3ClientBuilderFactory>) - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
setS3StorageClass(String) - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
setS3ThreadPoolSize(int) - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
setS3UploadBufferSizeBytes(Integer) - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
setSSEAlgorithm(String) - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
setSSEAwsKeyManagementParams(SSEAwsKeyManagementParams) - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
setSSECustomerKey(SSECustomerKey) - Method in interface org.apache.beam.sdk.io.aws.options.S3Options
 
SnsCoderProviderRegistrar - Class in org.apache.beam.sdk.io.aws.sns
A CoderProviderRegistrar for standard types used with SnsIO.
SnsCoderProviderRegistrar() - Constructor for class org.apache.beam.sdk.io.aws.sns.SnsCoderProviderRegistrar
 
SnsIO - Class in org.apache.beam.sdk.io.aws.sns
PTransforms for writing to SNS.
SnsIO() - Constructor for class org.apache.beam.sdk.io.aws.sns.SnsIO
 
SnsIO.RetryConfiguration - Class in org.apache.beam.sdk.io.aws.sns
A POJO encapsulating a configuration for retry behavior when issuing requests to SNS.
SnsIO.Write - Class in org.apache.beam.sdk.io.aws.sns
Implementation of SnsIO.write().
SOCKET_TIMEOUT - Static variable in class org.apache.beam.sdk.io.aws.options.AwsModule
 
SqsIO - Class in org.apache.beam.sdk.io.aws.sqs
An unbounded source for Amazon Simple Queue Service (SQS).
SqsIO.Read - Class in org.apache.beam.sdk.io.aws.sqs
A PTransform to read/receive messages from SQS.
SqsIO.Write - Class in org.apache.beam.sdk.io.aws.sqs
A PTransform to send messages to SQS.

W

withAwsClientsProvider(AwsClientsProvider) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
 
withAwsClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
 
withAwsClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
 
withAwsClientsProvider(AwsClientsProvider) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Write
 
withAwsClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Write
 
withAwsClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Write
 
withAWSClientsProvider(AwsClientsProvider) - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Allows to specify custom AwsClientsProvider.
withAWSClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Specify credential details and region to be used to write to SNS.
withAWSClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Specify credential details and region to be used to write to SNS.
withCoder(Coder<T>) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
 
withCoder(Coder<PublishResult>) - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Encode the PublishResult with the given coder.
withDeduplicateKeys(List<String>) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Write
 
withFullPublishResult() - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Encode the full PublishResult object, including sdkResponseMetadata and sdkHttpMetadata with the HTTP response headers.
withFullPublishResultWithoutHeaders() - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Encode the full PublishResult object, including sdkResponseMetadata and sdkHttpMetadata but excluding the HTTP response headers.
withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.aws.sqs.SqsIO.Read
Define the max number of records received by the SqsIO.Read.
withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.aws.sqs.SqsIO.Read
Define the max read time (duration) while the SqsIO.Read will receive messages.
withQueueUrl(String) - Method in class org.apache.beam.sdk.io.aws.sqs.SqsIO.Read
Define the queueUrl used by the SqsIO.Read to receive messages from SQS.
withResultOutputTag(TupleTag<PublishResult>) - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Tuple tag to store results.
withRetryConfiguration(DynamoDBIO.RetryConfiguration) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Write
Provides configuration to retry a failed request to publish a set of records to DynamoDB.
withRetryConfiguration(SnsIO.RetryConfiguration) - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Provides configuration to retry a failed request to publish a message to SNS.
withScanRequestFn(SerializableFunction<Void, ScanRequest>) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
Can't pass ScanRequest object directly from client since this object is not full serializable.
withScanResultMapperFn(SerializableFunction<ScanResult, T>) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Read
 
withTopicName(String) - Method in class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
Specify the SNS topic which will be used for writing, this name is mandatory.
withWriteRequestMapperFn(SerializableFunction<T, KV<String, WriteRequest>>) - Method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Write
 
write() - Static method in class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO
 
Write() - Constructor for class org.apache.beam.sdk.io.aws.dynamodb.DynamoDBIO.Write
 
write() - Static method in class org.apache.beam.sdk.io.aws.sns.SnsIO
 
Write() - Constructor for class org.apache.beam.sdk.io.aws.sns.SnsIO.Write
 
write() - Static method in class org.apache.beam.sdk.io.aws.sqs.SqsIO
 
Write() - Constructor for class org.apache.beam.sdk.io.aws.sqs.SqsIO.Write
 
A B C D E F G I M O P R S W 
Skip navigation links