com.amazonaws.services.dynamodbv2.streamsadapter

Class DynamoDBStreamsShardSyncer

java.lang.Object

com.amazonaws.services.dynamodbv2.streamsadapter.DynamoDBStreamsShardSyncer

All Implemented Interfaces:

com.amazonaws.services.kinesis.clientlibrary.lib.worker.ShardSyncer

public class DynamoDBStreamsShardSyncer
extends java.lang.Object
implements com.amazonaws.services.kinesis.clientlibrary.lib.worker.ShardSyncer

This class has been copied from ShardSyncer in KinesisClientLibrary and edited slightly to enable DynamoDB Streams specific behavior. It is a helper class to sync leases with shards of the DynamoDB Stream. It will create new leases/activities when it discovers new DynamoDB Streams shards (bootstrap/resharding). It deletes leases for shards that have been trimmed from DynamoDB Stream. It also ensures that leases for shards that have been completely processed are not deleted until their children shards have also been completely processed.

Constructor Summary

Constructors

Constructor and Description
DynamoDBStreamsShardSyncer(com.amazonaws.services.kinesis.clientlibrary.lib.worker.LeaseCleanupValidator leaseCleanupValidator)

Method Summary

Modifier and Type

Method and Description

void

checkAndCreateLeasesForNewShards(com.amazonaws.services.kinesis.clientlibrary.proxies.IKinesisProxy kinesisProxy, com.amazonaws.services.kinesis.leases.interfaces.ILeaseManager<com.amazonaws.services.kinesis.leases.impl.KinesisClientLease> leaseManager, com.amazonaws.services.kinesis.clientlibrary.lib.worker.InitialPositionInStreamExtended initialPositionInStream, boolean cleanupLeasesOfCompletedShards, boolean ignoreUnexpectedChildShards) Check and create leases for any new shards (e.g.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.amazonaws.services.kinesis.clientlibrary.lib.worker.ShardSyncer

checkAndCreateLeasesForNewShards

Constructor Detail

DynamoDBStreamsShardSyncer

public DynamoDBStreamsShardSyncer(com.amazonaws.services.kinesis.clientlibrary.lib.worker.LeaseCleanupValidator leaseCleanupValidator)

Method Detail

checkAndCreateLeasesForNewShards

public void checkAndCreateLeasesForNewShards(com.amazonaws.services.kinesis.clientlibrary.proxies.IKinesisProxy kinesisProxy,
                                             com.amazonaws.services.kinesis.leases.interfaces.ILeaseManager<com.amazonaws.services.kinesis.leases.impl.KinesisClientLease> leaseManager,
                                             com.amazonaws.services.kinesis.clientlibrary.lib.worker.InitialPositionInStreamExtended initialPositionInStream,
                                             boolean cleanupLeasesOfCompletedShards,
                                             boolean ignoreUnexpectedChildShards)
                                      throws com.amazonaws.services.kinesis.leases.exceptions.DependencyException,
                                             com.amazonaws.services.kinesis.leases.exceptions.InvalidStateException,
                                             com.amazonaws.services.kinesis.leases.exceptions.ProvisionedThroughputException,
                                             com.amazonaws.services.kinesis.clientlibrary.exceptions.internal.KinesisClientLibIOException

Check and create leases for any new shards (e.g. following a reshard operation).

Specified by:

checkAndCreateLeasesForNewShards in interface com.amazonaws.services.kinesis.clientlibrary.lib.worker.ShardSyncer

Parameters:

kinesisProxy - Implementation of IKinesisProxy that would read from the underlying Stream

leaseManager - Performs data operations on the leases table.

initialPositionInStream - Position in Stream from which to start processing.

cleanupLeasesOfCompletedShards - Whether or not leases of completed shards should be processed for deletion from leases table. Leases for shards are deleted once their children shards have been completely processed.

ignoreUnexpectedChildShards - Ignore some consistency checks on the shard graph.

Throws:

com.amazonaws.services.kinesis.leases.exceptions.DependencyException - Thrown when one of the dependencies throws an exception

com.amazonaws.services.kinesis.leases.exceptions.InvalidStateException - Unexpected state, e.g. if the leases table does not exist.

com.amazonaws.services.kinesis.leases.exceptions.ProvisionedThroughputException - Thrown on being throttled from leases table.

com.amazonaws.services.kinesis.clientlibrary.exceptions.internal.KinesisClientLibIOException - Wrapper for various exceptions thrown from KCL