org.apache.flink.streaming.connectors.kinesis.proxy

Class DynamoDBStreamsProxy

java.lang.Object

org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy

org.apache.flink.streaming.connectors.kinesis.proxy.DynamoDBStreamsProxy

All Implemented Interfaces:

KinesisProxyInterface

public class DynamoDBStreamsProxy
extends KinesisProxy

DynamoDB streams proxy: interface interacting with the DynamoDB streams.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	DynamoDBStreamsProxy(Properties configProps)

Method Summary

Modifier and Type	Method and Description
static KinesisProxyInterface	create(Properties configProps) Creates a DynamoDB streams proxy.
protected com.amazonaws.services.kinesis.AmazonKinesis	createKinesisClient(Properties configProps) Creates an AmazonDynamoDBStreamsAdapterClient.
GetShardListResult	getShardList(Map<String,String> streamNamesWithLastSeenShardIds) Get shard list of multiple Kinesis streams, ignoring the shards of each stream before a specified last seen shard id.

Methods inherited from class org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy

describeStream, fullJitterBackoff, getRecords, getShardIterator, isRecoverableException, isRecoverableSdkClientException

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DynamoDBStreamsProxy

protected DynamoDBStreamsProxy(Properties configProps)

Method Detail

create

public static KinesisProxyInterface create(Properties configProps)

Creates a DynamoDB streams proxy.

Parameters:

configProps - configuration properties

Returns:

the created DynamoDB streams proxy

createKinesisClient

protected com.amazonaws.services.kinesis.AmazonKinesis createKinesisClient(Properties configProps)

Creates an AmazonDynamoDBStreamsAdapterClient. Uses it as the internal client interacting with the DynamoDB streams.

Overrides:

createKinesisClient in class KinesisProxy

Parameters:

configProps - configuration properties

Returns:

an AWS DynamoDB streams adapter client

getShardList

public GetShardListResult getShardList(Map<String,String> streamNamesWithLastSeenShardIds)
                                throws InterruptedException

Description copied from class: KinesisProxy

Get shard list of multiple Kinesis streams, ignoring the shards of each stream before a specified last seen shard id.

Specified by:

getShardList in interface KinesisProxyInterface

Overrides:

getShardList in class KinesisProxy

Parameters:

streamNamesWithLastSeenShardIds - a map with stream as key, and last seen shard id as value

Returns:

result of the shard list query

Throws:

InterruptedException - this method will retry with backoff if AWS Kinesis complains that the operation has exceeded the rate limit; this exception will be thrown if the backoff is interrupted.