org.apache.flink.streaming.connectors.kinesis

Class FlinkDynamoDBStreamsConsumer<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichParallelSourceFunction<T>

org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer<T>

org.apache.flink.streaming.connectors.kinesis.FlinkDynamoDBStreamsConsumer<T>

Type Parameters:

T - the type of data emitted

All Implemented Interfaces:

Serializable, Function, RichFunction, ResultTypeQueryable<T>, CheckpointedFunction, ParallelSourceFunction<T>, SourceFunction<T>

public class FlinkDynamoDBStreamsConsumer<T>
extends FlinkKinesisConsumer<T>

Consume events from DynamoDB streams.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

SourceFunction.SourceContext<T>

Constructor Summary

Constructors

Constructor and Description
FlinkDynamoDBStreamsConsumer(List<String> streams, KinesisDeserializationSchema deserializer, Properties config) Constructor of FlinkDynamodbStreamConsumer.
FlinkDynamoDBStreamsConsumer(String stream, DeserializationSchema<T> deserializer, Properties config) Constructor of FlinkDynamoDBStreamsConsumer.

Method Summary

Modifier and Type	Method and Description
protected KinesisDataFetcher<T>	createFetcher(List<String> streams, SourceFunction.SourceContext<T> sourceContext, RuntimeContext runtimeContext, Properties configProps, KinesisDeserializationSchema<T> deserializationSchema) This method is exposed for tests that need to mock the KinesisDataFetcher in the consumer.

Methods inherited from class org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer

cancel, close, getPeriodicWatermarkAssigner, getProducedType, getShardAssigner, getWatermarkTracker, initializeState, run, setPeriodicWatermarkAssigner, setShardAssigner, setWatermarkTracker, snapshotState

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkDynamoDBStreamsConsumer

public FlinkDynamoDBStreamsConsumer(String stream,
                                    DeserializationSchema<T> deserializer,
                                    Properties config)

Constructor of FlinkDynamoDBStreamsConsumer.

Parameters:

stream - stream to consume

deserializer - deserialization schema

config - config properties

FlinkDynamoDBStreamsConsumer

public FlinkDynamoDBStreamsConsumer(List<String> streams,
                                    KinesisDeserializationSchema deserializer,
                                    Properties config)

Constructor of FlinkDynamodbStreamConsumer.

Parameters:

streams - list of streams to consume

deserializer - deserialization schema

config - config properties

Method Detail

createFetcher

protected KinesisDataFetcher<T> createFetcher(List<String> streams,
                                              SourceFunction.SourceContext<T> sourceContext,
                                              RuntimeContext runtimeContext,
                                              Properties configProps,
                                              KinesisDeserializationSchema<T> deserializationSchema)

Description copied from class: FlinkKinesisConsumer

This method is exposed for tests that need to mock the KinesisDataFetcher in the consumer.

Overrides:

createFetcher in class FlinkKinesisConsumer<T>