T
- type of fetched data.public class DynamoDBStreamsDataFetcher<T> extends KinesisDataFetcher<T>
KinesisDataFetcher.FlinkKinesisProxyFactory, KinesisDataFetcher.FlinkKinesisProxyV2Factory
DEFAULT_SHARD_ASSIGNER
Constructor and Description |
---|
DynamoDBStreamsDataFetcher(List<String> streams,
SourceFunction.SourceContext<T> sourceContext,
RuntimeContext runtimeContext,
Properties configProps,
KinesisDeserializationSchema<T> deserializationSchema,
KinesisShardAssigner shardAssigner)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
protected RecordPublisher |
createRecordPublisher(SequenceNumber sequenceNumber,
Properties configProps,
MetricGroup metricGroup,
StreamShardHandle subscribedShard) |
protected boolean |
shouldAdvanceLastDiscoveredShardId(String shardId,
String lastSeenShardIdOfStream)
Given lastSeenShardId, check if last discovered shardId should be advanced.
|
advanceLastDiscoveredShardOfStream, awaitTermination, closeRecordPublisherFactory, convertToStreamShardHandle, convertToStreamShardMetadata, createInitialSubscribedStreamsToLastDiscoveredShardsState, createRecordPublisherFactory, createShardConsumer, createShardConsumersThreadPool, deregisterStreamConsumer, discoverNewShardsToSubscribe, emitRecordAndUpdateState, emitWatermark, getConsumerConfiguration, getCurrentTimeMillis, getSubscribedShardsState, isThisSubtaskShouldSubscribeTo, registerNewSubscribedShardState, runFetcher, shutdownFetcher, snapshotState, stopWithError, updateState
public DynamoDBStreamsDataFetcher(List<String> streams, SourceFunction.SourceContext<T> sourceContext, RuntimeContext runtimeContext, Properties configProps, KinesisDeserializationSchema<T> deserializationSchema, KinesisShardAssigner shardAssigner)
streams
- list of streams to fetch datasourceContext
- source contextruntimeContext
- runtime contextconfigProps
- config propertiesdeserializationSchema
- deserialization schemashardAssigner
- shard assignerprotected boolean shouldAdvanceLastDiscoveredShardId(String shardId, String lastSeenShardIdOfStream)
KinesisDataFetcher
shouldAdvanceLastDiscoveredShardId
in class KinesisDataFetcher<T>
protected RecordPublisher createRecordPublisher(SequenceNumber sequenceNumber, Properties configProps, MetricGroup metricGroup, StreamShardHandle subscribedShard) throws InterruptedException
createRecordPublisher
in class KinesisDataFetcher<T>
InterruptedException
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.