Package | Description |
---|---|
org.apache.flink.streaming.connectors.kafka.internals |
Modifier and Type | Class and Description |
---|---|
class |
KafkaTopicPartitionStateWithWatermarkGenerator<T,KPH>
A special version of the per-kafka-partition-state that additionally holds a
TimestampAssigner , WatermarkGenerator , an immediate WatermarkOutput , and a
deferred WatermarkOutput for this partition. |
Modifier and Type | Field and Description |
---|---|
protected ClosableBlockingQueue<KafkaTopicPartitionState<T,KPH>> |
AbstractFetcher.unassignedPartitionsQueue
Queue of partitions that are not yet assigned to any Kafka clients for consuming.
|
Modifier and Type | Method and Description |
---|---|
protected List<KafkaTopicPartitionState<T,KPH>> |
AbstractFetcher.subscribedPartitionStates()
Gets all partitions (with partition state) that this fetcher is subscribed to.
|
Modifier and Type | Method and Description |
---|---|
protected void |
AbstractFetcher.emitRecordsWithTimestamps(Queue<T> records,
KafkaTopicPartitionState<T,KPH> partitionState,
long offset,
long kafkaEventTimestamp)
Emits a record attaching a timestamp to it.
|
protected void |
KafkaFetcher.partitionConsumerRecordsHandler(List<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>> partitionRecords,
KafkaTopicPartitionState<T,org.apache.kafka.common.TopicPartition> partition) |
protected void |
KafkaShuffleFetcher.partitionConsumerRecordsHandler(List<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>> partitionRecords,
KafkaTopicPartitionState<T,org.apache.kafka.common.TopicPartition> partition) |
Constructor and Description |
---|
KafkaConsumerThread(org.slf4j.Logger log,
Handover handover,
Properties kafkaProperties,
ClosableBlockingQueue<KafkaTopicPartitionState<T,org.apache.kafka.common.TopicPartition>> unassignedPartitionsQueue,
String threadName,
long pollTimeout,
boolean useMetrics,
MetricGroup consumerMetricGroup,
MetricGroup subtaskMetricGroup) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.