Modifier and Type | Method and Description |
---|---|
SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> |
KafkaSource.createEnumerator(SplitEnumeratorContext<KafkaPartitionSplit> enumContext) |
SourceReader<OUT,KafkaPartitionSplit> |
KafkaSource.createReader(SourceReaderContext readerContext) |
SimpleVersionedSerializer<KafkaPartitionSplit> |
KafkaSource.getSplitSerializer() |
SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> |
KafkaSource.restoreEnumerator(SplitEnumeratorContext<KafkaPartitionSplit> enumContext,
KafkaSourceEnumState checkpoint) |
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> |
KafkaSource.createEnumerator(SplitEnumeratorContext<KafkaPartitionSplit> enumContext) |
SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> |
KafkaSource.restoreEnumerator(SplitEnumeratorContext<KafkaPartitionSplit> enumContext,
KafkaSourceEnumState checkpoint) |
Modifier and Type | Method and Description |
---|---|
void |
KafkaSourceEnumerator.addSplitsBack(List<KafkaPartitionSplit> splits,
int subtaskId) |
Constructor and Description |
---|
KafkaSourceEnumerator(KafkaSubscriber subscriber,
OffsetsInitializer startingOffsetInitializer,
OffsetsInitializer stoppingOffsetInitializer,
Properties properties,
SplitEnumeratorContext<KafkaPartitionSplit> context,
Boundedness boundedness) |
KafkaSourceEnumerator(KafkaSubscriber subscriber,
OffsetsInitializer startingOffsetInitializer,
OffsetsInitializer stoppingOffsetInitializer,
Properties properties,
SplitEnumeratorContext<KafkaPartitionSplit> context,
Boundedness boundedness,
Set<org.apache.kafka.common.TopicPartition> assignedPartitions) |
Modifier and Type | Method and Description |
---|---|
protected KafkaPartitionSplit |
KafkaSourceReader.toSplitType(String splitId,
KafkaPartitionSplitState splitState) |
Modifier and Type | Method and Description |
---|---|
List<KafkaPartitionSplit> |
KafkaSourceReader.snapshotState(long checkpointId) |
Modifier and Type | Method and Description |
---|---|
protected KafkaPartitionSplitState |
KafkaSourceReader.initializedState(KafkaPartitionSplit split) |
Modifier and Type | Method and Description |
---|---|
void |
KafkaPartitionSplitReader.handleSplitsChanges(SplitsChange<KafkaPartitionSplit> splitsChange) |
Constructor and Description |
---|
KafkaSourceFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>>> elementsQueue,
java.util.function.Supplier<SplitReader<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,KafkaPartitionSplit>> splitReaderSupplier,
java.util.function.Consumer<Collection<String>> splitFinishedHook)
Creates a new SplitFetcherManager with a single I/O threads.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaPartitionSplitState
This class extends KafkaPartitionSplit to track a mutable current offset.
|
Modifier and Type | Method and Description |
---|---|
KafkaPartitionSplit |
KafkaPartitionSplitSerializer.deserialize(int version,
byte[] serialized) |
KafkaPartitionSplit |
KafkaPartitionSplitState.toKafkaPartitionSplit()
Use the current offset as the starting offset to create a new KafkaPartitionSplit.
|
Modifier and Type | Method and Description |
---|---|
byte[] |
KafkaPartitionSplitSerializer.serialize(KafkaPartitionSplit split) |
Constructor and Description |
---|
KafkaPartitionSplitState(KafkaPartitionSplit partitionSplit) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.