Constructor and Description |
---|
SingleThreadMultiplexSourceReaderBase(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue,
java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier,
RecordEmitter<E,T,SplitStateT> recordEmitter,
Configuration config,
SourceReaderContext context)
This constructor behaves like
SingleThreadMultiplexSourceReaderBase(Supplier,
RecordEmitter, Configuration, SourceReaderContext) , but accepts a specific FutureCompletingBlockingQueue . |
SingleThreadMultiplexSourceReaderBase(java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier,
RecordEmitter<E,T,SplitStateT> recordEmitter,
Configuration config,
SourceReaderContext context)
The primary constructor for the source reader.
|
Modifier and Type | Method and Description |
---|---|
SplitReader<E,SplitT> |
SplitFetcher.getSplitReader() |
Modifier and Type | Class and Description |
---|---|
class |
KafkaPartitionSplitReader
A
SplitReader implementation that reads records from Kafka partitions. |
Constructor and Description |
---|
KafkaSourceFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>>> elementsQueue,
java.util.function.Supplier<SplitReader<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,KafkaPartitionSplit>> splitReaderSupplier,
java.util.function.Consumer<Collection<String>> splitFinishedHook)
Creates a new SplitFetcherManager with a single I/O threads.
|
Constructor and Description |
---|
PulsarFetcherManagerBase(FutureCompletingBlockingQueue<RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier)
Creates a new SplitFetcherManager with multiple I/O threads.
|
PulsarOrderedFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier) |
PulsarUnorderedFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier) |
Modifier and Type | Class and Description |
---|---|
class |
PulsarOrderedPartitionSplitReader<OUT>
The split reader a given
PulsarPartitionSplit , it would be closed once the PulsarOrderedSourceReader is closed. |
class |
PulsarUnorderedPartitionSplitReader<OUT>
The split reader a given
PulsarPartitionSplit , it would be closed once the PulsarUnorderedSourceReader is closed. |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.