Modifier and Type | Method and Description |
---|---|
SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.createEnumerator(SplitEnumeratorContext<PulsarPartitionSplit> enumContext) |
SourceReader<OUT,PulsarPartitionSplit> |
PulsarSource.createReader(SourceReaderContext readerContext) |
SimpleVersionedSerializer<PulsarPartitionSplit> |
PulsarSource.getSplitSerializer() |
SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.restoreEnumerator(SplitEnumeratorContext<PulsarPartitionSplit> enumContext,
PulsarSourceEnumState checkpoint) |
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.createEnumerator(SplitEnumeratorContext<PulsarPartitionSplit> enumContext) |
SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.restoreEnumerator(SplitEnumeratorContext<PulsarPartitionSplit> enumContext,
PulsarSourceEnumState checkpoint) |
Modifier and Type | Method and Description |
---|---|
void |
PulsarSourceEnumerator.addSplitsBack(List<PulsarPartitionSplit> splits,
int subtaskId) |
Constructor and Description |
---|
PulsarSourceEnumerator(PulsarSubscriber subscriber,
StartCursor startCursor,
StopCursor stopCursor,
RangeGenerator rangeGenerator,
SourceConfiguration sourceConfiguration,
SplitEnumeratorContext<PulsarPartitionSplit> context) |
PulsarSourceEnumerator(PulsarSubscriber subscriber,
StartCursor startCursor,
StopCursor stopCursor,
RangeGenerator rangeGenerator,
SourceConfiguration sourceConfiguration,
SplitEnumeratorContext<PulsarPartitionSplit> context,
PulsarSourceEnumState enumState) |
Modifier and Type | Method and Description |
---|---|
Optional<SplitsAssignment<PulsarPartitionSplit>> |
SplitAssigner.createAssignment(List<Integer> readers)
Create a split assignment from the current readers.
|
Modifier and Type | Method and Description |
---|---|
void |
KeySharedSplitAssigner.addSplitsBack(List<PulsarPartitionSplit> splits,
int subtaskId) |
void |
SplitAssigner.addSplitsBack(List<PulsarPartitionSplit> splits,
int subtaskId)
Add a split back to the split assigner if the reader fails.
|
static SplitAssigner |
SplitAssignerFactory.createAssigner(StopCursor stopCursor,
SourceConfiguration sourceConfiguration,
SplitEnumeratorContext<PulsarPartitionSplit> context,
PulsarSourceEnumState enumState) |
Constructor and Description |
---|
KeySharedSplitAssigner(StopCursor stopCursor,
boolean enablePartitionDiscovery,
SplitEnumeratorContext<PulsarPartitionSplit> context,
PulsarSourceEnumState enumState) |
Modifier and Type | Method and Description |
---|---|
static <OUT> SourceReader<OUT,PulsarPartitionSplit> |
PulsarSourceReaderFactory.create(SourceReaderContext readerContext,
PulsarDeserializationSchema<OUT> deserializationSchema,
SourceConfiguration sourceConfiguration) |
Modifier and Type | Method and Description |
---|---|
protected SplitFetcher<PulsarMessage<T>,PulsarPartitionSplit> |
PulsarFetcherManagerBase.getOrCreateFetcher(String splitId) |
List<PulsarPartitionSplit> |
PulsarUnorderedFetcherManager.snapshotState() |
Modifier and Type | Method and Description |
---|---|
void |
PulsarFetcherManagerBase.addSplits(List<PulsarPartitionSplit> splitsToAdd)
Override this method for supporting multiple thread fetching, one fetcher thread for one
split.
|
protected void |
PulsarFetcherManagerBase.startFetcher(SplitFetcher<PulsarMessage<T>,PulsarPartitionSplit> fetcher) |
Constructor and Description |
---|
PulsarFetcherManagerBase(FutureCompletingBlockingQueue<RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier,
Configuration configuration)
Creates a new SplitFetcherManager with multiple I/O threads.
|
PulsarOrderedFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier,
Configuration configuration) |
PulsarUnorderedFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier,
Configuration configuration) |
Modifier and Type | Method and Description |
---|---|
List<PulsarPartitionSplit> |
PulsarOrderedSourceReader.snapshotState(long checkpointId) |
List<PulsarPartitionSplit> |
PulsarUnorderedSourceReader.snapshotState(long checkpointId) |
Modifier and Type | Method and Description |
---|---|
void |
PulsarUnorderedSourceReader.addSplits(List<PulsarPartitionSplit> splits) |
Modifier and Type | Method and Description |
---|---|
protected void |
PulsarUnorderedPartitionSplitReader.afterCreatingConsumer(PulsarPartitionSplit split,
org.apache.pulsar.client.api.Consumer<byte[]> consumer) |
protected void |
PulsarOrderedPartitionSplitReader.beforeCreatingConsumer(PulsarPartitionSplit split) |
Modifier and Type | Method and Description |
---|---|
PulsarPartitionSplit |
PulsarPartitionSplitSerializer.deserialize(int version,
byte[] serialized) |
PulsarPartitionSplit |
PulsarPartitionSplitSerializer.deserializePulsarPartitionSplit(int version,
DataInputStream in) |
PulsarPartitionSplit |
PulsarPartitionSplitState.toPulsarPartitionSplit()
Create a partition split which contains the latest consumed message id as the start position.
|
Modifier and Type | Method and Description |
---|---|
byte[] |
PulsarPartitionSplitSerializer.serialize(PulsarPartitionSplit obj) |
void |
PulsarPartitionSplitSerializer.serializePulsarPartitionSplit(DataOutputStream out,
PulsarPartitionSplit split) |
Constructor and Description |
---|
PulsarPartitionSplitState(PulsarPartitionSplit split) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.