org.apache.flink.connector.pulsar.source.enumerator.assigner

Interface SplitAssigner

All Known Implementing Classes:

KeySharedSplitAssigner

@Internal
public interface SplitAssigner

The split assigner for different subscription. We would spread all the splits to different readers and store all the state into checkpoint.

Method Summary

Modifier and Type	Method and Description
void	addSplitsBack(List<PulsarPartitionSplit> splits, int subtaskId) Add a split back to the split assigner if the reader fails.
Optional<SplitsAssignment<PulsarPartitionSplit>>	createAssignment(List<Integer> readers) Create a split assignment from the current readers.
boolean	noMoreSplits(Integer reader) It would return true only if periodically partition discovery is turned off, the initializing partition discovery has finished, AND there are no pending splits for assignment.
List<TopicPartition>	registerTopicPartitions(Set<TopicPartition> fetchedPartitions) Add the current available partitions into assigner.
PulsarSourceEnumState	snapshotState() Snapshot the current assign state into checkpoint.

Method Detail

registerTopicPartitions

List<TopicPartition> registerTopicPartitions(Set<TopicPartition> fetchedPartitions)

Add the current available partitions into assigner.

Parameters:

fetchedPartitions - The available partitions queried from Pulsar broker.

Returns:

New topic partitions compare to previous registered partitions.

addSplitsBack

void addSplitsBack(List<PulsarPartitionSplit> splits,
                   int subtaskId)

Add a split back to the split assigner if the reader fails. We would try to reassign the split or add it to the pending list.

createAssignment

Optional<SplitsAssignment<PulsarPartitionSplit>> createAssignment(List<Integer> readers)

Create a split assignment from the current readers.

noMoreSplits

boolean noMoreSplits(Integer reader)

It would return true only if periodically partition discovery is turned off, the initializing partition discovery has finished, AND there are no pending splits for assignment.

snapshotState

PulsarSourceEnumState snapshotState()

Snapshot the current assign state into checkpoint.