Modifier and Type | Interface and Description |
---|---|
interface |
ExternallyInducedSourceReader<T,SplitT extends SourceSplit>
Sources that implement this interface delay checkpoints when receiving a trigger message from the
checkpoint coordinator to the point when their input data/events indicate that a checkpoint
should be triggered.
|
interface |
Source<T,SplitT extends SourceSplit,EnumChkT>
The interface for Source.
|
interface |
SourceReader<T,SplitT extends SourceSplit>
The interface for a source reader which is responsible for reading the records from the source
splits assigned by
SplitEnumerator . |
interface |
SplitEnumerator<SplitT extends SourceSplit,CheckpointT>
A interface of a split enumerator responsible for the followings: 1.
|
interface |
SplitEnumeratorContext<SplitT extends SourceSplit>
A context class for the
SplitEnumerator . |
class |
SplitsAssignment<SplitT extends SourceSplit>
A class containing the splits assignment to the source readers.
|
Modifier and Type | Class and Description |
---|---|
static class |
NumberSequenceSource.NumberSequenceSplit
A split of the source, representing a number sub-sequence.
|
Modifier and Type | Interface and Description |
---|---|
interface |
IteratorSourceSplit<E,IterT extends Iterator<E>>
A
SourceSplit that represents a sequence of elements captured in an iterator. |
Modifier and Type | Class and Description |
---|---|
class |
HybridSourceSplit
Source split that wraps the actual split type.
|
Modifier and Type | Method and Description |
---|---|
static SourceSplit |
HybridSourceSplit.unwrapSplit(HybridSourceSplit split,
org.apache.flink.connector.base.source.hybrid.SwitchedSources switchedSources) |
Modifier and Type | Method and Description |
---|---|
static List<SourceSplit> |
HybridSourceSplit.unwrapSplits(List<HybridSourceSplit> splits,
org.apache.flink.connector.base.source.hybrid.SwitchedSources switchedSources) |
Modifier and Type | Method and Description |
---|---|
static HybridSourceSplit |
HybridSourceSplit.wrapSplit(SourceSplit split,
int sourceIndex,
org.apache.flink.connector.base.source.hybrid.SwitchedSources switchedSources) |
Modifier and Type | Method and Description |
---|---|
static List<HybridSourceSplit> |
HybridSourceSplit.wrapSplits(List<? extends SourceSplit> state,
int readerIndex,
org.apache.flink.connector.base.source.hybrid.SwitchedSources switchedSources) |
Modifier and Type | Class and Description |
---|---|
class |
SingleThreadMultiplexSourceReaderBase<E,T,SplitT extends SourceSplit,SplitStateT>
A base for
SourceReader s that read splits with one thread using one SplitReader . |
class |
SourceReaderBase<E,T,SplitT extends SourceSplit,SplitStateT>
An abstract implementation of
SourceReader which provides some synchronization between
the mail box main thread and the SourceReader internal threads. |
Modifier and Type | Method and Description |
---|---|
void |
RecordsBySplits.Builder.add(SourceSplit split,
E record)
Add the record from the given source split.
|
void |
RecordsBySplits.Builder.addAll(SourceSplit split,
Collection<E> records)
Add multiple records from the given source split.
|
Modifier and Type | Class and Description |
---|---|
class |
SingleThreadFetcherManager<E,SplitT extends SourceSplit>
A Fetcher Manager with a single fetching thread (I/O thread) that handles all splits
concurrently.
|
class |
SplitFetcher<E,SplitT extends SourceSplit>
The internal fetcher runnable responsible for polling message from the external system.
|
class |
SplitFetcherManager<E,SplitT extends SourceSplit>
A class responsible for starting the
SplitFetcher and manage the life cycles of them. |
Modifier and Type | Interface and Description |
---|---|
interface |
SplitReader<E,SplitT extends SourceSplit>
An interface used to read from splits.
|
Modifier and Type | Method and Description |
---|---|
static <SplitT extends SourceSplit,C extends Collection<SplitT>> |
SerdeUtils.deserializeSplitAssignments(byte[] serialized,
SimpleVersionedSerializer<SplitT> splitSerializer,
java.util.function.Function<Integer,C> collectionSupplier)
Deserialize the given bytes returned by
SerdeUtils.serializeSplitAssignments(Map,
SimpleVersionedSerializer) . |
static <SplitT extends SourceSplit,C extends Collection<SplitT>> |
SerdeUtils.serializeSplitAssignments(Map<Integer,C> splitAssignments,
SimpleVersionedSerializer<SplitT> splitSerializer)
Serialize a mapping from subtask ids to lists of assigned splits.
|
Modifier and Type | Class and Description |
---|---|
class |
FileSourceSplit
A
SourceSplit that represents a file, or a region of a file. |
Modifier and Type | Class and Description |
---|---|
class |
KafkaPartitionSplit
A
SourceSplit for a Kafka partition. |
class |
KafkaPartitionSplitState
This class extends KafkaPartitionSplit to track a mutable current offset.
|
Modifier and Type | Class and Description |
---|---|
class |
PulsarPartitionSplit
A
SourceSplit implementation for a Pulsar's partition. |
Modifier and Type | Class and Description |
---|---|
class |
FromElementsSplit
The split of the
FromElementsSource . |
Modifier and Type | Class and Description |
---|---|
class |
SourceReaderTestBase<SplitT extends SourceSplit>
An abstract test class for all the unit tests of
SourceReader to inherit. |
class |
TestingSplitEnumeratorContext<SplitT extends SourceSplit>
A test implementation of the
SplitEnumeratorContext , with manual, non-concurrent
interaction and intercepting of state. |
static class |
TestingSplitEnumeratorContext.SplitAssignmentState<SplitT extends SourceSplit>
The state of the split assignment for a subtask.
|
Modifier and Type | Class and Description |
---|---|
class |
HiveSourceSplit
A sub-class of
FileSourceSplit that contains extra information needed to read a hive
table. |
Modifier and Type | Class and Description |
---|---|
class |
SourceCoordinator<SplitT extends SourceSplit,EnumChkT>
The default implementation of the
OperatorCoordinator for the Source . |
class |
SourceCoordinatorContext<SplitT extends SourceSplit>
A context class for the
OperatorCoordinator . |
class |
SourceCoordinatorProvider<SplitT extends SourceSplit>
The provider of
SourceCoordinator . |
class |
SplitAssignmentTracker<SplitT extends SourceSplit>
A class that is responsible for tracking the past split assignments made by
SplitEnumerator . |
Modifier and Type | Class and Description |
---|---|
class |
SourceOperator<OUT,SplitT extends SourceSplit>
Base source operator only used for integrating the source reader which is proposed by FLIP-27.
|
Modifier and Type | Class and Description |
---|---|
class |
SourceTransformation<OUT,SplitT extends SourceSplit,EnumChkT>
A
PhysicalTransformation for Source . |
Modifier and Type | Class and Description |
---|---|
class |
SourceTransformationTranslator<OUT,SplitT extends SourceSplit,EnumChkT>
A
TransformationTranslator for the SourceTransformation . |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.