Modifier and Type | Interface and Description |
---|---|
interface |
ExternallyInducedSourceReader<T,SplitT extends SourceSplit>
Sources that implement this interface do not trigger checkpoints when receiving a trigger message
from the checkpoint coordinator, but when their input data/events indicate that a checkpoint
should be triggered.
|
interface |
SourceReader<T,SplitT extends SourceSplit>
The interface for a source reader which is responsible for reading the records from the source
splits assigned by
SplitEnumerator . |
interface |
SplitEnumerator<SplitT extends SourceSplit,CheckpointT>
A interface of a split enumerator responsible for the followings: 1.
|
Modifier and Type | Class and Description |
---|---|
class |
IteratorSourceEnumerator<SplitT extends IteratorSourceSplit<?,?>>
A
SplitEnumerator for iterator sources. |
class |
IteratorSourceReader<E,IterT extends Iterator<E>,SplitT extends IteratorSourceSplit<E,IterT>>
A
SourceReader that returns the values of an iterator, supplied via an IteratorSourceSplit . |
Modifier and Type | Class and Description |
---|---|
class |
CepOperator<IN,KEY,OUT>
CEP pattern operator for a keyed input stream.
|
Modifier and Type | Class and Description |
---|---|
class |
HybridSourceReader<T>
Hybrid source reader that delegates to the actual source reader.
|
class |
HybridSourceSplitEnumerator
Wraps the actual split enumerators and facilitates source switching.
|
Modifier and Type | Class and Description |
---|---|
class |
SingleThreadMultiplexSourceReaderBase<E,T,SplitT extends SourceSplit,SplitStateT>
A base for
SourceReader s that read splits with one thread using one SplitReader . |
class |
SourceReaderBase<E,T,SplitT extends SourceSplit,SplitStateT>
An abstract implementation of
SourceReader which provides some sychronization between the
mail box main thread and the SourceReader internal threads. |
Modifier and Type | Class and Description |
---|---|
class |
ContinuousFileSplitEnumerator
A continuously monitoring enumerator.
|
class |
FileSourceReader<T,SplitT extends FileSourceSplit>
A
SourceReader that read records from FileSourceSplit . |
class |
StaticFileSplitEnumerator
A SplitEnumerator implementation for bounded / batch
FileSource input. |
Modifier and Type | Class and Description |
---|---|
class |
JdbcXaSinkFunction<T>
JDBC sink function that uses XA transactions to provide exactly once guarantees.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaSourceEnumerator
The enumerator class for Kafka source.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaSourceReader<T>
The source reader for Kafka partitions.
|
Modifier and Type | Class and Description |
---|---|
class |
ContinuousHiveSplitEnumerator<T extends Comparable<T>>
A continuously monitoring
SplitEnumerator for hive source. |
Modifier and Type | Class and Description |
---|---|
class |
RocksDBKeyedStateBackend<K>
An
AbstractKeyedStateBackend that stores its state in RocksDB and serializes
state to streams provided by a CheckpointStreamFactory
upon checkpointing. |
Modifier and Type | Class and Description |
---|---|
class |
RocksDBSnapshotStrategyBase<K,R extends SnapshotResources>
Abstract base class for
SnapshotStrategy implementations for RocksDB state backend. |
class |
RocksFullSnapshotStrategy<K>
Snapshot strategy to create full snapshots of
RocksDBKeyedStateBackend . |
class |
RocksIncrementalSnapshotStrategy<K>
Snapshot strategy for
RocksDBKeyedStateBackend
that is based on RocksDB's native checkpoints and creates incremental snapshots. |
Modifier and Type | Interface and Description |
---|---|
interface |
OperatorCoordinatorCheckpointContext
This context is the interface through which the
CheckpointCoordinator interacts with an
OperatorCoordinator during checkpointing and checkpoint restoring. |
Modifier and Type | Interface and Description |
---|---|
interface |
OperatorCoordinator
A coordinator for runtime operators.
|
Modifier and Type | Class and Description |
---|---|
class |
OperatorCoordinatorHolder
The
OperatorCoordinatorHolder holds the OperatorCoordinator and manages all its
interactions with the remaining components. |
class |
RecreateOnResetOperatorCoordinator
A class that will recreate a new
OperatorCoordinator instance when reset to checkpoint. |
Modifier and Type | Class and Description |
---|---|
class |
SourceCoordinator<SplitT extends SourceSplit,EnumChkT>
The default implementation of the
OperatorCoordinator for the Source . |
Modifier and Type | Interface and Description |
---|---|
interface |
CheckpointListener
Deprecated.
This interface has been moved to
CheckpointListener . This class is kept to maintain
backwards compatibility and will be removed in future releases. |
interface |
TaskStateManager
This interface provides methods to report and retrieve state for a task.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractKeyedStateBackend<K>
Base implementation of KeyedStateBackend.
|
class |
TaskStateManagerImpl
This class is the default implementation of
TaskStateManager and collaborates with the
job manager through CheckpointResponder ) as well as a task-manager-local state store. |
Modifier and Type | Class and Description |
---|---|
class |
HeapKeyedStateBackend<K>
A
AbstractKeyedStateBackend that keeps state on the Java Heap and will serialize state to
streams provided by a CheckpointStreamFactory upon checkpointing. |
Modifier and Type | Class and Description |
---|---|
class |
Task
The Task represents one execution of a parallel subtask on a TaskManager.
|
Modifier and Type | Class and Description |
---|---|
class |
BroadcastStateBootstrapOperator<IN>
A
StreamOperator for executing BroadcastStateBootstrapFunction 's. |
class |
KeyedStateBootstrapOperator<K,IN>
A
StreamOperator for executing KeyedStateBootstrapFunction 's. |
class |
StateBootstrapOperator<IN>
A
StreamOperator for executing StateBootstrapFunction 's. |
class |
StateBootstrapWrapperOperator<IN,OUT,OP extends AbstractStreamOperator<OUT> & OneInputStreamOperator<IN,OUT>>
Wraps an existing operator so it can be bootstrapped.
|
Modifier and Type | Class and Description |
---|---|
class |
QueryableAppendingStateOperator<IN>
Internal operator handling queryable AppendingState instances.
|
class |
QueryableValueStateOperator<IN>
Internal operator handling queryable ValueState instances.
|
Modifier and Type | Class and Description |
---|---|
class |
TwoPhaseCommitSinkFunction<IN,TXN,CONTEXT>
This is a recommended base class for all of the
SinkFunction that intend to implement
exactly-once semantic. |
Modifier and Type | Class and Description |
---|---|
class |
StreamingFileSink<IN>
Sink that emits its input elements to
FileSystem files within buckets. |
Modifier and Type | Class and Description |
---|---|
class |
ContinuousFileReaderOperator<OUT,T extends TimestampedInputSplit>
The operator that reads the
splits received from the preceding
ContinuousFileMonitoringFunction . |
class |
MessageAcknowledgingSourceBase<Type,UId>
Abstract base class for data sources that receive elements from a message queue and acknowledge
them back by IDs.
|
class |
MultipleIdsMessageAcknowledgingSourceBase<Type,UId,SessionId>
Abstract base class for data sources that receive elements from a message queue and acknowledge
them back by IDs.
|
Modifier and Type | Interface and Description |
---|---|
interface |
MultipleInputStreamOperator<OUT>
Interface for stream operators with multiple
Input s. |
interface |
OneInputStreamOperator<IN,OUT>
Interface for stream operators with one input.
|
interface |
StreamOperator<OUT>
Basic interface for stream operators.
|
interface |
TwoInputStreamOperator<IN1,IN2,OUT>
Interface for stream operators with two inputs.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamOperator<OUT>
Base class for all stream operators.
|
class |
AbstractStreamOperatorV2<OUT>
New base class for all stream operators, intended to eventually replace
AbstractStreamOperator . |
class |
AbstractUdfStreamOperator<OUT,F extends Function>
This is used as the base class for operators that have a user-defined function.
|
class |
BatchGroupedReduceOperator<IN,KEY>
A
StreamOperator for executing a ReduceFunction on a KeyedStream in a RuntimeExecutionMode.BATCH
mode. |
class |
KeyedProcessOperator<K,IN,OUT>
A
StreamOperator for executing KeyedProcessFunctions . |
class |
LegacyKeyedProcessOperator<K,IN,OUT>
Deprecated.
Replaced by
KeyedProcessOperator which takes KeyedProcessFunction |
class |
ProcessOperator<IN,OUT>
A
StreamOperator for executing ProcessFunctions . |
class |
SourceOperator<OUT,SplitT extends SourceSplit>
Base source operator only used for integrating the source reader which is proposed by FLIP-27.
|
class |
StreamFilter<IN>
A
StreamOperator for executing FilterFunctions . |
class |
StreamFlatMap<IN,OUT>
A
StreamOperator for executing FlatMapFunctions . |
class |
StreamGroupedReduceOperator<IN>
|
class |
StreamMap<IN,OUT>
A
StreamOperator for executing MapFunctions . |
class |
StreamProject<IN,OUT extends Tuple>
A
StreamOperator for executing projections on streams. |
class |
StreamSink<IN>
A
StreamOperator for executing SinkFunctions . |
class |
StreamSource<OUT,SRC extends SourceFunction<OUT>>
StreamOperator for streaming sources. |
Modifier and Type | Class and Description |
---|---|
class |
AsyncWaitOperator<IN,OUT>
The
AsyncWaitOperator allows to asynchronously process incoming stream records. |
Modifier and Type | Class and Description |
---|---|
class |
CollectSinkFunction<IN>
A sink function that collects query results and sends them back to the client.
|
class |
CollectSinkOperator<IN>
A
StreamSink that collects query results and sends them back to the client. |
class |
CollectSinkOperatorCoordinator
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractOneInputPythonFunctionOperator<IN,OUT>
Base class for all one input stream operators to execute Python functions.
|
class |
AbstractPythonFunctionOperator<OUT>
Base class for all stream operators to execute Python functions.
|
class |
AbstractTwoInputPythonFunctionOperator<IN1,IN2,OUT>
Base class for all two input stream operators to execute Python functions.
|
class |
OneInputPythonFunctionOperator<IN,OUT,UDFIN,UDFOUT>
OneInputPythonFunctionOperator is responsible for launching beam runner which will start
a python harness to execute user defined python function. |
class |
PythonCoFlatMapOperator<IN1,IN2,OUT>
The
PythonCoFlatMapOperator is responsible for executing the Python CoMap Function. |
class |
PythonCoMapOperator<IN1,IN2,OUT>
The
PythonCoFlatMapOperator is responsible for executing the Python CoMap Function. |
class |
PythonFlatMapOperator<IN,OUT>
The
PythonFlatMapOperator is responsible for executing Python functions that gets one
input and produces zero/one or more outputs. |
class |
PythonKeyedCoProcessOperator<OUT>
KeyedCoProcessOperator.
|
class |
PythonKeyedProcessOperator<OUT>
PythonKeyedProcessOperator is responsible for launching beam runner which will start a
python harness to execute user defined python function. |
class |
PythonMapOperator<IN,OUT>
The
PythonMapOperator is responsible for executing Python functions that gets one input
and produces zero/one or more outputs. |
class |
PythonPartitionCustomOperator<IN,OUT>
The
PythonPartitionCustomOperator enables us to set the number of partitions for current
operator dynamically when generating the StreamGraph
before executing the job. |
class |
PythonProcessOperator<IN,OUT>
PythonProcessOperator is responsible for launching beam runner which will start a python
harness to execute user defined python ProcessFunction. |
class |
PythonTimestampsAndWatermarksOperator<IN>
A stream operator that may do one or both of the following: extract timestamps from events and
generate watermarks by user specify TimestampAssigner and WatermarkStrategy.
|
class |
TwoInputPythonFunctionOperator<IN1,IN2,RUNNER_OUT,OUT>
TwoInputPythonFunctionOperator is responsible for launching beam runner which will start
a python harness to execute two-input user defined python function. |
Modifier and Type | Class and Description |
---|---|
class |
CassandraRowWriteAheadSink
Sink that emits its input elements into a Cassandra table.
|
class |
CassandraTupleWriteAheadSink<IN extends Tuple>
Sink that emits its input elements into a Cassandra database.
|
Modifier and Type | Class and Description |
---|---|
class |
PubSubSource<OUT>
PubSub Source, this Source will consume PubSub messages from a subscription and Acknowledge them
on the next checkpoint.
|
Modifier and Type | Class and Description |
---|---|
class |
AcknowledgeOnCheckpoint<ACKID extends Serializable>
Helper class for SourceFunctions to acknowledge messages to external systems after a successful
checkpoint.
|
Modifier and Type | Class and Description |
---|---|
class |
FlinkKafkaConsumer<T>
The Flink Kafka Consumer is a streaming data source that pulls a parallel data stream from Apache
Kafka.
|
class |
FlinkKafkaConsumerBase<T>
Base class of all Flink Kafka Consumer data sources.
|
class |
FlinkKafkaProducer<IN>
Flink Sink to produce data into a Kafka topic.
|
Modifier and Type | Class and Description |
---|---|
class |
FlinkKafkaShuffleConsumer<T>
Flink Kafka Shuffle Consumer Function.
|
class |
FlinkKafkaShuffleProducer<IN,KEY>
Flink Kafka Shuffle Producer Function.
|
Modifier and Type | Class and Description |
---|---|
class |
BufferedUpsertSinkFunction
The wrapper of the
RichSinkFunction . |
Modifier and Type | Class and Description |
---|---|
class |
RMQSource<OUT>
RabbitMQ source (consumer) which reads from a queue and acknowledges messages on checkpoints.
|
Modifier and Type | Class and Description |
---|---|
class |
GenericWriteAheadSink<IN>
Generic Sink that emits its input elements into an arbitrary backend.
|
class |
TimestampsAndWatermarksOperator<T>
A stream operator that may do one or both of the following: extract timestamps from events and
generate watermarks.
|
Modifier and Type | Class and Description |
---|---|
class |
StreamingGlobalCommitterOperator<CommT,GlobalCommT>
Runtime
StreamOperator for executing GlobalCommitter in the streaming execution mode. |
Modifier and Type | Class and Description |
---|---|
class |
EvictingWindowOperator<K,IN,OUT,W extends Window>
A
WindowOperator that also allows an Evictor to be used. |
class |
WindowOperator<K,IN,ACC,OUT,W extends Window>
An operator that implements the logic for windowing based on a
WindowAssigner and Trigger . |
Modifier and Type | Class and Description |
---|---|
class |
FailureMapper<T>
This mapper simulates failure by throwing exceptions.
|
Modifier and Type | Class and Description |
---|---|
class |
FiniteTestSource<T>
A stream source that: 1) emits a list of elements without allowing checkpoints, 2) then waits for
two more checkpoints to complete, 3) then re-emits the same elements before 4) waiting for
another two checkpoints and 5) exiting.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamingWriter<IN,OUT>
Operator for file system sink.
|
class |
PartitionCommitter
Committer operator for partitions.
|
class |
StreamingFileWriter<IN>
Writer for emitting
PartitionCommitInfo to downstream. |
Modifier and Type | Class and Description |
---|---|
class |
CompactCoordinator
This is the single (non-parallel) monitoring task which coordinate input files to compaction
units.
|
class |
CompactFileWriter<T>
Writer for emitting
CompactMessages.InputFile and CompactMessages.EndCheckpoint to downstream. |
class |
CompactOperator<T>
Receives compaction units to do compaction.
|
Modifier and Type | Class and Description |
---|---|
class |
TableStreamOperator<OUT>
Table operator to invoke close always.
|
Modifier and Type | Class and Description |
---|---|
class |
LocalSlicingWindowAggOperator
The operator used for local window aggregation.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractMapBundleOperator<K,V,IN,OUT>
The
AbstractMapBundleOperator simply used a java Map to store the input elements in
key-value form. |
class |
KeyedMapBundleOperator<K,V,IN,OUT>
The
KeyedMapBundleOperator uses framework's key as bundle map key, thus can only be used
on KeyedStream . |
class |
MapBundleOperator<K,V,IN,OUT>
The
MapBundleOperator uses a KeySelector to extract bundle key, thus can be used
with non-keyed-stream. |
Modifier and Type | Class and Description |
---|---|
class |
HashJoinOperator
Hash join base operator.
|
class |
KeyedCoProcessOperatorWithWatermarkDelay<K,IN1,IN2,OUT>
A
KeyedCoProcessOperator that supports holding back watermarks with a static delay. |
class |
SortMergeJoinOperator
An implementation that realizes the joining through a sort-merge join strategy.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamingJoinOperator
Abstract implementation for streaming unbounded Join operator which defines some member fields
can be shared between different implementations.
|
class |
StreamingJoinOperator
Streaming unbounded Join operator which supports INNER/LEFT/RIGHT/FULL JOIN.
|
class |
StreamingSemiAntiJoinOperator
Streaming unbounded Join operator which supports SEMI/ANTI JOIN.
|
Modifier and Type | Class and Description |
---|---|
class |
BaseTwoInputStreamOperatorWithStateRetention
An abstract
TwoInputStreamOperator that allows its subclasses to clean up their state
based on a TTL. |
class |
TemporalProcessTimeJoinOperator
The operator to temporal join a stream on processing time.
|
class |
TemporalRowTimeJoinOperator
The operator for temporal join (FOR SYSTEM_TIME AS OF o.rowtime) on row time, it has no
limitation about message types of the left input and right input, this means the operator deals
changelog well.
|
Modifier and Type | Class and Description |
---|---|
class |
BatchMultipleInputStreamOperator
A
MultipleInputStreamOperatorBase to handle batch operators. |
class |
MultipleInputStreamOperatorBase
Base
MultipleInputStreamOperator to handle multiple inputs in table module. |
class |
UnionStreamOperator
A special operator which collects all inputs' records and forwards them in
MultipleInputStreamOperatorBase . |
Modifier and Type | Class and Description |
---|---|
class |
BufferDataOverWindowOperator
the operator for OVER window need cache data by ResettableExternalBuffer for
OverWindowFrame . |
class |
NonBufferOverWindowOperator
The operator for OVER window don't need cache data.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractStatelessFunctionOperator<IN,OUT,UDFIN>
Base class for all stream operators to execute Python Stateless Functions.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonStreamAggregateOperator
Base class for
AbstractPythonStreamGroupAggregateOperator and PythonStreamGroupWindowAggregateOperator . |
class |
AbstractPythonStreamGroupAggregateOperator
Base class for
PythonStreamGroupAggregateOperator and PythonStreamGroupTableAggregateOperator . |
class |
PythonStreamGroupAggregateOperator
The Python AggregateFunction operator for the blink planner.
|
class |
PythonStreamGroupTableAggregateOperator
The Python TableAggregateFunction operator for the blink planner.
|
class |
PythonStreamGroupWindowAggregateOperator<K,W extends Window>
The Python Group Window AggregateFunction operator for the blink planner.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractArrowPythonAggregateFunctionOperator
The Abstract class of Arrow Aggregate Operator for Pandas
AggregateFunction . |
Modifier and Type | Class and Description |
---|---|
class |
BatchArrowPythonGroupAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Group Aggregation. |
class |
BatchArrowPythonGroupWindowAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Group Window Aggregation. |
class |
BatchArrowPythonOverWindowAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Over Window Aggregation. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamArrowPythonBoundedRangeOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for RANGE clause
bounded Over Window Aggregation. |
class |
AbstractStreamArrowPythonBoundedRowsOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for ROWS clause
bounded Over Window Aggregation. |
class |
AbstractStreamArrowPythonOverWindowAggregateFunctionOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for Over Window
Aggregation. |
class |
StreamArrowPythonGroupWindowAggregateFunctionOperator<K,W extends Window>
The Stream Arrow Python
AggregateFunction Operator for Group Window Aggregation. |
class |
StreamArrowPythonProcTimeBoundedRangeOperator<K>
The Stream Arrow Python
AggregateFunction Operator for ROWS clause proc-time bounded OVER
window. |
class |
StreamArrowPythonProcTimeBoundedRowsOperator<K>
The Stream Arrow Python
AggregateFunction Operator for ROWS clause proc-time bounded OVER
window. |
class |
StreamArrowPythonRowTimeBoundedRangeOperator<K>
The Stream Arrow Python
AggregateFunction Operator for RANGE clause event-time bounded
OVER window. |
class |
StreamArrowPythonRowTimeBoundedRowsOperator<K>
The Stream Arrow Python
AggregateFunction Operator for RANGE clause event-time bounded
OVER window. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonScalarFunctionOperator<IN,OUT,UDFIN>
Base class for all stream operators to execute Python
ScalarFunction s. |
class |
AbstractRowDataPythonScalarFunctionOperator
The Python
ScalarFunction operator for the blink planner. |
class |
AbstractRowPythonScalarFunctionOperator
Base Python
ScalarFunction operator for the legacy planner. |
class |
PythonScalarFunctionOperator
The Python
ScalarFunction operator for the legacy planner. |
class |
RowDataPythonScalarFunctionOperator
The Python
ScalarFunction operator for the blink planner. |
Modifier and Type | Class and Description |
---|---|
class |
ArrowPythonScalarFunctionOperator
Arrow Python
ScalarFunction operator for the old planner. |
class |
RowDataArrowPythonScalarFunctionOperator
Arrow Python
ScalarFunction operator for the blink planner. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonTableFunctionOperator<IN,OUT,UDTFIN> |
class |
PythonTableFunctionOperator
The Python
TableFunction operator for the legacy planner. |
class |
RowDataPythonTableFunctionOperator
The Python
TableFunction operator for the blink planner. |
Modifier and Type | Class and Description |
---|---|
class |
OutputConversionOperator
Operator that converts to external data structures and unwraps atomic records if necessary.
|
class |
SinkOperator
A
StreamOperator for executing SinkFunctions . |
class |
SinkUpsertMaterializer
An operator that maintains incoming records in state corresponding to the upsert keys and
generates an upsert view for the downstream operator.
|
Modifier and Type | Class and Description |
---|---|
class |
LimitOperator
Operator for batch limit.
|
class |
ProcTimeSortOperator
Sort on proc-time and additional secondary sort attributes.
|
class |
RankOperator
Rank operator to compute top N.
|
class |
RowTimeSortOperator
Sort based on event-time and possibly additional secondary sort attributes.
|
class |
SortLimitOperator
Operator for batch sort limit.
|
class |
SortOperator
Operator for batch sort.
|
class |
StreamSortOperator
Operator for stream sort.
|
Modifier and Type | Class and Description |
---|---|
class |
InputConversionOperator<E>
Operator that converts to internal data structures and wraps atomic records if necessary.
|
Modifier and Type | Class and Description |
---|---|
class |
AggregateWindowOperator<K,W extends Window>
A
WindowOperator for grouped window aggregates. |
class |
TableAggregateWindowOperator<K,W extends Window>
A
WindowOperator for grouped and windowed table aggregates. |
Modifier and Type | Class and Description |
---|---|
class |
SlicingWindowOperator<K,W>
The
SlicingWindowOperator implements an optimized processing for aligned windows which
can apply the slicing optimization. |
Modifier and Type | Class and Description |
---|---|
class |
ProcTimeMiniBatchAssignerOperator
A stream operator that emits mini-batch marker in a given period.
|
class |
RowTimeMiniBatchAssginerOperator
A stream operator that emits watermark in a given event-time interval.
|
class |
WatermarkAssignerOperator
A stream operator that extracts timestamps from stream elements and generates periodic
watermarks.
|
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.