Modifier and Type | Class and Description |
---|---|
class |
CepOperator<IN,KEY,OUT>
CEP pattern operator for a keyed input stream.
|
Modifier and Type | Method and Description |
---|---|
StreamOperator<TaggedOperatorSubtaskState> |
SavepointWriterOperatorFactory.createOperator(long savepointTimestamp,
Path savepointPath)
Creates a
StreamOperator to be used for generating and snapshotting state. |
Modifier and Type | Method and Description |
---|---|
static <OUT,OP extends StreamOperator<OUT>> |
SnapshotUtils.snapshot(OP operator,
int index,
long timestamp,
boolean isExactlyOnceMode,
boolean isUnalignedCheckpoint,
Configuration configuration,
Path savepointPath) |
Modifier and Type | Class and Description |
---|---|
class |
BroadcastStateBootstrapOperator<IN>
A
StreamOperator for executing BroadcastStateBootstrapFunction 's. |
class |
KeyedStateBootstrapOperator<K,IN>
A
StreamOperator for executing KeyedStateBootstrapFunction 's. |
class |
StateBootstrapOperator<IN>
A
StreamOperator for executing StateBootstrapFunction 's. |
class |
StateBootstrapWrapperOperator<IN,OUT,OP extends AbstractStreamOperator<OUT> & OneInputStreamOperator<IN,OUT>>
Wraps an existing operator so it can be bootstrapped.
|
Modifier and Type | Class and Description |
---|---|
class |
QueryableAppendingStateOperator<IN>
Internal operator handling queryable AppendingState instances.
|
class |
QueryableValueStateOperator<IN>
Internal operator handling queryable ValueState instances.
|
Modifier and Type | Class and Description |
---|---|
class |
ContinuousFileReaderOperator<OUT,T extends TimestampedInputSplit>
The operator that reads the
splits received from the preceding
ContinuousFileMonitoringFunction . |
Modifier and Type | Method and Description |
---|---|
<O extends StreamOperator<OUT>> |
ContinuousFileReaderOperatorFactory.createStreamOperator(StreamOperatorParameters<OUT> parameters) |
Modifier and Type | Method and Description |
---|---|
Class<? extends StreamOperator> |
ContinuousFileReaderOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Modifier and Type | Method and Description |
---|---|
<T extends StreamOperator<?>> |
StreamConfig.getStreamOperator(ClassLoader cl) |
Modifier and Type | Method and Description |
---|---|
StreamOperator<?> |
StreamNode.getOperator() |
Modifier and Type | Method and Description |
---|---|
void |
StreamConfig.setStreamOperator(StreamOperator<?> operator) |
Constructor and Description |
---|
StreamNode(Integer id,
String slotSharingGroup,
String coLocationGroup,
StreamOperator<?> operator,
String operatorName,
Class<? extends TaskInvokable> jobVertexClass) |
Modifier and Type | Interface and Description |
---|---|
interface |
MultipleInputStreamOperator<OUT>
Interface for stream operators with multiple
Input s. |
interface |
OneInputStreamOperator<IN,OUT>
Interface for stream operators with one input.
|
interface |
TwoInputStreamOperator<IN1,IN2,OUT>
Interface for stream operators with two inputs.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamOperator<OUT>
Base class for all stream operators.
|
class |
AbstractStreamOperatorV2<OUT>
New base class for all stream operators, intended to eventually replace
AbstractStreamOperator . |
class |
AbstractUdfStreamOperator<OUT,F extends Function>
This is used as the base class for operators that have a user-defined function.
|
class |
BatchGroupedReduceOperator<IN,KEY>
A
StreamOperator for executing a ReduceFunction on a KeyedStream in a RuntimeExecutionMode.BATCH
mode. |
class |
KeyedProcessOperator<K,IN,OUT>
A
StreamOperator for executing KeyedProcessFunctions . |
class |
LegacyKeyedProcessOperator<K,IN,OUT>
Deprecated.
Replaced by
KeyedProcessOperator which takes KeyedProcessFunction |
class |
ProcessOperator<IN,OUT>
A
StreamOperator for executing ProcessFunctions . |
class |
SourceOperator<OUT,SplitT extends SourceSplit>
Base source operator only used for integrating the source reader which is proposed by FLIP-27.
|
class |
StreamFilter<IN>
A
StreamOperator for executing FilterFunctions . |
class |
StreamFlatMap<IN,OUT>
A
StreamOperator for executing FlatMapFunctions . |
class |
StreamGroupedReduceOperator<IN>
|
class |
StreamMap<IN,OUT>
A
StreamOperator for executing MapFunctions . |
class |
StreamProject<IN,OUT extends Tuple>
A
StreamOperator for executing projections on streams. |
class |
StreamSink<IN>
A
StreamOperator for executing SinkFunctions . |
class |
StreamSource<OUT,SRC extends SourceFunction<OUT>>
StreamOperator for streaming sources. |
Modifier and Type | Method and Description |
---|---|
static <OUT,OP extends StreamOperator<OUT>> |
StreamOperatorFactoryUtil.createOperator(StreamOperatorFactory<OUT> operatorFactory,
StreamTask<OUT,?> containingTask,
StreamConfig configuration,
Output<StreamRecord<OUT>> output,
OperatorEventDispatcher operatorEventDispatcher)
Creates a new operator using a factory and makes sure that all special factory traits are
properly handled.
|
<T extends StreamOperator<OUT>> |
SourceOperatorFactory.createStreamOperator(StreamOperatorParameters<OUT> parameters) |
<T extends StreamOperator<OUT>> |
SimpleOperatorFactory.createStreamOperator(StreamOperatorParameters<OUT> parameters) |
<T extends StreamOperator<OUT>> |
CoordinatedOperatorFactory.createStreamOperator(StreamOperatorParameters<OUT> parameters)
The implementation should return an instance of
OperatorEventHandler . |
<T extends StreamOperator<OUT>> |
StreamOperatorFactory.createStreamOperator(StreamOperatorParameters<OUT> parameters)
Create the operator.
|
Modifier and Type | Method and Description |
---|---|
StreamOperator<OUT> |
SimpleOperatorFactory.getOperator() |
Modifier and Type | Method and Description |
---|---|
Class<? extends StreamOperator> |
SourceOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Class<? extends StreamOperator> |
SimpleOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Class<? extends StreamOperator> |
StreamOperatorFactory.getStreamOperatorClass(ClassLoader classLoader)
Returns the runtime class of the stream operator.
|
Modifier and Type | Method and Description |
---|---|
static <OUT> SimpleOperatorFactory<OUT> |
SimpleOperatorFactory.of(StreamOperator<OUT> operator)
Create a SimpleOperatorFactory from existed StreamOperator.
|
Constructor and Description |
---|
SimpleOperatorFactory(StreamOperator<OUT> operator) |
Modifier and Type | Class and Description |
---|---|
class |
AsyncWaitOperator<IN,OUT>
The
AsyncWaitOperator allows to asynchronously process incoming stream records. |
Modifier and Type | Method and Description |
---|---|
<T extends StreamOperator<OUT>> |
AsyncWaitOperatorFactory.createStreamOperator(StreamOperatorParameters<OUT> parameters) |
Modifier and Type | Method and Description |
---|---|
Class<? extends StreamOperator> |
AsyncWaitOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Modifier and Type | Class and Description |
---|---|
class |
CollectSinkOperator<IN>
A
StreamSink that collects query results and sends them back to the client. |
Modifier and Type | Method and Description |
---|---|
<T extends StreamOperator<Object>> |
CollectSinkOperatorFactory.createStreamOperator(StreamOperatorParameters<Object> parameters) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractDataStreamPythonFunctionOperator<OUT>
Base class for all Python DataStream operators.
|
class |
AbstractOneInputPythonFunctionOperator<IN,OUT>
AbstractOneInputPythonFunctionOperator is responsible for launching beam runner which
will start a python harness to execute user defined python function. |
class |
AbstractPythonFunctionOperator<OUT>
Base class for all stream operators to execute Python functions.
|
class |
AbstractTwoInputPythonFunctionOperator<IN1,IN2,OUT>
AbstractTwoInputPythonFunctionOperator is responsible for launching beam runner which
will start a python harness to execute two-input user defined python function. |
class |
PythonCoProcessOperator<IN1,IN2,OUT>
The
PythonCoProcessOperator is responsible for executing the Python CoProcess Function. |
class |
PythonKeyedCoProcessOperator<OUT>
KeyedCoProcessOperator.
|
class |
PythonKeyedProcessOperator<OUT>
PythonKeyedProcessOperator is responsible for launching beam runner which will start a
python harness to execute user defined python function. |
class |
PythonProcessOperator<IN,OUT>
PythonProcessOperator is responsible for launching beam runner which will start a python
harness to execute user defined python ProcessFunction. |
Modifier and Type | Class and Description |
---|---|
class |
CassandraRowWriteAheadSink
Sink that emits its input elements into a Cassandra table.
|
class |
CassandraTupleWriteAheadSink<IN extends Tuple>
Sink that emits its input elements into a Cassandra database.
|
Modifier and Type | Class and Description |
---|---|
class |
GenericWriteAheadSink<IN>
Generic Sink that emits its input elements into an arbitrary backend.
|
class |
TimestampsAndWatermarksOperator<T>
A stream operator that may do one or both of the following: extract timestamps from events and
generate watermarks.
|
Modifier and Type | Method and Description |
---|---|
<T extends StreamOperator<byte[]>> |
SinkOperatorFactory.createStreamOperator(StreamOperatorParameters<byte[]> parameters) |
<T extends StreamOperator<byte[]>> |
CommitterOperatorFactory.createStreamOperator(StreamOperatorParameters<byte[]> parameters) |
Modifier and Type | Method and Description |
---|---|
Class<? extends StreamOperator> |
SinkOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Class<? extends StreamOperator> |
CommitterOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Modifier and Type | Class and Description |
---|---|
class |
EvictingWindowOperator<K,IN,OUT,W extends Window>
A
WindowOperator that also allows an Evictor to be used. |
class |
WindowOperator<K,IN,ACC,OUT,W extends Window>
An operator that implements the logic for windowing based on a
WindowAssigner and Trigger . |
Modifier and Type | Class and Description |
---|---|
class |
FinishedOperatorChain<OUT,OP extends StreamOperator<OUT>>
The
OperatorChain that is used for restoring tasks that are TaskStateManager.isTaskDeployedAsFinished() . |
class |
OperatorChain<OUT,OP extends StreamOperator<OUT>>
The
OperatorChain contains all operators that are executed as one chain within a single
StreamTask . |
class |
RegularOperatorChain<OUT,OP extends StreamOperator<OUT>>
A regular non finished on restore
OperatorChain . |
class |
StreamOperatorWrapper<OUT,OP extends StreamOperator<OUT>>
This class handles the finish, endInput and other related logic of a
StreamOperator . |
class |
StreamTask<OUT,OP extends StreamOperator<OUT>>
Base class for all streaming tasks.
|
Modifier and Type | Field and Description |
---|---|
protected OP |
StreamTask.mainOperator
the main operator that consumes the input streams of this task.
|
Modifier and Type | Method and Description |
---|---|
protected Counter |
StreamTask.setupNumRecordsInCounter(StreamOperator streamOperator) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamingWriter<IN,OUT>
Operator for file system sink.
|
class |
PartitionCommitter
Committer operator for partitions.
|
class |
StreamingFileWriter<IN>
Writer for emitting
PartitionCommitInfo to downstream. |
Modifier and Type | Class and Description |
---|---|
class |
CompactCoordinator
This is the single (non-parallel) monitoring task which coordinate input files to compaction
units.
|
class |
CompactFileWriter<T>
Writer for emitting
CompactMessages.InputFile and CompactMessages.EndCheckpoint to downstream. |
class |
CompactOperator<T>
Receives compaction units to do compaction.
|
Modifier and Type | Class and Description |
---|---|
class |
GeneratedOperator<C extends StreamOperator<?>>
Describes a generated
StreamOperator . |
Modifier and Type | Class and Description |
---|---|
class |
TableStreamOperator<OUT>
Table operator to invoke close always.
|
Modifier and Type | Method and Description |
---|---|
<T extends StreamOperator<OUT>> |
CodeGenOperatorFactory.createStreamOperator(StreamOperatorParameters<OUT> parameters) |
Modifier and Type | Method and Description |
---|---|
GeneratedClass<? extends StreamOperator<OUT>> |
CodeGenOperatorFactory.getGeneratedClass() |
Class<? extends StreamOperator> |
CodeGenOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Constructor and Description |
---|
CodeGenOperatorFactory(GeneratedClass<? extends StreamOperator<OUT>> generatedClass) |
Modifier and Type | Class and Description |
---|---|
class |
LocalSlicingWindowAggOperator
The operator used for local window aggregation.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractMapBundleOperator<K,V,IN,OUT>
The
AbstractMapBundleOperator simply used a java Map to store the input elements in
key-value form. |
class |
KeyedMapBundleOperator<K,V,IN,OUT>
The
KeyedMapBundleOperator uses framework's key as bundle map key, thus can only be used
on KeyedStream . |
class |
MapBundleOperator<K,V,IN,OUT>
The
MapBundleOperator uses a KeySelector to extract bundle key, thus can be used
with non-keyed-stream. |
Modifier and Type | Class and Description |
---|---|
class |
HashJoinOperator
Hash join base operator.
|
class |
KeyedCoProcessOperatorWithWatermarkDelay<K,IN1,IN2,OUT>
A
KeyedCoProcessOperator that supports holding back watermarks with a static delay. |
class |
SortMergeJoinOperator
An implementation that realizes the joining through a sort-merge join strategy.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamingJoinOperator
Abstract implementation for streaming unbounded Join operator which defines some member fields
can be shared between different implementations.
|
class |
StreamingJoinOperator
Streaming unbounded Join operator which supports INNER/LEFT/RIGHT/FULL JOIN.
|
class |
StreamingSemiAntiJoinOperator
Streaming unbounded Join operator which supports SEMI/ANTI JOIN.
|
Modifier and Type | Class and Description |
---|---|
class |
BaseTwoInputStreamOperatorWithStateRetention
An abstract
TwoInputStreamOperator that allows its subclasses to clean up their state
based on a TTL. |
class |
TemporalProcessTimeJoinOperator
The operator to temporal join a stream on processing time.
|
class |
TemporalRowTimeJoinOperator
The operator for temporal join (FOR SYSTEM_TIME AS OF o.rowtime) on row time, it has no
limitation about message types of the left input and right input, this means the operator deals
changelog well.
|
Modifier and Type | Class and Description |
---|---|
class |
WindowJoinOperator
Streaming window join operator.
|
Modifier and Type | Class and Description |
---|---|
class |
TableOperatorWrapper<OP extends StreamOperator<RowData>>
This class handles the close, endInput and other related logic of a
StreamOperator . |
Modifier and Type | Class and Description |
---|---|
class |
BatchMultipleInputStreamOperator
A
MultipleInputStreamOperatorBase to handle batch operators. |
class |
MultipleInputStreamOperatorBase
Base
MultipleInputStreamOperator to handle multiple inputs in table module. |
class |
UnionStreamOperator
A special operator which collects all inputs' records and forwards them in
MultipleInputStreamOperatorBase . |
Modifier and Type | Method and Description |
---|---|
<T extends StreamOperator<RowData>> |
BatchMultipleInputStreamOperatorFactory.createStreamOperator(StreamOperatorParameters<RowData> parameters) |
Modifier and Type | Method and Description |
---|---|
Class<? extends StreamOperator> |
BatchMultipleInputStreamOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Constructor and Description |
---|
OutputBase(StreamOperator<?> operator) |
Modifier and Type | Class and Description |
---|---|
class |
BufferDataOverWindowOperator
the operator for OVER window need cache data by ResettableExternalBuffer for
OverWindowFrame . |
class |
NonBufferOverWindowOperator
The operator for OVER window don't need cache data.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractStatelessFunctionOperator<IN,OUT,UDFIN>
Base class for all stream operators to execute Python Stateless Functions.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonStreamAggregateOperator
Base class for
AbstractPythonStreamGroupAggregateOperator and PythonStreamGroupWindowAggregateOperator . |
class |
AbstractPythonStreamGroupAggregateOperator
Base class for
PythonStreamGroupAggregateOperator and PythonStreamGroupTableAggregateOperator . |
class |
PythonStreamGroupAggregateOperator
The Python AggregateFunction operator.
|
class |
PythonStreamGroupTableAggregateOperator
The Python TableAggregateFunction operator.
|
class |
PythonStreamGroupWindowAggregateOperator<K,W extends Window>
The Python Group Window AggregateFunction operator.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractArrowPythonAggregateFunctionOperator
The Abstract class of Arrow Aggregate Operator for Pandas
AggregateFunction . |
Modifier and Type | Class and Description |
---|---|
class |
BatchArrowPythonGroupAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Group Aggregation. |
class |
BatchArrowPythonGroupWindowAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Group Window Aggregation. |
class |
BatchArrowPythonOverWindowAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Over Window Aggregation. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamArrowPythonBoundedRangeOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for RANGE clause
bounded Over Window Aggregation. |
class |
AbstractStreamArrowPythonBoundedRowsOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for ROWS clause
bounded Over Window Aggregation. |
class |
AbstractStreamArrowPythonOverWindowAggregateFunctionOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for Over Window
Aggregation. |
class |
StreamArrowPythonGroupWindowAggregateFunctionOperator<K,W extends Window>
The Stream Arrow Python
AggregateFunction Operator for Group Window Aggregation. |
class |
StreamArrowPythonProcTimeBoundedRangeOperator<K>
The Stream Arrow Python
AggregateFunction Operator for ROWS clause proc-time bounded OVER
window. |
class |
StreamArrowPythonProcTimeBoundedRowsOperator<K>
The Stream Arrow Python
AggregateFunction Operator for ROWS clause proc-time bounded OVER
window. |
class |
StreamArrowPythonRowTimeBoundedRangeOperator<K>
The Stream Arrow Python
AggregateFunction Operator for RANGE clause event-time bounded
OVER window. |
class |
StreamArrowPythonRowTimeBoundedRowsOperator<K>
The Stream Arrow Python
AggregateFunction Operator for RANGE clause event-time bounded
OVER window. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonScalarFunctionOperator
Base class for all stream operators to execute Python
ScalarFunction s. |
class |
PythonScalarFunctionOperator
The Python
ScalarFunction operator. |
Modifier and Type | Class and Description |
---|---|
class |
ArrowPythonScalarFunctionOperator
Arrow Python
ScalarFunction operator. |
Modifier and Type | Class and Description |
---|---|
class |
PythonTableFunctionOperator
The Python
TableFunction operator. |
Modifier and Type | Class and Description |
---|---|
class |
OutputConversionOperator
Operator that converts to external data structures and unwraps atomic records if necessary.
|
class |
SinkOperator
A
StreamOperator for executing SinkFunctions . |
class |
SinkUpsertMaterializer
An operator that maintains incoming records in state corresponding to the upsert keys and
generates an upsert view for the downstream operator.
|
class |
StreamRecordTimestampInserter
Operator which sets the timestamp on the StreamRecord from the corresponding column of each row.
|
Modifier and Type | Class and Description |
---|---|
class |
LimitOperator
Operator for batch limit.
|
class |
ProcTimeSortOperator
Sort on proc-time and additional secondary sort attributes.
|
class |
RankOperator
Rank operator to compute top N.
|
class |
RowTimeSortOperator
Sort based on event-time and possibly additional secondary sort attributes.
|
class |
SortLimitOperator
Operator for batch sort limit.
|
class |
SortOperator
Operator for batch sort.
|
class |
StreamSortOperator
Operator for stream sort.
|
Modifier and Type | Class and Description |
---|---|
class |
InputConversionOperator<E>
Operator that converts to internal data structures and wraps atomic records if necessary.
|
Modifier and Type | Class and Description |
---|---|
class |
AggregateWindowOperator<K,W extends Window>
A
WindowOperator for grouped window aggregates. |
class |
TableAggregateWindowOperator<K,W extends Window>
A
WindowOperator for grouped and windowed table aggregates. |
class |
WindowTableFunctionOperator
The WindowTableFunctionOperator acts as a table-valued function to assign windows for input row.
|
Modifier and Type | Class and Description |
---|---|
class |
SlicingWindowOperator<K,W>
The
SlicingWindowOperator implements an optimized processing for aligned windows which
can apply the slicing optimization. |
Modifier and Type | Class and Description |
---|---|
class |
ProcTimeMiniBatchAssignerOperator
A stream operator that emits mini-batch marker in a given period.
|
class |
RowTimeMiniBatchAssginerOperator
A stream operator that emits watermark in a given event-time interval.
|
class |
WatermarkAssignerOperator
A stream operator that extracts timestamps from stream elements and generates periodic
watermarks.
|
Modifier and Type | Method and Description |
---|---|
StreamOperator |
WatermarkAssignerOperatorFactory.createStreamOperator(StreamOperatorParameters initializer) |
Modifier and Type | Method and Description |
---|---|
Class<? extends StreamOperator> |
WatermarkAssignerOperatorFactory.getStreamOperatorClass(ClassLoader classLoader) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.