org.apache.flink.streaming.runtime.operators

Class TimestampsAndPunctuatedWatermarksOperator<T>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<T,AssignerWithPunctuatedWatermarks<T>>

org.apache.flink.streaming.runtime.operators.TimestampsAndPunctuatedWatermarksOperator<T>

Type Parameters:

T - The type of the input elements

All Implemented Interfaces:

Serializable, CheckpointListener, KeyContext, OneInputStreamOperator<T,T>, OutputTypeConfigurable<T>, StreamOperator<T>, Disposable

public class TimestampsAndPunctuatedWatermarksOperator<T>
extends AbstractUdfStreamOperator<T,AssignerWithPunctuatedWatermarks<T>>
implements OneInputStreamOperator<T,T>

A stream operator that extracts timestamps from stream elements and generates watermarks based on punctuation elements.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

AbstractStreamOperator.CountingOutput<OUT>

Field Summary

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

userFunction

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, timeServiceManager

Constructor Summary

Constructors

Constructor and Description
TimestampsAndPunctuatedWatermarksOperator(AssignerWithPunctuatedWatermarks<T> assigner)

Method Summary

Modifier and Type	Method and Description
void	processElement(StreamRecord<T> element) Processes one element that arrived at this operator.
void	processWatermark(Watermark mark) Override the base implementation to completely ignore watermarks propagated from upstream (we rely only on the AssignerWithPunctuatedWatermarks to emit watermarks from here).

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

close, dispose, getUserFunction, getUserFunctionParameters, initializeState, notifyCheckpointComplete, open, setOutputType, setup, snapshotState

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getUserCodeClassloader, initializeState, numEventTimeTimers, numProcessingTimeTimers, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, snapshotState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.OneInputStreamOperator

processLatencyMarker

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

close, dispose, getChainingStrategy, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setup, snapshotState

Methods inherited from interface org.apache.flink.runtime.state.CheckpointListener

notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

Constructor Detail

TimestampsAndPunctuatedWatermarksOperator

public TimestampsAndPunctuatedWatermarksOperator(AssignerWithPunctuatedWatermarks<T> assigner)

Method Detail

processElement

public void processElement(StreamRecord<T> element)
                    throws Exception

Description copied from interface: OneInputStreamOperator

Processes one element that arrived at this operator. This method is guaranteed to not be called concurrently with other methods of the operator.

Specified by:

processElement in interface OneInputStreamOperator<T,T>

Throws:

Exception

processWatermark

public void processWatermark(Watermark mark)
                      throws Exception

Override the base implementation to completely ignore watermarks propagated from upstream (we rely only on the AssignerWithPunctuatedWatermarks to emit watermarks from here).

Specified by:

processWatermark in interface OneInputStreamOperator<T,T>

Overrides:

processWatermark in class AbstractStreamOperator<T>

Throws:

Exception

See Also:

Watermark