T
- The type of the input elementspublic class TimestampsAndPeriodicWatermarksOperator<T> extends AbstractUdfStreamOperator<T,AssignerWithPeriodicWatermarks<T>> implements OneInputStreamOperator<T,T>, ProcessingTimeCallback
AbstractStreamOperator.CountingOutput, AbstractStreamOperator.LatencyGauge
userFunction
chainingStrategy, config, latencyGauge, LOG, metrics, output
Constructor and Description |
---|
TimestampsAndPeriodicWatermarksOperator(AssignerWithPeriodicWatermarks<T> assigner) |
Modifier and Type | Method and Description |
---|---|
void |
close()
This method is called after all records have been added to the operators via the methods
OneInputStreamOperator.processElement(StreamRecord) , or
TwoInputStreamOperator.processElement1(StreamRecord) and
TwoInputStreamOperator.processElement2(StreamRecord) . |
void |
onProcessingTime(long timestamp)
This method is invoked with the timestamp for which the trigger was scheduled.
|
void |
open()
This method is called immediately before any elements are processed, it should contain the
operator's initialization logic, e.g.
|
void |
processElement(StreamRecord<T> element)
Processes one element that arrived at this operator.
|
void |
processWatermark(Watermark mark)
Override the base implementation to completely ignore watermarks propagated from
upstream (we rely only on the
AssignerWithPeriodicWatermarks to emit
watermarks from here). |
dispose, getUserFunction, getUserFunctionParameters, initializeState, notifyOfCompletedCheckpoint, restoreState, setOutputType, setup, snapshotState, snapshotState
getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getUserCodeClassloader, initializeState, numEventTimeTimers, numProcessingTimeTimers, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, snapshotLegacyOperatorState, snapshotState
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
processLatencyMarker
dispose, getChainingStrategy, getMetricGroup, initializeState, notifyOfCompletedCheckpoint, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setup, snapshotLegacyOperatorState, snapshotState
public TimestampsAndPeriodicWatermarksOperator(AssignerWithPeriodicWatermarks<T> assigner)
public void open() throws Exception
AbstractStreamOperator
The default implementation does nothing.
open
in interface StreamOperator<T>
open
in class AbstractUdfStreamOperator<T,AssignerWithPeriodicWatermarks<T>>
Exception
- An exception in this method causes the operator to fail.public void processElement(StreamRecord<T> element) throws Exception
OneInputStreamOperator
processElement
in interface OneInputStreamOperator<T,T>
Exception
public void onProcessingTime(long timestamp) throws Exception
ProcessingTimeCallback
If the triggering is delayed for whatever reason (trigger timer was blocked, JVM stalled due to a garbage collection), the timestamp supplied to this function will still be the original timestamp for which the trigger was scheduled.
onProcessingTime
in interface ProcessingTimeCallback
timestamp
- The timestamp for which the trigger event was scheduled.Exception
public void processWatermark(Watermark mark) throws Exception
AssignerWithPeriodicWatermarks
to emit
watermarks from here).processWatermark
in interface OneInputStreamOperator<T,T>
processWatermark
in class AbstractStreamOperator<T>
Exception
Watermark
public void close() throws Exception
AbstractStreamOperator
OneInputStreamOperator.processElement(StreamRecord)
, or
TwoInputStreamOperator.processElement1(StreamRecord)
and
TwoInputStreamOperator.processElement2(StreamRecord)
.
The method is expected to flush all remaining buffered data. Exceptions during this flushing of buffered should be propagated, in order to cause the operation to be recognized asa failed, because the last data items are not processed properly.
close
in interface StreamOperator<T>
close
in class AbstractUdfStreamOperator<T,AssignerWithPeriodicWatermarks<T>>
Exception
- An exception in this method causes the operator to fail.Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.