public class RowTimeMiniBatchAssginerOperator extends AbstractStreamOperator<RowData> implements OneInputStreamOperator<RowData,RowData>
For example, if this operator receives watermarks 0,1,2,3 ..., 19, 20, 21. The
downstream operator is a 5-size window aggregate, then the mini-batch interval is 5 (this is
inferred by rules). Then only 4, 9, 14, 19 will be forwarded, because they are the
watermarks trigger windows.
The difference between this operator and ProcTimeMiniBatchAssignerOperator is that,
this operator forwards watermarks from upstream, but the other generates watermarks by itself
using processing time.
chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService| Constructor and Description |
|---|
RowTimeMiniBatchAssginerOperator(long minibatchInterval) |
| Modifier and Type | Method and Description |
|---|---|
void |
finish()
This method is called at the end of data processing.
|
void |
open()
This method is called immediately before any elements are processed, it should contain the
operator's initialization logic, e.g.
|
void |
processElement(StreamRecord<RowData> element)
Processes one element that arrived on this input of the
MultipleInputStreamOperator. |
void |
processWatermark(Watermark mark)
Processes a
Watermark that arrived on the first input of this two-input operator. |
close, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotStateclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitsetKeyContextElementclose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotStatenotifyCheckpointAborted, notifyCheckpointCompletegetCurrentKey, setCurrentKeyprocessLatencyMarker, processWatermarkStatushasKeyContextpublic RowTimeMiniBatchAssginerOperator(long minibatchInterval)
public void open()
throws Exception
AbstractStreamOperatorThe default implementation does nothing.
open in interface StreamOperator<RowData>open in class AbstractStreamOperator<RowData>Exception - An exception in this method causes the operator to fail.public void processElement(StreamRecord<RowData> element) throws Exception
InputMultipleInputStreamOperator.
This method is guaranteed to not be called concurrently with other methods of the operator.processElement in interface Input<RowData>Exceptionpublic void processWatermark(Watermark mark) throws Exception
InputWatermark that arrived on the first input of this two-input operator.
This method is guaranteed to not be called concurrently with other methods of the operator.processWatermark in interface Input<RowData>processWatermark in class AbstractStreamOperator<RowData>ExceptionWatermarkpublic void finish()
throws Exception
StreamOperatorThe method is expected to flush all remaining buffered data. Exceptions during this flushing of buffered data should be propagated, in order to cause the operation to be recognized as failed, because the last data items are not processed properly.
After this method is called, no more records can be produced for the downstream operators.
WARNING: It is not safe to use this method to commit any transactions or other side
effects! You can use this method to flush any buffered data that can later on be committed
e.g. in a CheckpointListener.notifyCheckpointComplete(long).
NOTE:This method does not need to close any resources. You should release external
resources in the StreamOperator.close() method.
finish in interface StreamOperator<RowData>finish in class AbstractStreamOperator<RowData>Exception - An exception in this method causes the operator to fail.Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.