public class SinkOperator extends AbstractUdfStreamOperator<Object,SinkFunction<RowData>> implements OneInputStreamOperator<RowData,Object>
StreamOperator
for executing SinkFunctions
. This operator also
checks writing null values into NOT NULL columns.userFunction
chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService
Constructor and Description |
---|
SinkOperator(SinkFunction<RowData> sinkFunction,
int rowtimeFieldIndex,
ExecutionConfigOptions.NotNullEnforcer notNullEnforcer,
int[] notNullFieldIndices,
String[] allFieldNames) |
Modifier and Type | Method and Description |
---|---|
void |
open()
This method is called immediately before any elements are processed, it should contain the
operator's initialization logic, e.g.
|
void |
processElement(StreamRecord<RowData> element)
Processes one element that arrived at this operator.
|
void |
processWatermark(Watermark mark)
Processes a
Watermark . |
protected void |
reportOrForwardLatencyMarker(LatencyMarker marker) |
close, dispose, getUserFunction, getUserFunctionParameters, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, setOutputType, setup, snapshotState
getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, isUsingCustomRawKeyedState, numEventTimeTimers, numProcessingTimeTimers, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, snapshotState
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
processLatencyMarker
close, dispose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState
notifyCheckpointAborted, notifyCheckpointComplete
getCurrentKey, setCurrentKey
public SinkOperator(SinkFunction<RowData> sinkFunction, int rowtimeFieldIndex, ExecutionConfigOptions.NotNullEnforcer notNullEnforcer, int[] notNullFieldIndices, String[] allFieldNames)
public void open() throws Exception
AbstractStreamOperator
The default implementation does nothing.
open
in interface StreamOperator<Object>
open
in class AbstractUdfStreamOperator<Object,SinkFunction<RowData>>
Exception
- An exception in this method causes the operator to fail.public void processElement(StreamRecord<RowData> element) throws Exception
OneInputStreamOperator
processElement
in interface OneInputStreamOperator<RowData,Object>
Exception
protected void reportOrForwardLatencyMarker(LatencyMarker marker)
reportOrForwardLatencyMarker
in class AbstractStreamOperator<Object>
public void processWatermark(Watermark mark) throws Exception
OneInputStreamOperator
Watermark
. This method is guaranteed to not be called concurrently with
other methods of the operator.processWatermark
in interface OneInputStreamOperator<RowData,Object>
processWatermark
in class AbstractStreamOperator<Object>
Exception
Watermark
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.