@Internal public class RowDataPythonTableFunctionOperator extends AbstractPythonTableFunctionOperator<RowData,RowData,RowData>
TableFunction
operator for the blink planner.AbstractStatelessFunctionOperator.StreamRecordCRowWrappingCollector, AbstractStatelessFunctionOperator.StreamRecordRowDataWrappingCollector
joinType, tableFunction
bais, baisWrapper, forwardedInputQueue, inputType, outputType, userDefinedFunctionInputOffsets, userDefinedFunctionInputType, userDefinedFunctionOutputType, userDefinedFunctionResultQueue
chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService
Constructor and Description |
---|
RowDataPythonTableFunctionOperator(Configuration config,
PythonFunctionInfo tableFunction,
RowType inputType,
RowType outputType,
int[] udtfInputOffsets,
org.apache.calcite.rel.core.JoinRelType joinType) |
Modifier and Type | Method and Description |
---|---|
void |
bufferInput(RowData input)
Buffers the specified input, it will be used to construct the operator result together with
the user-defined function execution result.
|
PythonFunctionRunner<RowData> |
createPythonFunctionRunner(org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonEnvironmentManager pythonEnvironmentManager,
Map<String,String> jobOptions) |
void |
emitResults()
Sends the execution results to the downstream operator.
|
RowData |
getFunctionInput(RowData element) |
void |
open()
This method is called immediately before any elements are processed, it should contain the
operator's initialization logic, e.g.
|
getPythonEnv, isFinishResult
createPythonFunctionRunner, processElement
close, createPythonEnvironmentManager, dispose, endInput, getFlinkMetricContainer, getPythonConfig, prepareSnapshotPreBarrier, processWatermark
getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, numEventTimeTimers, numProcessingTimeTimers, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
processLatencyMarker
getMetricGroup, getOperatorID, initializeState, setKeyContextElement1, setKeyContextElement2, snapshotState
notifyCheckpointAborted, notifyCheckpointComplete
getCurrentKey, setCurrentKey
public RowDataPythonTableFunctionOperator(Configuration config, PythonFunctionInfo tableFunction, RowType inputType, RowType outputType, int[] udtfInputOffsets, org.apache.calcite.rel.core.JoinRelType joinType)
public void open() throws Exception
AbstractStreamOperator
The default implementation does nothing.
open
in interface StreamOperator<RowData>
open
in class AbstractPythonTableFunctionOperator<RowData,RowData,RowData>
Exception
- An exception in this method causes the operator to fail.public void bufferInput(RowData input)
AbstractStatelessFunctionOperator
bufferInput
in class AbstractStatelessFunctionOperator<RowData,RowData,RowData>
public RowData getFunctionInput(RowData element)
getFunctionInput
in class AbstractStatelessFunctionOperator<RowData,RowData,RowData>
public PythonFunctionRunner<RowData> createPythonFunctionRunner(org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver, PythonEnvironmentManager pythonEnvironmentManager, Map<String,String> jobOptions)
createPythonFunctionRunner
in class AbstractStatelessFunctionOperator<RowData,RowData,RowData>
public void emitResults() throws IOException
AbstractPythonFunctionOperator
emitResults
in class AbstractPythonFunctionOperator<RowData,RowData>
IOException
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.