org.apache.flink.streaming.api.runners.python.beam

Class BeamDataStreamPythonFunctionRunner

java.lang.Object

org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner

org.apache.flink.streaming.api.runners.python.beam.BeamDataStreamPythonFunctionRunner

All Implemented Interfaces:

PythonFunctionRunner

@Internal
public class BeamDataStreamPythonFunctionRunner
extends BeamPythonFunctionRunner

BeamDataStreamPythonFunctionRunner is responsible for starting a beam python harness to execute user defined python function.

Field Summary

Fields inherited from class org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner

LOG, mainInputReceiver, resultBuffer, resultTuple

Constructor Summary

Constructors

Constructor and Description

BeamDataStreamPythonFunctionRunner(String taskName, PythonEnvironmentManager environmentManager, TypeInformation inputType, TypeInformation outputType, String functionUrn, FlinkFnApi.UserDefinedDataStreamFunction userDefinedDataStreamFunction, String coderUrn, Map<String,String> jobOptions, FlinkMetricContainer flinkMetricContainer, KeyedStateBackend stateBackend, TypeSerializer keySerializer, MemoryManager memoryManager, double managedMemoryFraction)

Method Summary

Modifier and Type	Method and Description
protected org.apache.beam.model.pipeline.v1.RunnerApi.Coder	getInputCoderProto()
protected org.apache.beam.model.pipeline.v1.RunnerApi.Coder	getOutputCoderProto()
protected byte[]	getUserDefinedFunctionsProtoBytes()

Methods inherited from class org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner

close, createJobBundleFactory, flush, open, pollResult, process, startBundle

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamDataStreamPythonFunctionRunner

public BeamDataStreamPythonFunctionRunner(String taskName,
                                          PythonEnvironmentManager environmentManager,
                                          TypeInformation inputType,
                                          TypeInformation outputType,
                                          String functionUrn,
                                          FlinkFnApi.UserDefinedDataStreamFunction userDefinedDataStreamFunction,
                                          String coderUrn,
                                          Map<String,String> jobOptions,
                                          @Nullable
                                          FlinkMetricContainer flinkMetricContainer,
                                          KeyedStateBackend stateBackend,
                                          TypeSerializer keySerializer,
                                          MemoryManager memoryManager,
                                          double managedMemoryFraction)

Method Detail

getUserDefinedFunctionsProtoBytes

protected byte[] getUserDefinedFunctionsProtoBytes()

Specified by:

getUserDefinedFunctionsProtoBytes in class BeamPythonFunctionRunner

getInputCoderProto

protected org.apache.beam.model.pipeline.v1.RunnerApi.Coder getInputCoderProto()

Specified by:

getInputCoderProto in class BeamPythonFunctionRunner

getOutputCoderProto

protected org.apache.beam.model.pipeline.v1.RunnerApi.Coder getOutputCoderProto()

Specified by:

getOutputCoderProto in class BeamPythonFunctionRunner