@Internal public class ArrowPythonScalarFunctionRunner extends AbstractArrowPythonScalarFunctionRunner<Row>
PythonFunctionRunner
used to execute Arrow Python ScalarFunction
s. It takes
Row
as the input type.root
baos, baosWrapper, flinkMetricContainer, mainInputReceiver, resultReceiver
Constructor and Description |
---|
ArrowPythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
int maxArrowBatchSize,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
Modifier and Type | Method and Description |
---|---|
ArrowWriter<Row> |
createArrowWriter()
Creates an
ArrowWriter . |
close, createOutputReceiverFactory, finishBundle, getInputOutputCoderUrn, open, processElement
getUserDefinedFunctionsProto
createExecutableStage, getInputType, getOutputType, getUserDefinedFunctionProto
createJobBundleFactory, createPythonExecutionEnvironment, startBundle
public ArrowPythonScalarFunctionRunner(String taskName, org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver, PythonFunctionInfo[] scalarFunctions, PythonEnvironmentManager environmentManager, RowType inputType, RowType outputType, int maxArrowBatchSize, Map<String,String> jobOptions, FlinkMetricContainer flinkMetricContainer)
public ArrowWriter<Row> createArrowWriter()
AbstractArrowPythonScalarFunctionRunner
ArrowWriter
.createArrowWriter
in class AbstractArrowPythonScalarFunctionRunner<Row>
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.