org.apache.flink.streaming.api.utils

Class PythonTypeUtils

java.lang.Object

org.apache.flink.streaming.api.utils.PythonTypeUtils

@Internal
public class PythonTypeUtils
extends Object

A util class for converting the given TypeInformation to other objects.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	PythonTypeUtils.ArrayDataConverter<T> The element in the Object Array will be converted to the corresponding Data through element DataConverter.
static class	PythonTypeUtils.ByteDataConverter Python Long will be converted to Long in PemJa, so we need ByteDataConverter to convert Java Long to internal Byte.
static class	PythonTypeUtils.DataConverter<IN,OUT> Data Converter that converts the data to the format data which can be used in PemJa.
static class	PythonTypeUtils.FloatDataConverter Python Float will be converted to Double in PemJa, so we need FloatDataConverter to convert Java Double to internal Float.
static class	PythonTypeUtils.IdentityDataConverter<T> Identity data converter.
static class	PythonTypeUtils.IntDataConverter Python Long will be converted to Long in PemJa, so we need IntDataConverter to convert Java Long to internal Integer.
static class	PythonTypeUtils.ListDataConverter The element in the List will be converted to the corresponding Data through element DataConverter.
static class	PythonTypeUtils.MapDataConverter The key/value in the Map will be converted to the corresponding Data through key/value DataConverter.
static class	PythonTypeUtils.RowDataConverter Row Data will be converted to the Object Array [RowKind(as Long Object), Field Values(as Object Array)].
static class	PythonTypeUtils.RowDataDataConverter RowData Data will be converted to the Object Array [RowKind(as Long Object), Field Values(as Object Array)].
static class	PythonTypeUtils.ShortDataConverter Python Long will be converted to Long in PemJa, so we need ShortDataConverter to convert Java Long to internal Short.
static class	PythonTypeUtils.TupleDataConverter Tuple Data will be converted to the Object Array.
static class	PythonTypeUtils.TypeInfoToDataConverter Get DataConverter according to the given typeInformation.
static class	PythonTypeUtils.TypeInfoToProtoConverter Get coder proto according to the given type information.
static class	PythonTypeUtils.TypeInfoToSerializerConverter Get serializers according to the given typeInformation.

Constructor Summary

Constructors

Constructor and Description
PythonTypeUtils()

Method Summary

Modifier and Type	Method and Description
static <T> InputFormat<T,?>	getCollectionInputFormat(List<T> data, TypeInformation<T> dataType, ExecutionConfig config) Wrap the unpickled python data with an InputFormat.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PythonTypeUtils

public PythonTypeUtils()

Method Detail

getCollectionInputFormat

public static <T> InputFormat<T,?> getCollectionInputFormat(List<T> data,
                                                            TypeInformation<T> dataType,
                                                            ExecutionConfig config)

Wrap the unpickled python data with an InputFormat. It will be passed to StreamExecutionEnvironment.creatInput() to create an InputFormat later.

Parameters:

data - The unpickled python data.

dataType - The python data type.

config - The execution config used to create serializer.

Returns:

An InputFormat containing the python data.