org.apache.flink.python.util

Class PythonConfigUtil

java.lang.Object

org.apache.flink.python.util.PythonConfigUtil

public class PythonConfigUtil
extends Object

A Util class to handle the configurations of Python jobs.

Field Summary

Fields

Modifier and Type	Field and Description
static String	KEYED_STREAM_VALUE_OPERATOR_NAME
static String	STREAM_KEY_BY_MAP_OPERATOR_NAME
static String	STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

Constructor Summary

Constructors

Constructor and Description
PythonConfigUtil()

Method Summary

Modifier and Type	Method and Description
static void	configPythonOperator(StreamExecutionEnvironment env)
static List<MapStateDescriptor<ByteArrayWrapper,byte[]>>	convertStateNamesToStateDescriptors(String[] names)
static SingleOutputStreamOperator<?>	createSingleOutputStreamOperator(StreamExecutionEnvironment env, Transformation<?> transformation)
static Configuration	extractPythonConfiguration(List<Tuple2<String,DistributedCache.DistributedCacheEntry>> cachedFiles, ReadableConfig config) Extract the configurations which is used in the Python operators.
static Configuration	getEnvironmentConfig(StreamExecutionEnvironment env)
static StreamOperatorFactory<?>	getOperatorFactory(Transformation<?> transform)
static boolean	isPythonDataStreamOperator(Transformation<?> transform)
static void	registerPythonBroadcastTransformationTranslator()
static void	setPartitionCustomOperatorNumPartitions(List<Transformation<?>> transformations)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

KEYED_STREAM_VALUE_OPERATOR_NAME

public static final String KEYED_STREAM_VALUE_OPERATOR_NAME

See Also:

Constant Field Values

STREAM_KEY_BY_MAP_OPERATOR_NAME

public static final String STREAM_KEY_BY_MAP_OPERATOR_NAME

See Also:

Constant Field Values

STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

public static final String STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

See Also:

Constant Field Values

Constructor Detail

PythonConfigUtil

public PythonConfigUtil()

Method Detail

getEnvironmentConfig

public static Configuration getEnvironmentConfig(StreamExecutionEnvironment env)

configPythonOperator

public static void configPythonOperator(StreamExecutionEnvironment env)
                                 throws Exception

Throws:

Exception

extractPythonConfiguration

public static Configuration extractPythonConfiguration(List<Tuple2<String,DistributedCache.DistributedCacheEntry>> cachedFiles,
                                                       ReadableConfig config)

Extract the configurations which is used in the Python operators.

getOperatorFactory

public static StreamOperatorFactory<?> getOperatorFactory(Transformation<?> transform)

isPythonDataStreamOperator

public static boolean isPythonDataStreamOperator(Transformation<?> transform)

setPartitionCustomOperatorNumPartitions

public static void setPartitionCustomOperatorNumPartitions(List<Transformation<?>> transformations)

convertStateNamesToStateDescriptors

public static List<MapStateDescriptor<ByteArrayWrapper,byte[]>> convertStateNamesToStateDescriptors(String[] names)

registerPythonBroadcastTransformationTranslator

public static void registerPythonBroadcastTransformationTranslator()
                                                            throws Exception

Throws:

Exception

createSingleOutputStreamOperator

public static SingleOutputStreamOperator<?> createSingleOutputStreamOperator(StreamExecutionEnvironment env,
                                                                             Transformation<?> transformation)
                                                                      throws Exception

Throws:

Exception