org.apache.flink.ml.common.utils

Class DataStreamConversionUtil

java.lang.Object

org.apache.flink.ml.common.utils.DataStreamConversionUtil

public class DataStreamConversionUtil
extends Object

Provide functions of conversions between DataStream and Table.

Constructor Summary

Constructors

Constructor and Description
DataStreamConversionUtil()

Method Summary

Modifier and Type	Method and Description
static DataStream<Row>	fromTable(Long sessionId, Table table) Convert the given Table to DataStream<Row>.
static Table	toTable(Long sessionId, DataStream<Row> data, String[] colNames) Convert the given DataStream to Table with specified colNames.
static Table	toTable(Long sessionId, DataStream<Row> data, String[] colNames, TypeInformation<?>[] colTypes) Convert the given DataStream to Table with specified colNames and colTypes.
static Table	toTable(Long sessionId, DataStream<Row> data, TableSchema schema) Convert the given DataStream to Table with specified TableSchema.
static Table	toTable(MLEnvironment session, DataStream<Row> data, String[] colNames) Convert the given DataStream to Table with specified colNames.
static Table	toTable(MLEnvironment session, DataStream<Row> data, String[] colNames, TypeInformation<?>[] colTypes) Convert the given DataStream to Table with specified colNames and colTypes.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataStreamConversionUtil

public DataStreamConversionUtil()

Method Detail

fromTable

public static DataStream<Row> fromTable(Long sessionId,
                                        Table table)

Convert the given Table to DataStream<Row>.

Parameters:

sessionId - the sessionId of MLEnvironmentFactory

table - the Table to convert.

Returns:

the converted DataStream.

toTable

public static Table toTable(Long sessionId,
                            DataStream<Row> data,
                            TableSchema schema)

Convert the given DataStream to Table with specified TableSchema.

Parameters:

sessionId - the sessionId of MLEnvironmentFactory

data - the DataStream to convert.

schema - the specified TableSchema.

Returns:

the converted Table.

toTable

public static Table toTable(Long sessionId,
                            DataStream<Row> data,
                            String[] colNames)

Convert the given DataStream to Table with specified colNames.

Parameters:

sessionId - sessionId the sessionId of MLEnvironmentFactory.

data - the DataStream to convert.

colNames - the specified colNames.

Returns:

the converted Table.

toTable

public static Table toTable(Long sessionId,
                            DataStream<Row> data,
                            String[] colNames,
                            TypeInformation<?>[] colTypes)

Convert the given DataStream to Table with specified colNames and colTypes.

Parameters:

sessionId - sessionId the sessionId of MLEnvironmentFactory.

data - the DataStream to convert.

colNames - the specified colNames.

colTypes - the specified colTypes. This variable is used only when the DataStream is produced by a function and Flink cannot determine automatically what the produced type is.

Returns:

the converted Table.

toTable

public static Table toTable(MLEnvironment session,
                            DataStream<Row> data,
                            String[] colNames)

Convert the given DataStream to Table with specified colNames.

Parameters:

session - the MLEnvironment using to convert DataStream to Table.

data - the DataStream to convert.

colNames - the specified colNames.

Returns:

the converted Table.

toTable

public static Table toTable(MLEnvironment session,
                            DataStream<Row> data,
                            String[] colNames,
                            TypeInformation<?>[] colTypes)

Convert the given DataStream to Table with specified colNames and colTypes.

Parameters:

session - the MLEnvironment using to convert DataStream to Table.

data - the DataStream to convert.

colNames - the specified colNames.

colTypes - the specified colTypes. This variable is used only when the DataStream is produced by a function and Flink cannot determine automatically what the produced type is.

Returns:

the converted Table.