org.apache.flink.python.api.functions

Class PythonMapPartition<IN,OUT>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.api.common.functions.RichMapPartitionFunction<IN,OUT>

org.apache.flink.python.api.functions.PythonMapPartition<IN,OUT>

Type Parameters:

IN -

OUT -

All Implemented Interfaces:

Serializable, Function, MapPartitionFunction<IN,OUT>, RichFunction, ResultTypeQueryable

public class PythonMapPartition<IN,OUT>
extends RichMapPartitionFunction<IN,OUT>
implements ResultTypeQueryable

Multi-purpose class, usable by all operations using a python script with one input source and possibly differing in-/output types.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PythonMapPartition(int id, TypeInformation<OUT> typeInformation)

Method Summary

Modifier and Type	Method and Description
void	close() Closes this function.
TypeInformation<OUT>	getProducedType() Gets the data type (as a TypeInformation) produced by this function or input format.
void	mapPartition(Iterable<IN> values, Collector<OUT> out) A user-implemented function that modifies or transforms an incoming object.
void	open(Configuration config) Opens this function.

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PythonMapPartition

public PythonMapPartition(int id,
                          TypeInformation<OUT> typeInformation)

Method Detail

open

public void open(Configuration config)
          throws IOException

Opens this function.

Specified by:

open in interface RichFunction

Overrides:

open in class AbstractRichFunction

Parameters:

config - configuration

Throws:

IOException

See Also:

Configuration

mapPartition

public void mapPartition(Iterable<IN> values,
                         Collector<OUT> out)
                  throws Exception

Description copied from interface: MapPartitionFunction

A user-implemented function that modifies or transforms an incoming object.

Specified by:

mapPartition in interface MapPartitionFunction<IN,OUT>

Specified by:

mapPartition in class RichMapPartitionFunction<IN,OUT>

Parameters:

values - All records for the mapper

out - The collector to hand results to.

Throws:

Exception

close

public void close()
           throws IOException

Closes this function.

Specified by:

close in interface RichFunction

Overrides:

close in class AbstractRichFunction

Throws:

IOException

getProducedType

public TypeInformation<OUT> getProducedType()

Description copied from interface: ResultTypeQueryable

Gets the data type (as a TypeInformation) produced by this function or input format.

Specified by:

getProducedType in interface ResultTypeQueryable

Returns:

The data type produced by this function or input format.