org.apache.flink.python.api.streaming.data

Class PythonReceiver<OUT>

java.lang.Object

org.apache.flink.python.api.streaming.data.PythonReceiver<OUT>

All Implemented Interfaces:

Serializable

public class PythonReceiver<OUT>
extends Object
implements Serializable

This class is used to read data from memory-mapped files.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PythonReceiver(Configuration config, boolean usesByteArray)

Method Summary

Modifier and Type	Method and Description
void	close()
void	collectBuffer(Collector<OUT> c, int bufferSize) Reads a buffer of the given size from the memory-mapped file, and collects all records contained.
static Tuple	createTuple(int size)
void	open(File inputFile)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PythonReceiver

public PythonReceiver(Configuration config,
                      boolean usesByteArray)

Method Detail

open

public void open(File inputFile)
          throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Throws:

IOException

collectBuffer

public void collectBuffer(Collector<OUT> c,
                          int bufferSize)
                   throws IOException

Reads a buffer of the given size from the memory-mapped file, and collects all records contained. This method assumes that all values in the buffer are of the same type. This method does NOT take care of synchronization. The user must guarantee that the buffer was completely written before calling this method.

Parameters:

c - Collector to collect records

bufferSize - size of the buffer

Throws:

IOException

createTuple

public static Tuple createTuple(int size)