org.apache.flink.api.java.io

Class ParallelIteratorInputFormat<T>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,GenericInputSplit>

org.apache.flink.api.common.io.GenericInputFormat<T>

org.apache.flink.api.java.io.ParallelIteratorInputFormat<T>

All Implemented Interfaces:

Serializable, InputFormat<T,GenericInputSplit>, InputSplitSource<GenericInputSplit>

@PublicEvolving
public class ParallelIteratorInputFormat<T>
extends GenericInputFormat<T>

An input format that generates data in parallel through a SplittableIterator.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.api.common.io.GenericInputFormat

partitionNumber

Constructor Summary

Constructors

Constructor and Description
ParallelIteratorInputFormat(SplittableIterator<T> iterator)

Method Summary

Modifier and Type	Method and Description
T	nextRecord(T reuse) Reads the next record from the input.
void	open(GenericInputSplit split) Opens a parallel instance of the input format to work on a split.
boolean	reachedEnd() Method used to check if the end of the input is reached.

Methods inherited from class org.apache.flink.api.common.io.GenericInputFormat

close, configure, createInputSplits, getInputSplitAssigner, getStatistics

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParallelIteratorInputFormat

public ParallelIteratorInputFormat(SplittableIterator<T> iterator)

Method Detail

open

public void open(GenericInputSplit split)
          throws IOException

Description copied from interface: InputFormat

Opens a parallel instance of the input format to work on a split.

When this method is called, the input format it guaranteed to be configured.

Specified by:

open in interface InputFormat<T,GenericInputSplit>

Overrides:

open in class GenericInputFormat<T>

Parameters:

split - The split to be opened.

Throws:

IOException - Thrown, if the spit could not be opened due to an I/O problem.

reachedEnd

public boolean reachedEnd()

Description copied from interface: InputFormat

Method used to check if the end of the input is reached.

When this method is called, the input format it guaranteed to be opened.

Returns:

True if the end is reached, otherwise false.

nextRecord

public T nextRecord(T reuse)

Description copied from interface: InputFormat

Reads the next record from the input.

When this method is called, the input format it guaranteed to be opened.

Parameters:

reuse - Object that may be reused.

Returns:

Read record.