org.apache.flink.api.java.hadoop.mapreduce

Class HadoopInputFormat<K,V>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<T,SPITTYPE>

org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<T,HadoopInputSplit>

org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase<K,V,Tuple2<K,V>>

org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormat<K,V>

Type Parameters:

K - Key Type

V - Value Type

All Implemented Interfaces:

Serializable, InputFormat<Tuple2<K,V>,HadoopInputSplit>, ResultTypeQueryable<Tuple2<K,V>>, InputSplitSource<HadoopInputSplit>

@Public
public class HadoopInputFormat<K,V>
extends HadoopInputFormatBase<K,V,Tuple2<K,V>>
implements ResultTypeQueryable<Tuple2<K,V>>

InputFormat implementation allowing to use Hadoop (mapreduce) InputFormats with Flink.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase

fetched, hasNext, keyClass, recordReader, valueClass

Fields inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

credentials

Constructor Summary

Constructors

Constructor and Description
HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value)
HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapreduce.Job job)

Method Summary

Modifier and Type	Method and Description
TypeInformation<Tuple2<K,V>>	getProducedType() Gets the data type (as a TypeInformation) produced by this function or input format.
Tuple2<K,V>	nextRecord(Tuple2<K,V> record) Reads the next record from the input.

Methods inherited from class org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase

close, configure, createInputSplits, fetchNext, getConfiguration, getInputSplitAssigner, getStatistics, open, reachedEnd

Methods inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

getCredentialsFromUGI, read, write

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
                         Class<K> key,
                         Class<V> value,
                         org.apache.hadoop.mapreduce.Job job)

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
                         Class<K> key,
                         Class<V> value)
                  throws IOException

Throws:

IOException

Method Detail

nextRecord

public Tuple2<K,V> nextRecord(Tuple2<K,V> record)
                       throws IOException

Description copied from interface: InputFormat

Reads the next record from the input.

When this method is called, the input format it guaranteed to be opened.

Specified by:

nextRecord in interface InputFormat<Tuple2<K,V>,HadoopInputSplit>

Parameters:

record - Object that may be reused.

Returns:

Read record.

Throws:

IOException - Thrown, if an I/O error occurred.

getProducedType

public TypeInformation<Tuple2<K,V>> getProducedType()

Description copied from interface: ResultTypeQueryable

Gets the data type (as a TypeInformation) produced by this function or input format.

Specified by:

getProducedType in interface ResultTypeQueryable<Tuple2<K,V>>

Returns:

The data type produced by this function or input format.