org.apache.flink.api.java.hadoop.mapred

Class HadoopOutputFormat<K,V>

java.lang.Object

org.apache.flink.api.common.io.RichOutputFormat<T>

org.apache.flink.api.java.hadoop.common.HadoopOutputFormatCommonBase<T>

org.apache.flink.api.java.hadoop.mapred.HadoopOutputFormatBase<K,V,Tuple2<K,V>>

org.apache.flink.api.java.hadoop.mapred.HadoopOutputFormat<K,V>

Type Parameters:

K - Type of the key

V - Type of the value.

All Implemented Interfaces:

Serializable, FinalizeOnMaster, OutputFormat<Tuple2<K,V>>

@Public
public class HadoopOutputFormat<K,V>
extends HadoopOutputFormatBase<K,V,Tuple2<K,V>>

Wrapper for using HadoopOutputFormats (mapred-variant) with Flink.

The IF is returning a Tuple2<K,V>.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.api.common.io.FinalizeOnMaster

FinalizeOnMaster.FinalizationContext

Nested classes/interfaces inherited from interface org.apache.flink.api.common.io.OutputFormat

OutputFormat.InitializationContext

Field Summary

Fields inherited from class org.apache.flink.api.java.hadoop.mapred.HadoopOutputFormatBase

CLOSE_MUTEX, CONFIGURE_MUTEX, context, jobConf, mapredOutputFormat, OPEN_MUTEX, outputCommitter, recordWriter

Fields inherited from class org.apache.flink.api.java.hadoop.common.HadoopOutputFormatCommonBase

credentials

Constructor Summary

Constructors

Constructor and Description
HadoopOutputFormat(org.apache.hadoop.mapred.OutputFormat<K,V> mapredOutputFormat, Class<org.apache.hadoop.mapred.OutputCommitter> outputCommitterClass, org.apache.hadoop.mapred.JobConf job)
HadoopOutputFormat(org.apache.hadoop.mapred.OutputFormat<K,V> mapredOutputFormat, org.apache.hadoop.mapred.JobConf job)

Method Summary

Modifier and Type	Method and Description
void	writeRecord(Tuple2<K,V> record) Adds a record to the output.

Methods inherited from class org.apache.flink.api.java.hadoop.mapred.HadoopOutputFormatBase

close, configure, finalizeGlobal, getJobConf, open

Methods inherited from class org.apache.flink.api.java.hadoop.common.HadoopOutputFormatCommonBase

read, write

Methods inherited from class org.apache.flink.api.common.io.RichOutputFormat

getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.io.FinalizeOnMaster

finalizeGlobal

Methods inherited from interface org.apache.flink.api.common.io.OutputFormat

open

Constructor Detail

HadoopOutputFormat

public HadoopOutputFormat(org.apache.hadoop.mapred.OutputFormat<K,V> mapredOutputFormat,
                          org.apache.hadoop.mapred.JobConf job)

HadoopOutputFormat

public HadoopOutputFormat(org.apache.hadoop.mapred.OutputFormat<K,V> mapredOutputFormat,
                          Class<org.apache.hadoop.mapred.OutputCommitter> outputCommitterClass,
                          org.apache.hadoop.mapred.JobConf job)

Method Detail

writeRecord

public void writeRecord(Tuple2<K,V> record)
                 throws IOException

Description copied from interface: OutputFormat

Adds a record to the output.

When this method is called, the output format it guaranteed to be opened.

Parameters:

record - The records to add to the output.

Throws:

IOException - Thrown, if the records could not be added due to an I/O problem.