org.apache.flink.formats.sequencefile

Class SequenceFileWriterFactory<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.flink.formats.sequencefile.SequenceFileWriterFactory<K,V>

Type Parameters:

K - The type of key to write. It should be writable.

V - The type of value to write. It should be writable.

All Implemented Interfaces:

Serializable, BulkWriter.Factory<Tuple2<K,V>>

@PublicEvolving
public class SequenceFileWriterFactory<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>
extends Object
implements BulkWriter.Factory<Tuple2<K,V>>

A factory that creates a SequenceFile BulkWriter.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static String	NO_COMPRESSION A constant specifying that no compression is requested.

Constructor Summary

Constructors

Constructor and Description
SequenceFileWriterFactory(org.apache.hadoop.conf.Configuration hadoopConf, Class<K> keyClass, Class<V> valueClass) Creates a new SequenceFileWriterFactory using the given builder to assemble the SequenceFileWriter.
SequenceFileWriterFactory(org.apache.hadoop.conf.Configuration hadoopConf, Class<K> keyClass, Class<V> valueClass, String compressionCodecName) Creates a new SequenceFileWriterFactory using the given builder to assemble the SequenceFileWriter.
SequenceFileWriterFactory(org.apache.hadoop.conf.Configuration hadoopConf, Class<K> keyClass, Class<V> valueClass, String compressionCodecName, org.apache.hadoop.io.SequenceFile.CompressionType compressionType) Creates a new SequenceFileWriterFactory using the given builder to assemble the SequenceFileWriter.

Method Summary

Modifier and Type	Method and Description
SequenceFileWriter<K,V>	create(FSDataOutputStream out) Creates a writer that writes to the given stream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NO_COMPRESSION

public static final String NO_COMPRESSION

A constant specifying that no compression is requested.

See Also:

Constant Field Values

Constructor Detail

SequenceFileWriterFactory

public SequenceFileWriterFactory(org.apache.hadoop.conf.Configuration hadoopConf,
                                 Class<K> keyClass,
                                 Class<V> valueClass)

Creates a new SequenceFileWriterFactory using the given builder to assemble the SequenceFileWriter.

Parameters:

hadoopConf - The Hadoop configuration for Sequence File Writer.

keyClass - The class of key to write.

valueClass - The class of value to write.

SequenceFileWriterFactory

public SequenceFileWriterFactory(org.apache.hadoop.conf.Configuration hadoopConf,
                                 Class<K> keyClass,
                                 Class<V> valueClass,
                                 String compressionCodecName)

Creates a new SequenceFileWriterFactory using the given builder to assemble the SequenceFileWriter.

Parameters:

hadoopConf - The Hadoop configuration for Sequence File Writer.

keyClass - The class of key to write.

valueClass - The class of value to write.

compressionCodecName - The name of compression codec.

SequenceFileWriterFactory

public SequenceFileWriterFactory(org.apache.hadoop.conf.Configuration hadoopConf,
                                 Class<K> keyClass,
                                 Class<V> valueClass,
                                 String compressionCodecName,
                                 org.apache.hadoop.io.SequenceFile.CompressionType compressionType)

Creates a new SequenceFileWriterFactory using the given builder to assemble the SequenceFileWriter.

Parameters:

hadoopConf - The Hadoop configuration for Sequence File Writer.

keyClass - The class of key to write.

valueClass - The class of value to write.

compressionCodecName - The name of compression codec.

compressionType - The type of compression level.

Method Detail

create

public SequenceFileWriter<K,V> create(FSDataOutputStream out)
                               throws IOException

Description copied from interface: BulkWriter.Factory

Creates a writer that writes to the given stream.

Specified by:

create in interface BulkWriter.Factory<Tuple2<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>>

Parameters:

out - The output stream to write the encoded data to.

Throws:

IOException - Thrown if the writer cannot be opened, or if the output stream throws an exception.