org.apache.flink.orc.writer

Class OrcBulkWriterFactory<T>

java.lang.Object

org.apache.flink.orc.writer.OrcBulkWriterFactory<T>

Type Parameters:

T - The type of element to write.

All Implemented Interfaces:

Serializable, BulkWriter.Factory<T>

@PublicEvolving
public class OrcBulkWriterFactory<T>
extends Object
implements BulkWriter.Factory<T>

A factory that creates an ORC BulkWriter. The factory takes a user supplied Vectorizer implementation to convert the element into an VectorizedRowBatch.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
OrcBulkWriterFactory(Vectorizer<T> vectorizer) Creates a new OrcBulkWriterFactory using the provided Vectorizer implementation.
OrcBulkWriterFactory(Vectorizer<T> vectorizer, Configuration configuration) Creates a new OrcBulkWriterFactory using the provided Vectorizer, Hadoop Configuration.
OrcBulkWriterFactory(Vectorizer<T> vectorizer, Properties writerProperties, Configuration configuration) Creates a new OrcBulkWriterFactory using the provided Vectorizer, Hadoop Configuration, ORC writer properties.

Method Summary

Modifier and Type	Method and Description
BulkWriter<T>	create(FSDataOutputStream out) Creates a writer that writes to the given stream.
protected org.apache.orc.OrcFile.WriterOptions	getWriterOptions()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

OrcBulkWriterFactory

public OrcBulkWriterFactory(Vectorizer<T> vectorizer)

Creates a new OrcBulkWriterFactory using the provided Vectorizer implementation.

Parameters:

vectorizer - The vectorizer implementation to convert input record to a VectorizerRowBatch.

OrcBulkWriterFactory

public OrcBulkWriterFactory(Vectorizer<T> vectorizer,
                            Configuration configuration)

Creates a new OrcBulkWriterFactory using the provided Vectorizer, Hadoop Configuration.

Parameters:

vectorizer - The vectorizer implementation to convert input record to a VectorizerRowBatch.

OrcBulkWriterFactory

public OrcBulkWriterFactory(Vectorizer<T> vectorizer,
                            Properties writerProperties,
                            Configuration configuration)

Creates a new OrcBulkWriterFactory using the provided Vectorizer, Hadoop Configuration, ORC writer properties.

Parameters:

vectorizer - The vectorizer implementation to convert input record to a VectorizerRowBatch.

writerProperties - Properties that can be used in ORC WriterOptions.

Method Detail

create

public BulkWriter<T> create(FSDataOutputStream out)
                     throws IOException

Description copied from interface: BulkWriter.Factory

Creates a writer that writes to the given stream.

Specified by:

create in interface BulkWriter.Factory<T>

Parameters:

out - The output stream to write the encoded data to.

Throws:

IOException - Thrown if the writer cannot be opened, or if the output stream throws an exception.

getWriterOptions

@VisibleForTesting
protected org.apache.orc.OrcFile.WriterOptions getWriterOptions()