org.apache.flink.connector.file.sink

Class FileSink.BulkFormatBuilder<IN,T extends FileSink.BulkFormatBuilder<IN,T>>

java.lang.Object

org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder<IN,T>

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

FileSink.DefaultBulkFormatBuilder

Enclosing class:

FileSink<IN>

@PublicEvolving
public static class FileSink.BulkFormatBuilder<IN,T extends FileSink.BulkFormatBuilder<IN,T>>
extends Object

A builder for configuring the sink for bulk-encoding formats, e.g. Parquet/ORC.

See Also:

Serialized Form

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	BulkFormatBuilder(Path basePath, BulkWriter.Factory<IN> writerFactory, BucketAssigner<IN,String> assigner)
protected	BulkFormatBuilder(Path basePath, long bucketCheckInterval, BulkWriter.Factory<IN> writerFactory, BucketAssigner<IN,String> assigner, CheckpointRollingPolicy<IN,String> policy, FileWriterBucketFactory<IN> bucketFactory, OutputFileConfig outputFileConfig)

Method Summary

Modifier and Type	Method and Description
FileSink<IN>	build() Creates the actual sink.
T	withBucketAssigner(BucketAssigner<IN,String> assigner)
T	withBucketCheckInterval(long interval)
FileSink.BulkFormatBuilder<IN,? extends FileSink.BulkFormatBuilder<IN,?>>	withNewBucketAssigner(BucketAssigner<IN,String> assigner)
T	withOutputFileConfig(OutputFileConfig outputFileConfig)
T	withRollingPolicy(CheckpointRollingPolicy<IN,String> rollingPolicy)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BulkFormatBuilder

protected BulkFormatBuilder(Path basePath,
                            BulkWriter.Factory<IN> writerFactory,
                            BucketAssigner<IN,String> assigner)

BulkFormatBuilder

protected BulkFormatBuilder(Path basePath,
                            long bucketCheckInterval,
                            BulkWriter.Factory<IN> writerFactory,
                            BucketAssigner<IN,String> assigner,
                            CheckpointRollingPolicy<IN,String> policy,
                            FileWriterBucketFactory<IN> bucketFactory,
                            OutputFileConfig outputFileConfig)

Method Detail

withBucketCheckInterval

public T withBucketCheckInterval(long interval)

withBucketAssigner

public T withBucketAssigner(BucketAssigner<IN,String> assigner)

withRollingPolicy

public T withRollingPolicy(CheckpointRollingPolicy<IN,String> rollingPolicy)

withOutputFileConfig

public T withOutputFileConfig(OutputFileConfig outputFileConfig)

withNewBucketAssigner

public FileSink.BulkFormatBuilder<IN,? extends FileSink.BulkFormatBuilder<IN,?>> withNewBucketAssigner(BucketAssigner<IN,String> assigner)

build

public FileSink<IN> build()

Creates the actual sink.