Package org.apache.flink.streaming.api.functions.sink.filesystem

Interface Summary

Interface	Description
BucketAssigner<IN,BucketID>	A BucketAssigner is used with a file sink to determine the bucket each incoming element should be put into.
BucketAssigner.Context	Context that the BucketAssigner can use for getting additional data about an input record.
BucketFactory<IN,BucketID>	A factory able to create buckets for the StreamingFileSink.
BucketLifeCycleListener<IN,BucketID>	Listener about the status of Bucket.
BucketWriter<IN,BucketID>	An interface for factories that create the different writers.
BucketWriter.PendingFile	This represents the file that can not write any data to.
CompactingFileWriter	The file sink compactors use the CompactingFileWriter to write a compacting file.
FileLifeCycleListener<BucketID>	Listener about the status of file.
InProgressFileWriter<IN,BucketID>	The Bucket uses the InProgressFileWriter to write element to a part file.
InProgressFileWriter.InProgressFileRecoverable	A handle can be used to recover in-progress file..
InProgressFileWriter.PendingFileRecoverable	The handle can be used to recover pending file.
OutputStreamBasedCompactingFileWriter	The compactors use the OutputStreamBasedCompactingFileWriter to directly write a compacting file as an OutputStream.
PartFileInfo<BucketID>	An interface exposing the information concerning the current (open) part file that is necessary to the RollingPolicy in order to determine if it should roll the part file or not.
RecordWiseCompactingFileWriter<IN>	The compactors use the RecordWiseCompactingFileWriter to write elements to a compacting file.
RollingPolicy<IN,BucketID>	The policy based on which a Bucket in the Filesystem Sink rolls its currently open part file and opens a new one.

Class Summary

Class	Description
AbstractPartFileWriter<IN,BucketID>	An abstract writer for the currently open part file in a specific Bucket.
Bucket<IN,BucketID>	A bucket is the directory organization of the output of the StreamingFileSink.
Buckets<IN,BucketID>	The manager of the different active buckets in the StreamingFileSink.
BulkBucketWriter<IN,BucketID>	A factory that creates BulkPartWriters.
DefaultBucketFactoryImpl<IN,BucketID>	A factory returning buckets.
HadoopPathBasedBulkFormatBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>>	Buckets builder to create buckets that use HadoopPathBasedPartFileWriter.
OutputFileConfig	Part file name configuration.
OutputFileConfig.OutputFileConfigBuilder	A builder to create the part file configuration.
OutputStreamBasedPartFileWriter<IN,BucketID>	The base class for all the part file writer that use RecoverableFsDataOutputStream.
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable	The InProgressFileWriter.InProgressFileRecoverable implementation for OutputStreamBasedPartFileWriter.OutputStreamBasedBucketWriter.
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer	The serializer for OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable.
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable	The InProgressFileWriter.PendingFileRecoverable implementation for OutputStreamBasedPartFileWriter.OutputStreamBasedBucketWriter.
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer	The serializer for OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable.
RowWiseBucketWriter<IN,BucketID>	A factory that creates RowWisePartWriters.
RowWisePartWriter<IN,BucketID>	A InProgressFileWriter for row-wise formats that use an Encoder.
SerializableConfiguration	Wrapper of hadoop Configuration to make it serializable.
StreamingFileSinkHelper<IN>	Helper for StreamingFileSink.
WriterProperties	This class describes the property of the BucketWriter.

Enum Summary

Enum	Description
CompactingFileWriter.Type	Enum defining the types of CompactingFileWriter.