Package org.apache.flink.connector.file.sink.compactor
-
Interface Summary Interface Description DecoderBasedReader.Decoder<T> ADecoderBasedReader.Decoder
to decode the file content into the actual records.DecoderBasedReader.Decoder.Factory<T> Factory to createDecoderBasedReader.Decoder
.FileCompactor TheFileCompactor
is responsible for compacting files into one file.RecordWiseFileCompactor.Reader<T> The reader that reads record from the compacting files.RecordWiseFileCompactor.Reader.Factory<T> Factory forRecordWiseFileCompactor.Reader
.RecordWiseFileCompactor.Writer<T> The writer that writers record into the compacting files. -
Class Summary Class Description ConcatFileCompactor AOutputStreamBasedFileCompactor
implementation that simply concat the compacting files.DecoderBasedReader<T> ARecordWiseFileCompactor.Reader
implementation that reads the file as anFSDataInputStream
and decodes the record with theDecoderBasedReader.Decoder
.DecoderBasedReader.Factory<T> Factory forDecoderBasedReader
.FileCompactStrategy Strategy for compacting the files written inFileSink
before committing.FileCompactStrategy.Builder Builder forFileCompactStrategy
.IdenticalFileCompactor A simpleOutputStreamBasedFileCompactor
implementation that directly copy the content of the only input file to the output.InputFormatBasedReader<T> ARecordWiseFileCompactor.Reader
implementation that reads the file using theFileInputFormat
.InputFormatBasedReader.Factory<T> Factory forInputFormatBasedReader
.OutputStreamBasedFileCompactor Base class forFileCompactor
implementations that write the compacting file by a output stream.RecordWiseFileCompactor<IN> AFileCompactor
implementation that reads input files with aRecordWiseFileCompactor.Reader
and writes with aRecordWiseFileCompactor.Writer
.SimpleStringDecoder A sinkDecoderBasedReader.Decoder
that reads data encoded by theSimpleStringEncoder
only for compaction.