Interface | Description |
---|---|
DecoderBasedReader.Decoder<T> |
A
DecoderBasedReader.Decoder to decode the file content into the actual records. |
DecoderBasedReader.Decoder.Factory<T> |
Factory to create
DecoderBasedReader.Decoder . |
FileCompactor |
The
FileCompactor is responsible for compacting files into one file. |
RecordWiseFileCompactor.Reader<T> |
The reader that reads record from the compacting files.
|
RecordWiseFileCompactor.Reader.Factory<T> |
Factory for
RecordWiseFileCompactor.Reader . |
RecordWiseFileCompactor.Writer<T> |
The writer that writers record into the compacting files.
|
Class | Description |
---|---|
ConcatFileCompactor |
A
OutputStreamBasedFileCompactor implementation that simply concat the compacting files. |
DecoderBasedReader<T> |
A
RecordWiseFileCompactor.Reader implementation that reads the file as an FSDataInputStream and decodes the record with the DecoderBasedReader.Decoder . |
DecoderBasedReader.Factory<T> |
Factory for
DecoderBasedReader . |
FileCompactStrategy |
Strategy for compacting the files written in
FileSink before committing. |
FileCompactStrategy.Builder |
Builder for
FileCompactStrategy . |
IdenticalFileCompactor |
A simple
OutputStreamBasedFileCompactor implementation that directly copy the content of
the only input file to the output. |
InputFormatBasedReader<T> |
A
RecordWiseFileCompactor.Reader implementation that reads the file using the FileInputFormat . |
InputFormatBasedReader.Factory<T> |
Factory for
InputFormatBasedReader . |
OutputStreamBasedFileCompactor |
Base class for
FileCompactor implementations that write the compacting file by a output
stream. |
RecordWiseFileCompactor<IN> |
A
FileCompactor implementation that reads input files with a RecordWiseFileCompactor.Reader and writes
with a RecordWiseFileCompactor.Writer . |
SimpleStringDecoder |
A sink
DecoderBasedReader.Decoder that reads data encoded by the SimpleStringEncoder only for compaction. |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.