Constructor and Description |
---|
FileCommitter(BucketWriter<?,?> bucketWriter) |
Constructor and Description |
---|
CompactorOperator(FileCompactStrategy strategy,
SimpleVersionedSerializer<FileSinkCommittable> committableSerializer,
FileCompactor fileCompactor,
BucketWriter<?,String> bucketWriter) |
CompactorOperatorStateHandler(SimpleVersionedSerializer<FileSinkCommittable> committableSerializer,
BucketWriter<?,String> bucketWriter) |
CompactService(int numCompactThreads,
FileCompactor fileCompactor,
BucketWriter<?,String> bucketWriter) |
Constructor and Description |
---|
CompactorOperatorFactory(FileCompactStrategy strategy,
FileCompactor fileCompactor,
SerializableSupplierWithException<SimpleVersionedSerializer<FileSinkCommittable>,IOException> committableSerializerSupplier,
SerializableSupplierWithException<BucketWriter<?,String>,IOException> bucketWriterProvider) |
CompactorOperatorStateHandlerFactory(SerializableSupplierWithException<SimpleVersionedSerializer<FileSinkCommittable>,IOException> committableSerializerSupplier,
SerializableSupplierWithException<BucketWriter<?,String>,IOException> bucketWriterProvider) |
Modifier and Type | Method and Description |
---|---|
org.apache.flink.connector.file.sink.writer.FileWriterBucket<IN> |
DefaultFileWriterBucketFactory.getNewBucket(String bucketId,
Path bucketPath,
BucketWriter<IN,String> bucketWriter,
RollingPolicy<IN,String> rollingPolicy,
OutputFileConfig outputFileConfig) |
org.apache.flink.connector.file.sink.writer.FileWriterBucket<IN> |
FileWriterBucketFactory.getNewBucket(String bucketId,
Path bucketPath,
BucketWriter<IN,String> bucketWriter,
RollingPolicy<IN,String> rollingPolicy,
OutputFileConfig outputFileConfig) |
org.apache.flink.connector.file.sink.writer.FileWriterBucket<IN> |
DefaultFileWriterBucketFactory.restoreBucket(BucketWriter<IN,String> bucketWriter,
RollingPolicy<IN,String> rollingPolicy,
FileWriterBucketState bucketState,
OutputFileConfig outputFileConfig) |
org.apache.flink.connector.file.sink.writer.FileWriterBucket<IN> |
FileWriterBucketFactory.restoreBucket(BucketWriter<IN,String> bucketWriter,
RollingPolicy<IN,String> rollingPolicy,
FileWriterBucketState bucketState,
OutputFileConfig outputFileConfig) |
Constructor and Description |
---|
FileWriter(Path basePath,
SinkWriterMetricGroup metricGroup,
BucketAssigner<IN,String> bucketAssigner,
FileWriterBucketFactory<IN> bucketFactory,
BucketWriter<IN,String> bucketWriter,
RollingPolicy<IN,String> rollingPolicy,
OutputFileConfig outputFileConfig,
ProcessingTimeService processingTimeService,
long bucketCheckInterval)
A constructor creating a new empty bucket manager.
|
Modifier and Type | Method and Description |
---|---|
static <T> CompactWriter.Factory<T> |
CompactBucketWriter.factory(SupplierWithException<BucketWriter<T,String>,IOException> factory) |
Modifier and Type | Class and Description |
---|---|
static class |
HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter<IN,BucketID>
Factory to create
HadoopPathBasedPartFileWriter . |
Modifier and Type | Class and Description |
---|---|
class |
BulkBucketWriter<IN,BucketID>
A factory that creates
BulkPartWriters . |
class |
RowWiseBucketWriter<IN,BucketID>
A factory that creates
RowWisePartWriters . |
Modifier and Type | Method and Description |
---|---|
BucketWriter<IN,BucketID> |
HadoopPathBasedBulkFormatBuilder.createBucketWriter() |
abstract BucketWriter<IN,BucketID> |
StreamingFileSink.BucketsBuilder.createBucketWriter() |
BucketWriter<IN,BucketID> |
StreamingFileSink.RowFormatBuilder.createBucketWriter() |
BucketWriter<IN,BucketID> |
StreamingFileSink.BulkFormatBuilder.createBucketWriter() |
Modifier and Type | Method and Description |
---|---|
Bucket<IN,BucketID> |
DefaultBucketFactoryImpl.getNewBucket(int subtaskIndex,
BucketID bucketId,
Path bucketPath,
long initialPartCounter,
BucketWriter<IN,BucketID> bucketWriter,
RollingPolicy<IN,BucketID> rollingPolicy,
FileLifeCycleListener<BucketID> fileListener,
OutputFileConfig outputFileConfig) |
Bucket<IN,BucketID> |
BucketFactory.getNewBucket(int subtaskIndex,
BucketID bucketId,
Path bucketPath,
long initialPartCounter,
BucketWriter<IN,BucketID> bucketWriter,
RollingPolicy<IN,BucketID> rollingPolicy,
FileLifeCycleListener<BucketID> fileListener,
OutputFileConfig outputFileConfig) |
Bucket<IN,BucketID> |
DefaultBucketFactoryImpl.restoreBucket(int subtaskIndex,
long initialPartCounter,
BucketWriter<IN,BucketID> bucketWriter,
RollingPolicy<IN,BucketID> rollingPolicy,
org.apache.flink.streaming.api.functions.sink.filesystem.BucketState<BucketID> bucketState,
FileLifeCycleListener<BucketID> fileListener,
OutputFileConfig outputFileConfig) |
Bucket<IN,BucketID> |
BucketFactory.restoreBucket(int subtaskIndex,
long initialPartCounter,
BucketWriter<IN,BucketID> bucketWriter,
RollingPolicy<IN,BucketID> rollingPolicy,
org.apache.flink.streaming.api.functions.sink.filesystem.BucketState<BucketID> bucketState,
FileLifeCycleListener<BucketID> fileListener,
OutputFileConfig outputFileConfig) |
Constructor and Description |
---|
Buckets(Path basePath,
BucketAssigner<IN,BucketID> bucketAssigner,
BucketFactory<IN,BucketID> bucketFactory,
BucketWriter<IN,BucketID> bucketWriter,
RollingPolicy<IN,BucketID> rollingPolicy,
int subtaskIndex,
OutputFileConfig outputFileConfig)
A constructor creating a new empty bucket manager.
|
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.