public class ProducerMergedPartitionFileWriter extends Object implements PartitionFileWriter
PartitionFileWriter
with producer-side merge mode. In this mode,
the shuffle data is written in the producer side, the consumer side need to read multiple
producers to get its partition data.
Note that one partition file written by the ProducerMergedPartitionFileWriter
may
contain the data of multiple subpartitions.
PartitionFileWriter.SegmentBufferContext, PartitionFileWriter.SubpartitionBufferContext
Modifier and Type | Method and Description |
---|---|
void |
release()
Release all the resources of the
PartitionFileWriter . |
CompletableFuture<Void> |
write(TieredStoragePartitionId partitionId,
List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)
Write the buffers to the partition file.
|
public CompletableFuture<Void> write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)
PartitionFileWriter
write
in interface PartitionFileWriter
partitionId
- the partition idbuffersToWrite
- the buffers to be written to the partition fileCompletableFuture
is completed, the written process is completed.public void release()
PartitionFileWriter
PartitionFileWriter
.release
in interface PartitionFileWriter
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.