Modifier and Type | Method and Description |
---|---|
void |
ChannelStateWriter.addOutputData(long checkpointId,
ResultSubpartitionInfo info,
int startSeqNum,
Buffer... data)
Add in-flight buffers from the
ResultSubpartition . |
void |
ChannelStateWriter.NoOpChannelStateWriter.addOutputData(long checkpointId,
ResultSubpartitionInfo info,
int startSeqNum,
Buffer... data) |
void |
ChannelStateWriterImpl.addOutputData(long checkpointId,
ResultSubpartitionInfo info,
int startSeqNum,
Buffer... data) |
Modifier and Type | Method and Description |
---|---|
void |
ChannelStateWriter.addInputData(long checkpointId,
InputChannelInfo info,
int startSeqNum,
CloseableIterator<Buffer> data)
Add in-flight buffers from the
InputChannel . |
void |
ChannelStateWriter.NoOpChannelStateWriter.addInputData(long checkpointId,
InputChannelInfo info,
int startSeqNum,
CloseableIterator<Buffer> data) |
void |
ChannelStateWriterImpl.addInputData(long checkpointId,
InputChannelInfo info,
int startSeqNum,
CloseableIterator<Buffer> iterator) |
void |
ChannelStateWriter.addOutputDataFuture(long checkpointId,
ResultSubpartitionInfo info,
int startSeqNum,
CompletableFuture<List<Buffer>> data)
Add in-flight bufferFuture from the
ResultSubpartition . |
void |
ChannelStateWriter.NoOpChannelStateWriter.addOutputDataFuture(long checkpointId,
ResultSubpartitionInfo info,
int startSeqNum,
CompletableFuture<List<Buffer>> data) |
void |
ChannelStateWriterImpl.addOutputDataFuture(long checkpointId,
ResultSubpartitionInfo info,
int startSeqNum,
CompletableFuture<List<Buffer>> dataFuture) |
Modifier and Type | Method and Description |
---|---|
Buffer |
FileBasedBufferIterator.next() |
Modifier and Type | Method and Description |
---|---|
boolean |
BufferFileChannelReader.readBufferFromFileChannel(Buffer buffer)
Reads data from the object's file channel into the given buffer.
|
void |
AsynchronousBufferFileReader.readInto(Buffer buffer) |
void |
SynchronousBufferFileReader.readInto(Buffer buffer) |
void |
BufferFileReader.readInto(Buffer buffer) |
void |
AsynchronousBufferFileWriter.writeBlock(Buffer buffer)
Writes the given block asynchronously.
|
Modifier and Type | Method and Description |
---|---|
BufferFileReader |
IOManagerAsync.createBufferFileReader(FileIOChannel.ID channelID,
RequestDoneCallback<Buffer> callback) |
abstract BufferFileReader |
IOManager.createBufferFileReader(FileIOChannel.ID channelID,
RequestDoneCallback<Buffer> callback) |
Constructor and Description |
---|
AsynchronousBufferFileReader(FileIOChannel.ID channelID,
RequestQueue<org.apache.flink.runtime.io.disk.iomanager.ReadRequest> requestQueue,
RequestDoneCallback<Buffer> callback) |
Modifier and Type | Method and Description |
---|---|
static Buffer |
EventSerializer.toBuffer(AbstractEvent event,
boolean hasPriority) |
Modifier and Type | Method and Description |
---|---|
CloseableIterator<Buffer> |
RecordDeserializer.getUnconsumedBuffer()
Gets the unconsumed buffer which needs to be persisted in unaligned checkpoint scenario.
|
CloseableIterator<Buffer> |
SpillingAdaptiveSpanningRecordDeserializer.getUnconsumedBuffer() |
Modifier and Type | Method and Description |
---|---|
static AbstractEvent |
EventSerializer.fromBuffer(Buffer buffer,
ClassLoader classLoader) |
void |
RecordDeserializer.setNextBuffer(Buffer buffer) |
void |
SpillingAdaptiveSpanningRecordDeserializer.setNextBuffer(Buffer buffer) |
Modifier and Type | Class and Description |
---|---|
class |
CompositeBuffer
An implementation of
Buffer which contains multiple partial buffers for network data
communication. |
class |
FileRegionBuffer
This class represents a chunk of data in a file channel.
|
class |
NetworkBuffer
Wrapper for pooled
MemorySegment instances. |
class |
ReadOnlySlicedNetworkBuffer
Minimal best-effort read-only sliced
Buffer implementation wrapping a NetworkBuffer 's sub-region based on io.netty.buffer.SlicedByteBuf and
io.netty.buffer.ReadOnlyByteBuf. |
Modifier and Type | Method and Description |
---|---|
Buffer |
BufferConsumer.build() |
Buffer |
BufferConsumerWithPartialRecordLength.build() |
Buffer |
BufferCompressor.compressToIntermediateBuffer(Buffer buffer)
Compresses the given
Buffer using BlockCompressor . |
Buffer |
BufferCompressor.compressToOriginalBuffer(Buffer buffer)
The difference between this method and
BufferCompressor.compressToIntermediateBuffer(Buffer) is that
this method will copy the compressed data back to the input Buffer starting from
offset 0. |
Buffer |
BufferDecompressor.decompressToIntermediateBuffer(Buffer buffer)
Decompresses the given
Buffer using BlockDecompressor . |
Buffer |
BufferDecompressor.decompressToOriginalBuffer(Buffer buffer)
The difference between this method and
BufferDecompressor.decompressToIntermediateBuffer(Buffer) is
that this method copies the decompressed data to the input Buffer starting from
offset 0. |
Buffer |
CompositeBuffer.getFullBufferData(MemorySegment segment)
Returns the full buffer data in one piece of
MemorySegment . |
Buffer |
FileRegionBuffer.readInto(MemorySegment segment) |
Buffer |
CompositeBuffer.readOnlySlice() |
Buffer |
Buffer.readOnlySlice()
Returns a read-only slice of this buffer's readable bytes, i.e.
|
Buffer |
CompositeBuffer.readOnlySlice(int index,
int length) |
Buffer |
Buffer.readOnlySlice(int index,
int length)
Returns a read-only slice of this buffer.
|
Buffer |
BufferProvider.requestBuffer()
Returns a
Buffer instance from the buffer provider, if one is available. |
Buffer |
CompositeBuffer.retainBuffer() |
Buffer |
Buffer.retainBuffer()
Retains this buffer for further use, increasing the reference counter by 1.
|
Modifier and Type | Method and Description |
---|---|
void |
CompositeBuffer.addPartialBuffer(Buffer buffer) |
Buffer |
BufferCompressor.compressToIntermediateBuffer(Buffer buffer)
Compresses the given
Buffer using BlockCompressor . |
Buffer |
BufferCompressor.compressToOriginalBuffer(Buffer buffer)
The difference between this method and
BufferCompressor.compressToIntermediateBuffer(Buffer) is that
this method will copy the compressed data back to the input Buffer starting from
offset 0. |
Buffer |
BufferDecompressor.decompressToIntermediateBuffer(Buffer buffer)
Decompresses the given
Buffer using BlockDecompressor . |
Buffer |
BufferDecompressor.decompressToOriginalBuffer(Buffer buffer)
The difference between this method and
BufferDecompressor.decompressToIntermediateBuffer(Buffer) is
that this method copies the decompressed data to the input Buffer starting from
offset 0. |
boolean |
BufferListener.notifyBufferAvailable(Buffer buffer)
Notification callback if a buffer is recycled and becomes available in buffer pool.
|
Constructor and Description |
---|
BufferConsumer(Buffer buffer,
org.apache.flink.runtime.io.network.buffer.BufferBuilder.PositionMarker currentWriterPosition,
int currentReaderPosition) |
BufferConsumer(Buffer buffer,
int size)
Constructs
BufferConsumer instance with static content of a certain size. |
Modifier and Type | Method and Description |
---|---|
static void |
NetworkActionsLogger.traceInput(String action,
Buffer buffer,
String taskName,
InputChannelInfo channelInfo,
ChannelStatePersister channelStatePersister,
int sequenceNumber) |
static void |
NetworkActionsLogger.traceOutput(String action,
Buffer buffer,
String taskName,
ResultSubpartitionInfo channelInfo) |
static void |
NetworkActionsLogger.tracePersist(String action,
Buffer buffer,
String taskName,
Object channelInfo,
long checkpointId) |
static void |
NetworkActionsLogger.traceRecover(String action,
Buffer buffer,
String taskName,
InputChannelInfo channelInfo) |
Modifier and Type | Method and Description |
---|---|
Buffer |
ResultSubpartition.BufferAndBacklog.buffer() |
Buffer |
BufferWithChannel.getBuffer() |
static Buffer |
BufferReaderWriterUtil.readFromByteChannel(FileChannel channel,
ByteBuffer headerBuffer,
MemorySegment memorySegment,
BufferRecycler bufferRecycler) |
Modifier and Type | Method and Description |
---|---|
protected boolean |
ResultPartition.canBeCompressed(Buffer buffer)
Whether the buffer can be compressed or not.
|
static ResultSubpartition.BufferAndBacklog |
ResultSubpartition.BufferAndBacklog.fromBufferAndLookahead(Buffer current,
Buffer.DataType nextDataType,
int backlog,
int sequenceNumber) |
static void |
BufferReaderWriterUtil.setByteChannelBufferHeader(Buffer buffer,
ByteBuffer header) |
Constructor and Description |
---|
BufferAndBacklog(Buffer buffer,
int buffersInBacklog,
Buffer.DataType nextDataType,
int sequenceNumber) |
Modifier and Type | Method and Description |
---|---|
Buffer |
InputChannel.BufferAndAvailability.buffer() |
Buffer |
BufferOrEvent.getBuffer() |
Buffer |
RemoteInputChannel.getNextReceivedBuffer() |
Buffer |
RemoteInputChannel.requestBuffer()
Requests buffer from input channel directly for receiving network data.
|
Buffer |
RecoveredInputChannel.requestBufferBlocking() |
Modifier and Type | Method and Description |
---|---|
protected OptionalLong |
ChannelStatePersister.checkForBarrier(Buffer buffer) |
protected void |
ChannelStatePersister.maybePersist(Buffer buffer) |
boolean |
BufferManager.notifyBufferAvailable(Buffer buffer)
The buffer pool notifies this listener of an available floating buffer.
|
void |
RemoteInputChannel.onBuffer(Buffer buffer,
int sequenceNumber,
int backlog)
Handles the input buffer.
|
void |
RecoveredInputChannel.onRecoveredStateBuffer(Buffer buffer) |
protected AbstractEvent |
ChannelStatePersister.parseEvent(Buffer buffer)
Parses the buffer as an event and returns the
CheckpointBarrier if the event is
indeed a barrier or returns null in all other cases. |
Modifier and Type | Method and Description |
---|---|
protected void |
ChannelStatePersister.startPersisting(long barrierId,
List<Buffer> knownBuffers) |
Constructor and Description |
---|
BufferAndAvailability(Buffer buffer,
Buffer.DataType nextDataType,
int buffersInBacklog,
int sequenceNumber) |
BufferOrEvent(Buffer buffer,
InputChannelInfo channelInfo) |
BufferOrEvent(Buffer buffer,
InputChannelInfo channelInfo,
boolean moreAvailable,
boolean morePriorityEvents) |
Modifier and Type | Method and Description |
---|---|
Buffer |
BufferWithIdentity.getBuffer() |
Buffer |
HsBufferContext.getBuffer() |
Modifier and Type | Method and Description |
---|---|
Optional<Buffer> |
HsSubpartitionFileReaderImpl.BufferIndexOrError.getBuffer() |
Constructor and Description |
---|
BufferWithIdentity(Buffer buffer,
int bufferIndex,
int channelIndex) |
HsBufferContext(Buffer buffer,
int bufferIndex,
int subpartitionId) |
Modifier and Type | Method and Description |
---|---|
void |
CompressedBlockChannelReader.requestFailed(Buffer buffer,
IOException e) |
void |
CompressedHeaderlessChannelReaderInputView.requestFailed(Buffer buffer,
IOException e) |
void |
CompressedBlockChannelReader.requestSuccessful(Buffer request) |
void |
CompressedHeaderlessChannelReaderInputView.requestSuccessful(Buffer request) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.