Modifier and Type | Method and Description |
---|---|
void |
SequentialChannelStateReaderImpl.readOutputData(ResultPartitionWriter[] writers,
boolean notifyAndBlockOnCompletion) |
void |
SequentialChannelStateReader.readOutputData(ResultPartitionWriter[] writers,
boolean notifyAndBlockOnCompletion) |
Modifier and Type | Method and Description |
---|---|
ResultPartitionWriter[] |
Environment.getAllWriters() |
ResultPartitionWriter |
Environment.getWriter(int index) |
Modifier and Type | Method and Description |
---|---|
void |
NettyShuffleEnvironment.registerLegacyNetworkMetrics(MetricGroup metricGroup,
ResultPartitionWriter[] producedPartitions,
InputGate[] inputGates)
Deprecated.
should be removed in future
|
Modifier and Type | Field and Description |
---|---|
protected ResultPartitionWriter |
RecordWriter.targetPartition |
Modifier and Type | Method and Description |
---|---|
RecordWriter<T> |
RecordWriterBuilder.build(ResultPartitionWriter writer) |
Modifier and Type | Method and Description |
---|---|
static void |
NettyShuffleMetricFactory.registerLegacyNetworkMetrics(boolean isDetailedMetrics,
MetricGroup metricGroup,
ResultPartitionWriter[] producedPartitions,
InputGate[] inputGates)
Deprecated.
should be removed in future
|
Modifier and Type | Class and Description |
---|---|
class |
BoundedBlockingResultPartition
A output data result of an individual task (one partition of an intermediate result), produced
and communicated in a batch manner: The result must be produced completely before it can be
consumed.
|
class |
BufferWritingResultPartition
A
ResultPartition which writes buffers directly to ResultSubpartition s. |
class |
PipelinedResultPartition
A result output of a task, pipelined (streamed) to the receivers.
|
class |
ResultPartition
A result partition for data produced by a single task.
|
class |
SortMergeResultPartition
SortMergeResultPartition appends records and events to SortBuffer and after the
SortBuffer is full, all data in the SortBuffer will be copied and spilled to a
PartitionedFile in subpartition index order sequentially. |
Modifier and Type | Interface and Description |
---|---|
interface |
ShuffleEnvironment<P extends ResultPartitionWriter,G extends IndexedInputGate>
Interface for the implementation of shuffle service local environment.
|
interface |
ShuffleServiceFactory<SD extends ShuffleDescriptor,P extends ResultPartitionWriter,G extends IndexedInputGate>
Interface for shuffle service factory implementations.
|
Modifier and Type | Method and Description |
---|---|
static ResultPartitionWriter[] |
ConsumableNotifyingResultPartitionWriterDecorator.decorate(Collection<ResultPartitionDeploymentDescriptor> descs,
ResultPartitionWriter[] partitionWriters,
TaskActions taskActions,
JobID jobId,
ResultPartitionConsumableNotifier notifier)
Optionally decorate the ResultPartitionWriter to call
ResultPartitionConsumableNotifier.notifyPartitionConsumable(JobID, ResultPartitionID,
TaskActions) on the first record, iff ResultPartitionDeploymentDescriptor.notifyPartitionDataAvailable() is true. |
ResultPartitionWriter[] |
RuntimeEnvironment.getAllWriters() |
ResultPartitionWriter |
RuntimeEnvironment.getWriter(int index) |
Modifier and Type | Method and Description |
---|---|
static ResultPartitionWriter[] |
ConsumableNotifyingResultPartitionWriterDecorator.decorate(Collection<ResultPartitionDeploymentDescriptor> descs,
ResultPartitionWriter[] partitionWriters,
TaskActions taskActions,
JobID jobId,
ResultPartitionConsumableNotifier notifier)
Optionally decorate the ResultPartitionWriter to call
ResultPartitionConsumableNotifier.notifyPartitionConsumable(JobID, ResultPartitionID,
TaskActions) on the first record, iff ResultPartitionDeploymentDescriptor.notifyPartitionDataAvailable() is true. |
static void |
Task.setupPartitionsAndGates(ResultPartitionWriter[] producedPartitions,
InputGate[] inputGates) |
Constructor and Description |
---|
RuntimeEnvironment(JobID jobId,
JobVertexID jobVertexId,
ExecutionAttemptID executionId,
ExecutionConfig executionConfig,
TaskInfo taskInfo,
Configuration jobConfiguration,
Configuration taskConfiguration,
UserCodeClassLoader userCodeClassLoader,
MemoryManager memManager,
IOManager ioManager,
BroadcastVariableManager bcVarManager,
TaskStateManager taskStateManager,
GlobalAggregateManager aggregateManager,
AccumulatorRegistry accumulatorRegistry,
TaskKvStateRegistry kvStateRegistry,
InputSplitProvider splitProvider,
Map<String,Future<Path>> distCacheEntries,
ResultPartitionWriter[] writers,
IndexedInputGate[] inputGates,
TaskEventDispatcher taskEventDispatcher,
CheckpointResponder checkpointResponder,
TaskOperatorEventGateway operatorEventGateway,
TaskManagerRuntimeInfo taskManagerInfo,
TaskMetricGroup metrics,
Task containingTask,
ExternalResourceInfoProvider externalResourceInfoProvider) |
Modifier and Type | Method and Description |
---|---|
ResultPartitionWriter[] |
SavepointEnvironment.getAllWriters() |
ResultPartitionWriter |
SavepointEnvironment.getWriter(int index) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.