Modifier and Type | Method and Description |
---|---|
void |
ExecutionGraph.scheduleOrUpdateConsumers(ResultPartitionID partitionId)
Schedule or updates consumers of the given result partition.
|
Modifier and Type | Method and Description |
---|---|
Collection<ResultPartitionID> |
NettyShuffleEnvironment.getPartitionsOccupyingLocalResources()
Report unreleased partitions.
|
Modifier and Type | Method and Description |
---|---|
boolean |
TaskEventDispatcher.publish(ResultPartitionID partitionId,
TaskEvent event)
Publishes the event to the registered
EventListener instances. |
boolean |
TaskEventPublisher.publish(ResultPartitionID partitionId,
TaskEvent event)
Publishes the event to the registered
EventListener instances. |
void |
TaskEventDispatcher.registerPartition(ResultPartitionID partitionId)
Registers the given partition for incoming task events allowing calls to
TaskEventDispatcher.subscribeToEvent(ResultPartitionID, EventListener, Class) . |
void |
PartitionRequestClient.requestSubpartition(ResultPartitionID partitionId,
int subpartitionIndex,
RemoteInputChannel inputChannel,
int delayMs)
Requests a remote sub partition.
|
void |
NetworkSequenceViewReader.requestSubpartitionView(ResultPartitionProvider partitionProvider,
ResultPartitionID resultPartitionId,
int subPartitionIndex) |
void |
PartitionRequestClient.sendTaskEvent(ResultPartitionID partitionId,
TaskEvent event,
RemoteInputChannel inputChannel)
Sends a task event backwards to an intermediate result partition.
|
void |
TaskEventDispatcher.subscribeToEvent(ResultPartitionID partitionId,
EventListener<TaskEvent> eventListener,
Class<? extends TaskEvent> eventType)
Subscribes a listener to this dispatcher for events on a partition.
|
void |
TaskEventDispatcher.unregisterPartition(ResultPartitionID partitionId)
Removes the given partition from listening to incoming task events, thus forbidding calls to
TaskEventDispatcher.subscribeToEvent(ResultPartitionID, EventListener, Class) . |
Modifier and Type | Method and Description |
---|---|
void |
NettyShuffleEnvironment.releasePartitionsLocally(Collection<ResultPartitionID> partitionIds) |
Modifier and Type | Method and Description |
---|---|
ResultPartitionID |
ResultPartitionWriter.getPartitionId() |
Modifier and Type | Method and Description |
---|---|
void |
NettyPartitionRequestClient.requestSubpartition(ResultPartitionID partitionId,
int subpartitionIndex,
RemoteInputChannel inputChannel,
int delayMs)
Requests a remote intermediate result partition queue.
|
void |
NettyPartitionRequestClient.sendTaskEvent(ResultPartitionID partitionId,
TaskEvent event,
RemoteInputChannel inputChannel)
Sends a task event backwards to an intermediate result partition producer.
|
Modifier and Type | Field and Description |
---|---|
protected ResultPartitionID |
ResultPartition.partitionId |
Modifier and Type | Method and Description |
---|---|
ResultPartitionID |
ResultPartition.getPartitionId() |
ResultPartitionID |
PartitionException.getPartitionId() |
Modifier and Type | Method and Description |
---|---|
Collection<ResultPartitionID> |
ResultPartitionManager.getUnreleasedPartitions() |
Modifier and Type | Method and Description |
---|---|
ResultPartition |
ResultPartitionFactory.create(String taskNameWithSubtaskAndId,
ResultPartitionID id,
ResultPartitionType type,
int numberOfSubpartitions,
int maxParallelism,
FunctionWithException<BufferPoolOwner,BufferPool,IOException> bufferPoolFactory) |
ResultSubpartitionView |
ResultPartitionProvider.createSubpartitionView(ResultPartitionID partitionId,
int index,
BufferAvailabilityListener availabilityListener)
Returns the requested intermediate result partition input view.
|
ResultSubpartitionView |
ResultPartitionManager.createSubpartitionView(ResultPartitionID partitionId,
int subpartitionIndex,
BufferAvailabilityListener availabilityListener) |
boolean |
PartitionTrackerImpl.isPartitionTracked(ResultPartitionID resultPartitionID) |
boolean |
PartitionTracker.isPartitionTracked(ResultPartitionID resultPartitionID)
Returns whether the given partition is being tracked.
|
void |
ResultPartitionConsumableNotifier.notifyPartitionConsumable(JobID jobId,
ResultPartitionID partitionId,
TaskActions taskActions) |
void |
ResultPartitionManager.releasePartition(ResultPartitionID partitionId,
Throwable cause) |
void |
PartitionProducerStateProvider.requestPartitionProducerState(IntermediateDataSetID intermediateDataSetId,
ResultPartitionID resultPartitionId,
java.util.function.Consumer<? super PartitionProducerStateProvider.ResponseHandle> responseConsumer)
Trigger the producer execution state request.
|
Modifier and Type | Method and Description |
---|---|
void |
PartitionTrackerImpl.stopTrackingAndReleasePartitions(Collection<ResultPartitionID> resultPartitionIds) |
void |
PartitionTracker.stopTrackingAndReleasePartitions(Collection<ResultPartitionID> resultPartitionIds)
Releases the given partitions and stop the tracking of partitions that were released.
|
void |
PartitionTrackerImpl.stopTrackingPartitions(Collection<ResultPartitionID> resultPartitionIds) |
void |
PartitionTracker.stopTrackingPartitions(Collection<ResultPartitionID> resultPartitionIds)
Stops the tracking of the given partitions.
|
Constructor and Description |
---|
PartitionException(String message,
ResultPartitionID partitionId) |
PartitionException(String message,
ResultPartitionID partitionId,
Throwable throwable) |
PartitionNotFoundException(ResultPartitionID partitionId) |
ResultPartition(String owningTaskName,
ResultPartitionID partitionId,
ResultPartitionType partitionType,
ResultSubpartition[] subpartitions,
int numTargetKeyGroups,
ResultPartitionManager partitionManager,
FunctionWithException<BufferPoolOwner,BufferPool,IOException> bufferPoolFactory) |
Modifier and Type | Field and Description |
---|---|
protected ResultPartitionID |
InputChannel.partitionId |
Modifier and Type | Method and Description |
---|---|
ResultPartitionID |
InputChannel.getPartitionId() |
Constructor and Description |
---|
InputChannel(SingleInputGate inputGate,
int channelIndex,
ResultPartitionID partitionId,
int initialBackoff,
int maxBackoff,
Counter numBytesIn,
Counter numBuffersIn) |
LocalInputChannel(SingleInputGate inputGate,
int channelIndex,
ResultPartitionID partitionId,
ResultPartitionManager partitionManager,
TaskEventPublisher taskEventPublisher,
InputChannelMetrics metrics) |
LocalInputChannel(SingleInputGate inputGate,
int channelIndex,
ResultPartitionID partitionId,
ResultPartitionManager partitionManager,
TaskEventPublisher taskEventPublisher,
int initialBackoff,
int maxBackoff,
InputChannelMetrics metrics) |
PartitionConnectionException(ResultPartitionID partitionId,
Throwable throwable) |
RemoteChannelStateChecker(ResultPartitionID resultPartitionId,
String taskNameWithSubtask) |
RemoteInputChannel(SingleInputGate inputGate,
int channelIndex,
ResultPartitionID partitionId,
ConnectionID connectionId,
ConnectionManager connectionManager,
int initialBackOff,
int maxBackoff,
InputChannelMetrics metrics,
MemorySegmentProvider memorySegmentProvider) |
Constructor and Description |
---|
PartitionProducerDisposedException(ResultPartitionID resultPartitionID) |
Modifier and Type | Method and Description |
---|---|
void |
TaskManagerGateway.releasePartitions(JobID jobId,
Collection<ResultPartitionID> partitionIds)
Batch release intermediate result partitions.
|
Modifier and Type | Method and Description |
---|---|
CompletableFuture<ExecutionState> |
JobMaster.requestPartitionState(IntermediateDataSetID intermediateResultId,
ResultPartitionID resultPartitionId) |
CompletableFuture<ExecutionState> |
JobMasterGateway.requestPartitionState(IntermediateDataSetID intermediateResultId,
ResultPartitionID partitionId)
Requests the current state of the partition.
|
CompletableFuture<Acknowledge> |
JobMaster.scheduleOrUpdateConsumers(ResultPartitionID partitionID,
Time timeout) |
CompletableFuture<Acknowledge> |
JobMasterGateway.scheduleOrUpdateConsumers(ResultPartitionID partitionID,
Time timeout)
Notifies the JobManager about available data for a produced partition.
|
Modifier and Type | Method and Description |
---|---|
void |
RpcTaskManagerGateway.releasePartitions(JobID jobId,
Collection<ResultPartitionID> partitionIds) |
Modifier and Type | Method and Description |
---|---|
ExecutionState |
LegacyScheduler.requestPartitionState(IntermediateDataSetID intermediateResultId,
ResultPartitionID resultPartitionId) |
ExecutionState |
SchedulerNG.requestPartitionState(IntermediateDataSetID intermediateResultId,
ResultPartitionID resultPartitionId) |
void |
LegacyScheduler.scheduleOrUpdateConsumers(ResultPartitionID partitionID) |
void |
SchedulerNG.scheduleOrUpdateConsumers(ResultPartitionID partitionID) |
Modifier and Type | Method and Description |
---|---|
void |
SchedulingStrategy.onPartitionConsumable(ExecutionVertexID executionVertexId,
ResultPartitionID resultPartitionId)
Called whenever an
IntermediateResultPartition becomes consumable. |
void |
EagerSchedulingStrategy.onPartitionConsumable(ExecutionVertexID executionVertexId,
ResultPartitionID resultPartitionId) |
void |
LazyFromSourcesSchedulingStrategy.onPartitionConsumable(ExecutionVertexID executionVertexId,
ResultPartitionID resultPartitionId) |
Modifier and Type | Method and Description |
---|---|
ResultPartitionID |
ShuffleDescriptor.getResultPartitionID() |
ResultPartitionID |
NettyShuffleDescriptor.getResultPartitionID() |
ResultPartitionID |
UnknownShuffleDescriptor.getResultPartitionID() |
Modifier and Type | Method and Description |
---|---|
Collection<ResultPartitionID> |
ShuffleEnvironment.getPartitionsOccupyingLocalResources()
Report partitions which still occupy some resources locally.
|
Modifier and Type | Method and Description |
---|---|
void |
ShuffleEnvironment.releasePartitionsLocally(Collection<ResultPartitionID> partitionIds)
Release local resources occupied by the given partitions.
|
Constructor and Description |
---|
NettyShuffleDescriptor(ResourceID producerLocation,
NettyShuffleDescriptor.PartitionConnectionInfo partitionConnectionInfo,
ResultPartitionID resultPartitionID) |
UnknownShuffleDescriptor(ResultPartitionID resultPartitionID) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<ExecutionState> |
PartitionProducerStateChecker.requestPartitionProducerState(JobID jobId,
IntermediateDataSetID intermediateDataSetId,
ResultPartitionID resultPartitionId)
Requests the execution state of the execution producing a result partition.
|
Modifier and Type | Method and Description |
---|---|
void |
TaskExecutorGateway.releasePartitions(JobID jobId,
Collection<ResultPartitionID> partitionIds)
Batch release intermediate result partitions.
|
void |
TaskExecutor.releasePartitions(JobID jobId,
Collection<ResultPartitionID> partitionIds) |
Modifier and Type | Method and Description |
---|---|
Collection<ResultPartitionID> |
PartitionTable.stopTrackingPartitions(K key)
Stops the tracking of all partition for the given key.
|
Modifier and Type | Method and Description |
---|---|
void |
PartitionTable.startTrackingPartitions(K key,
Collection<ResultPartitionID> newPartitionIds)
Starts the tracking of the given partition for the given key.
|
void |
PartitionTable.stopTrackingPartitions(K key,
Collection<ResultPartitionID> partitionIds)
Stops the tracking of the given set of partitions for the given key.
|
Modifier and Type | Method and Description |
---|---|
void |
RpcResultPartitionConsumableNotifier.notifyPartitionConsumable(JobID jobId,
ResultPartitionID partitionId,
TaskActions taskActions) |
CompletableFuture<ExecutionState> |
RpcPartitionStateChecker.requestPartitionProducerState(JobID jobId,
IntermediateDataSetID resultId,
ResultPartitionID partitionId) |
Modifier and Type | Method and Description |
---|---|
ResultPartitionID |
ConsumableNotifyingResultPartitionWriterDecorator.getPartitionId() |
Modifier and Type | Method and Description |
---|---|
void |
Task.requestPartitionProducerState(IntermediateDataSetID intermediateDataSetId,
ResultPartitionID resultPartitionId,
java.util.function.Consumer<? super PartitionProducerStateProvider.ResponseHandle> responseConsumer) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.