public class AdaptiveBatchScheduler extends DefaultScheduler implements SchedulerOperations
log, schedulingStrategy
executionVertexVersioner, inputsLocationsRetriever, operatorCoordinatorHandler, stateLocationRetriever
Modifier and Type | Method and Description |
---|---|
static VertexParallelismStore |
computeVertexParallelismStoreForDynamicGraph(Iterable<JobVertex> vertices,
int defaultMaxParallelism)
Compute the
VertexParallelismStore for all given vertices in a dynamic graph, which
will set defaults and ensure that the returned store contains valid parallelisms, with the
configured default max parallelism. |
void |
startSchedulingInternal() |
protected void |
updateTaskExecutionStateInternal(ExecutionVertexID executionVertexId,
TaskExecutionStateTransition taskExecutionState) |
allocateSlotsAndDeploy, cancelAllPendingSlotRequestsInternal, getNumberOfRestarts, handleGlobalFailure, notifyPartitionDataAvailableInternal
acknowledgeCheckpoint, archiveFromFailureHandlingResult, archiveGlobalFailure, cancel, closeAsync, computeVertexParallelismStore, computeVertexParallelismStore, computeVertexParallelismStore, computeVertexParallelismStore, declineCheckpoint, deliverCoordinationRequestToCoordinator, deliverOperatorEventToCoordinator, failJob, getDefaultMaxParallelism, getExecutionGraph, getExecutionJobVertex, getExecutionVertex, getExecutionVertexId, getExecutionVertexIdOrThrow, getJobGraph, getJobTerminationFuture, getMainThreadExecutor, getResultPartitionAvailabilityChecker, getSchedulingTopology, notifyKvStateRegistered, notifyKvStateUnregistered, notifyPartitionDataAvailable, registerJobMetrics, reportCheckpointMetrics, requestJob, requestJobDetails, requestJobStatus, requestKvStateLocation, requestNextInputSplit, requestPartitionState, resetForNewExecutions, restoreState, setGlobalFailureCause, startCheckpointScheduler, startScheduling, stopCheckpointScheduler, stopWithSavepoint, transitionExecutionGraphState, transitionToRunning, transitionToScheduled, triggerCheckpoint, triggerSavepoint, updateAccumulators, updateTaskExecutionState
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
allocateSlotsAndDeploy
updateTaskExecutionState
close
public void startSchedulingInternal()
startSchedulingInternal
in class DefaultScheduler
protected void updateTaskExecutionStateInternal(ExecutionVertexID executionVertexId, TaskExecutionStateTransition taskExecutionState)
updateTaskExecutionStateInternal
in class DefaultScheduler
@VisibleForTesting public static VertexParallelismStore computeVertexParallelismStoreForDynamicGraph(Iterable<JobVertex> vertices, int defaultMaxParallelism)
VertexParallelismStore
for all given vertices in a dynamic graph, which
will set defaults and ensure that the returned store contains valid parallelisms, with the
configured default max parallelism.vertices
- the vertices to compute parallelism fordefaultMaxParallelism
- the global default max parallelismCopyright © 2014–2023 The Apache Software Foundation. All rights reserved.