Modifier and Type | Method and Description |
---|---|
BlocklistHandler |
NoOpBlocklistHandler.Factory.create(BlocklistContext blocklistContext,
java.util.function.Function<ResourceID,String> taskManagerNodeIdRetriever,
ComponentMainThreadExecutor mainThreadExecutor,
org.slf4j.Logger log) |
BlocklistHandler |
BlocklistHandler.Factory.create(BlocklistContext blocklistContext,
java.util.function.Function<ResourceID,String> taskManagerNodeIdRetriever,
ComponentMainThreadExecutor mainThreadExecutor,
org.slf4j.Logger log)
Instantiates a
BlocklistHandler . |
BlocklistHandler |
DefaultBlocklistHandler.Factory.create(BlocklistContext blocklistContext,
java.util.function.Function<ResourceID,String> taskManagerNodeIdRetriever,
ComponentMainThreadExecutor mainThreadExecutor,
org.slf4j.Logger log) |
Modifier and Type | Class and Description |
---|---|
static class |
ComponentMainThreadExecutor.DummyComponentMainThreadExecutor
Dummy implementation of ComponentMainThreadExecutor.
|
Constructor and Description |
---|
OnMainThreadJobManagerRunnerRegistry(JobManagerRunnerRegistry delegate,
ComponentMainThreadExecutor mainThreadExecutor) |
Modifier and Type | Method and Description |
---|---|
ComponentMainThreadExecutor |
DefaultExecutionGraph.getJobMasterMainThreadExecutor() |
ComponentMainThreadExecutor |
InternalExecutionGraphAccessor.getJobMasterMainThreadExecutor() |
ComponentMainThreadExecutor |
ExecutionGraph.getJobMasterMainThreadExecutor() |
Modifier and Type | Method and Description |
---|---|
void |
DefaultExecutionGraph.start(ComponentMainThreadExecutor jobMasterMainThreadExecutor) |
void |
ExecutionGraph.start(ComponentMainThreadExecutor jobMasterMainThreadExecutor) |
Modifier and Type | Method and Description |
---|---|
SchedulerNG |
SlotPoolServiceSchedulerFactory.createScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration configuration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
BlocklistOperations blocklistOperations)
Creates a
SchedulerNG . |
SchedulerNG |
DefaultSlotPoolServiceSchedulerFactory.createScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration configuration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
BlocklistOperations blocklistOperations) |
Modifier and Type | Method and Description |
---|---|
protected void |
DeclarativeSlotPoolBridge.onStart(ComponentMainThreadExecutor componentMainThreadExecutor) |
protected void |
DeclarativeSlotPoolService.onStart(ComponentMainThreadExecutor componentMainThreadExecutor)
This method is called when the slot pool service is started.
|
void |
PhysicalSlotRequestBulkChecker.start(ComponentMainThreadExecutor mainThreadExecutor)
Starts the bulk checker by initializing the main thread executor.
|
void |
PhysicalSlotRequestBulkCheckerImpl.start(ComponentMainThreadExecutor mainThreadExecutor) |
void |
SlotPool.start(JobMasterId jobMasterId,
String newJobManagerAddress,
ComponentMainThreadExecutor jmMainThreadScheduledExecutor) |
void |
DeclarativeSlotPoolService.start(JobMasterId jobMasterId,
String address,
ComponentMainThreadExecutor mainThreadExecutor) |
void |
SlotPoolService.start(JobMasterId jobMasterId,
String address,
ComponentMainThreadExecutor mainThreadExecutor)
Start the encapsulated slot pool implementation.
|
Modifier and Type | Method and Description |
---|---|
void |
OperatorCoordinatorHolder.lazyInitialize(GlobalFailureHandler globalFailureHandler,
ComponentMainThreadExecutor mainThreadExecutor) |
Modifier and Type | Class and Description |
---|---|
protected static class |
RpcEndpoint.MainThreadExecutor
Executor which executes runnables in the main thread context.
|
Modifier and Type | Method and Description |
---|---|
protected ComponentMainThreadExecutor |
SchedulerBase.getMainThreadExecutor() |
Modifier and Type | Method and Description |
---|---|
DefaultExecutionDeployer |
DefaultExecutionDeployer.Factory.createInstance(org.slf4j.Logger log,
ExecutionSlotAllocator executionSlotAllocator,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
Time partitionRegistrationTimeout,
java.util.function.BiConsumer<ExecutionVertexID,AllocationID> allocationReservationFunc,
ComponentMainThreadExecutor mainThreadExecutor) |
ExecutionDeployer |
ExecutionDeployer.Factory.createInstance(org.slf4j.Logger log,
ExecutionSlotAllocator executionSlotAllocator,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
Time partitionRegistrationTimeout,
java.util.function.BiConsumer<ExecutionVertexID,AllocationID> allocationReservationFunc,
ComponentMainThreadExecutor mainThreadExecutor)
Instantiate an
ExecutionDeployer with the given params. |
SchedulerNG |
DefaultSchedulerFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
BlocklistOperations blocklistOperations) |
SchedulerNG |
SchedulerNGFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
BlocklistOperations blocklistOperations) |
void |
DefaultOperatorCoordinatorHandler.initializeOperatorCoordinators(ComponentMainThreadExecutor mainThreadExecutor) |
void |
OperatorCoordinatorHandler.initializeOperatorCoordinators(ComponentMainThreadExecutor mainThreadExecutor)
Initialize operator coordinators.
|
void |
DefaultOperatorCoordinatorHandler.registerAndStartNewCoordinators(Collection<OperatorCoordinatorHolder> coordinators,
ComponentMainThreadExecutor mainThreadExecutor) |
void |
OperatorCoordinatorHandler.registerAndStartNewCoordinators(Collection<OperatorCoordinatorHolder> coordinators,
ComponentMainThreadExecutor mainThreadExecutor)
Register and start new operator coordinators.
|
Constructor and Description |
---|
DefaultScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
java.util.function.Consumer<ComponentMainThreadExecutor> startUpAction,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
Time rpcTimeout,
VertexParallelismStore vertexParallelismStore,
ExecutionDeployer.Factory executionDeployerFactory) |
ExecutionGraphHandler(ExecutionGraph executionGraph,
org.slf4j.Logger log,
Executor ioExecutor,
ComponentMainThreadExecutor mainThreadExecutor) |
SchedulerBase(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
ExecutionVertexVersioner executionVertexVersioner,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
VertexParallelismStore vertexParallelismStore) |
Constructor and Description |
---|
DefaultScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
java.util.function.Consumer<ComponentMainThreadExecutor> startUpAction,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
Time rpcTimeout,
VertexParallelismStore vertexParallelismStore,
ExecutionDeployer.Factory executionDeployerFactory) |
Modifier and Type | Method and Description |
---|---|
ComponentMainThreadExecutor |
AdaptiveScheduler.getMainThreadExecutor() |
Modifier and Type | Method and Description |
---|---|
SchedulerNG |
AdaptiveSchedulerFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
BlocklistOperations blocklistOperations) |
Constructor and Description |
---|
AdaptiveScheduler(JobGraph jobGraph,
Configuration configuration,
DeclarativeSlotPool declarativeSlotPool,
SlotAllocator slotAllocator,
Executor ioExecutor,
ClassLoader userCodeClassLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
java.time.Duration initialResourceAllocationTimeout,
java.time.Duration resourceStabilizationTimeout,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory) |
Modifier and Type | Method and Description |
---|---|
SchedulerNG |
AdaptiveBatchSchedulerFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
BlocklistOperations blocklistOperations) |
Constructor and Description |
---|
AdaptiveBatchScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
java.util.function.Consumer<ComponentMainThreadExecutor> startUpAction,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
Time rpcTimeout,
VertexParallelismDecider vertexParallelismDecider,
int defaultMaxParallelism) |
SpeculativeScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
java.util.function.Consumer<ComponentMainThreadExecutor> startUpAction,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
Time rpcTimeout,
VertexParallelismDecider vertexParallelismDecider,
int defaultMaxParallelism,
BlocklistOperations blocklistOperations) |
Constructor and Description |
---|
AdaptiveBatchScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
java.util.function.Consumer<ComponentMainThreadExecutor> startUpAction,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
Time rpcTimeout,
VertexParallelismDecider vertexParallelismDecider,
int defaultMaxParallelism) |
SpeculativeScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
java.util.function.Consumer<ComponentMainThreadExecutor> startUpAction,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
Time rpcTimeout,
VertexParallelismDecider vertexParallelismDecider,
int defaultMaxParallelism,
BlocklistOperations blocklistOperations) |
Modifier and Type | Method and Description |
---|---|
void |
ExecutionTimeBasedSlowTaskDetector.start(ExecutionGraph executionGraph,
SlowTaskDetectorListener listener,
ComponentMainThreadExecutor mainThreadExecutor) |
void |
SlowTaskDetector.start(ExecutionGraph executionGraph,
SlowTaskDetectorListener listener,
ComponentMainThreadExecutor mainThreadExecutor)
Start detecting slow tasks periodically.
|
Modifier and Type | Method and Description |
---|---|
CompletableFuture<String> |
StopWithSavepointTerminationManager.stopWithSavepoint(CompletableFuture<CompletedCheckpoint> completedSavepointFuture,
CompletableFuture<Collection<ExecutionState>> terminatedExecutionStatesFuture,
ComponentMainThreadExecutor mainThreadExecutor)
Enforces the correct completion order of the passed
CompletableFuture instances in
accordance to the contract of StopWithSavepointTerminationHandler . |
Modifier and Type | Method and Description |
---|---|
void |
TaskSlotTable.start(SlotActions initialSlotActions,
ComponentMainThreadExecutor mainThreadExecutor)
Start the task slot table with the given slot actions.
|
void |
TaskSlotTableImpl.start(SlotActions initialSlotActions,
ComponentMainThreadExecutor mainThreadExecutor) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.