Modifier and Type | Class and Description |
---|---|
class |
KubernetesCheckpointRecoveryFactory
Factory to create
CompletedCheckpointStore and CheckpointIDCounter . |
Modifier and Type | Method and Description |
---|---|
protected CheckpointRecoveryFactory |
KubernetesLeaderElectionHaServices.createCheckpointRecoveryFactory() |
Modifier and Type | Class and Description |
---|---|
class |
PerJobCheckpointRecoveryFactory<T extends CompletedCheckpointStore>
Simple
CheckpointRecoveryFactory which creates and keeps separate CompletedCheckpointStore and CheckpointIDCounter for each JobID . |
class |
StandaloneCheckpointRecoveryFactory
CheckpointCoordinator components in HighAvailabilityMode.NONE . |
class |
ZooKeeperCheckpointRecoveryFactory
CheckpointCoordinator components in HighAvailabilityMode.ZOOKEEPER . |
Modifier and Type | Method and Description |
---|---|
static <T extends CompletedCheckpointStore> |
PerJobCheckpointRecoveryFactory.withoutCheckpointStoreRecovery(IntFunction<T> storeFn) |
Modifier and Type | Method and Description |
---|---|
JobManagerRunner |
CleanupRunnerFactory.create(JobResult jobResult,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Configuration configuration,
Executor cleanupExecutor) |
CheckpointResourcesCleanupRunner |
CheckpointResourcesCleanupRunnerFactory.create(JobResult jobResult,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Configuration configuration,
Executor cleanupExecutor) |
Constructor and Description |
---|
CheckpointResourcesCleanupRunner(JobResult jobResult,
CheckpointRecoveryFactory checkpointRecoveryFactory,
SharedStateRegistryFactory sharedStateRegistryFactory,
Configuration jobManagerConfiguration,
Executor cleanupExecutor,
long initializationTimestamp) |
Modifier and Type | Method and Description |
---|---|
protected abstract CheckpointRecoveryFactory |
AbstractHaServices.createCheckpointRecoveryFactory()
Create the checkpoint recovery factory for the job manager.
|
CheckpointRecoveryFactory |
AbstractHaServices.getCheckpointRecoveryFactory() |
CheckpointRecoveryFactory |
HighAvailabilityServices.getCheckpointRecoveryFactory()
Gets the checkpoint recovery factory for the job manager.
|
Modifier and Type | Method and Description |
---|---|
CheckpointRecoveryFactory |
AbstractNonHaServices.getCheckpointRecoveryFactory() |
Modifier and Type | Method and Description |
---|---|
CheckpointRecoveryFactory |
EmbeddedHaServicesWithLeadershipControl.getCheckpointRecoveryFactory() |
Constructor and Description |
---|
EmbeddedHaServicesWithLeadershipControl(Executor executor,
CheckpointRecoveryFactory checkpointRecoveryFactory) |
Modifier and Type | Method and Description |
---|---|
CheckpointRecoveryFactory |
ZooKeeperLeaderElectionHaServices.createCheckpointRecoveryFactory() |
Modifier and Type | Method and Description |
---|---|
SchedulerNG |
DefaultSlotPoolServiceSchedulerFactory.createScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration configuration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
BlocklistOperations blocklistOperations) |
SchedulerNG |
SlotPoolServiceSchedulerFactory.createScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration configuration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
BlocklistOperations blocklistOperations)
Creates a
SchedulerNG . |
Modifier and Type | Method and Description |
---|---|
static CheckpointIDCounter |
SchedulerUtils.createCheckpointIDCounterIfCheckpointingIsEnabled(JobGraph jobGraph,
CheckpointRecoveryFactory checkpointRecoveryFactory) |
static CompletedCheckpointStore |
SchedulerUtils.createCompletedCheckpointStoreIfCheckpointingIsEnabled(JobGraph jobGraph,
Configuration configuration,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Executor ioExecutor,
org.slf4j.Logger log) |
SchedulerNG |
SchedulerNGFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
BlocklistOperations blocklistOperations) |
SchedulerNG |
DefaultSchedulerFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
BlocklistOperations blocklistOperations) |
Constructor and Description |
---|
DefaultScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
Consumer<ComponentMainThreadExecutor> startUpAction,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
Time rpcTimeout,
VertexParallelismStore vertexParallelismStore,
ExecutionDeployer.Factory executionDeployerFactory) |
SchedulerBase(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
ExecutionVertexVersioner executionVertexVersioner,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
VertexParallelismStore vertexParallelismStore) |
Modifier and Type | Method and Description |
---|---|
SchedulerNG |
AdaptiveSchedulerFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
BlocklistOperations blocklistOperations) |
Constructor and Description |
---|
AdaptiveScheduler(AdaptiveScheduler.Settings settings,
JobGraph jobGraph,
JobResourceRequirements jobResourceRequirements,
Configuration configuration,
DeclarativeSlotPool declarativeSlotPool,
SlotAllocator slotAllocator,
Executor ioExecutor,
ClassLoader userCodeClassLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
ExecutionGraphFactory executionGraphFactory) |
Modifier and Type | Method and Description |
---|---|
SchedulerNG |
AdaptiveBatchSchedulerFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
SlotPoolService slotPoolService,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
FatalErrorHandler fatalErrorHandler,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
BlocklistOperations blocklistOperations) |
static AdaptiveBatchScheduler |
AdaptiveBatchSchedulerFactory.createScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
ExecutionConfig executionConfig,
Executor ioExecutor,
Configuration jobMasterConfiguration,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentTracker executionDeploymentTracker,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
BlocklistOperations blocklistOperations,
ExecutionOperations executionOperations,
ExecutionSlotAllocatorFactory allocatorFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ScheduledExecutor delayExecutor,
VertexParallelismAndInputInfosDecider vertexParallelismAndInputInfosDecider,
BatchJobRecoveryHandler jobRecoveryHandler) |
Constructor and Description |
---|
AdaptiveBatchScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
Configuration jobMasterConfiguration,
Consumer<ComponentMainThreadExecutor> startUpAction,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
Collection<FailureEnricher> failureEnrichers,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
Time rpcTimeout,
VertexParallelismAndInputInfosDecider vertexParallelismAndInputInfosDecider,
int defaultMaxParallelism,
BlocklistOperations blocklistOperations,
JobManagerOptions.HybridPartitionDataConsumeConstraint hybridPartitionDataConsumeConstraint,
Map<JobVertexID,ForwardGroup> forwardGroupsByJobVertexId,
BatchJobRecoveryHandler jobRecoveryHandler) |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.