org.apache.flink.runtime.dispatcher.cleanup

Class DispatcherResourceCleanerFactory

java.lang.Object

org.apache.flink.runtime.dispatcher.cleanup.DispatcherResourceCleanerFactory

All Implemented Interfaces:

ResourceCleanerFactory

public class DispatcherResourceCleanerFactory
extends Object
implements ResourceCleanerFactory

DispatcherResourceCleanerFactory instantiates ResourceCleaner instances that clean cleanable resources from the Dispatcher.

We need to handle the JobManagerRunnerRegistry differently due to a dependency between closing the JobManagerRunner and the HighAvailabilityServices. This is fixed in FLINK-24038 using a feature flag to enable/disable single leader election for all the JobManager components. We can remove the priority cleanup logic after removing the per-component leader election.

Constructor Summary

Constructors

Constructor and Description
DispatcherResourceCleanerFactory(Executor cleanupExecutor, RetryStrategy retryStrategy, JobManagerRunnerRegistry jobManagerRunnerRegistry, JobGraphWriter jobGraphWriter, BlobServer blobServer, HighAvailabilityServices highAvailabilityServices, JobManagerMetricGroup jobManagerMetricGroup)
DispatcherResourceCleanerFactory(JobManagerRunnerRegistry jobManagerRunnerRegistry, DispatcherServices dispatcherServices)

Method Summary

Modifier and Type	Method and Description
ResourceCleaner	createGlobalResourceCleaner(ComponentMainThreadExecutor mainThreadExecutor) Creates ResourceCleaner that initiates GloballyCleanableResource.globalCleanupAsync(JobID, Executor) calls.
ResourceCleaner	createLocalResourceCleaner(ComponentMainThreadExecutor mainThreadExecutor) Creates ResourceCleaner that initiates LocallyCleanableResource.localCleanupAsync(JobID, Executor) calls.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DispatcherResourceCleanerFactory

public DispatcherResourceCleanerFactory(JobManagerRunnerRegistry jobManagerRunnerRegistry,
                                        DispatcherServices dispatcherServices)

DispatcherResourceCleanerFactory

@VisibleForTesting
public DispatcherResourceCleanerFactory(Executor cleanupExecutor,
                                                           RetryStrategy retryStrategy,
                                                           JobManagerRunnerRegistry jobManagerRunnerRegistry,
                                                           JobGraphWriter jobGraphWriter,
                                                           BlobServer blobServer,
                                                           HighAvailabilityServices highAvailabilityServices,
                                                           JobManagerMetricGroup jobManagerMetricGroup)

Method Detail

createLocalResourceCleaner

public ResourceCleaner createLocalResourceCleaner(ComponentMainThreadExecutor mainThreadExecutor)

Description copied from interface: ResourceCleanerFactory

Creates ResourceCleaner that initiates LocallyCleanableResource.localCleanupAsync(JobID, Executor) calls.

Specified by:

createLocalResourceCleaner in interface ResourceCleanerFactory

Parameters:

mainThreadExecutor - Used for validating that the LocallyCleanableResource.localCleanupAsync(JobID, Executor) is called from the main thread.

createGlobalResourceCleaner

public ResourceCleaner createGlobalResourceCleaner(ComponentMainThreadExecutor mainThreadExecutor)

Description copied from interface: ResourceCleanerFactory

Creates ResourceCleaner that initiates GloballyCleanableResource.globalCleanupAsync(JobID, Executor) calls.

Specified by:

createGlobalResourceCleaner in interface ResourceCleanerFactory

Parameters:

mainThreadExecutor - Used for validating that the GloballyCleanableResource.globalCleanupAsync(JobID, Executor) is called from the main thread.