public abstract class AbstractYarnNonHaServices extends YarnHighAvailabilityServices
Internally, these services put their recovery data into YARN's working directory, except for checkpoints, which are in the configured checkpoint directory. That way, checkpoints can be resumed with a new job/application, even if the complete YARN application is killed and cleaned up.
blobStoreService, FLINK_RECOVERY_DATA_DIR, flinkFileSystem, haDataDirectory, hadoopFileSystem, LOG, workingDirectory
DEFAULT_JOB_ID, DEFAULT_LEADER_ID
Modifier | Constructor and Description |
---|---|
protected |
AbstractYarnNonHaServices(Configuration config,
org.apache.hadoop.conf.Configuration hadoopConf)
Creates new YARN high-availability services, configuring the file system and recovery
data directory based on the working directory in the given Hadoop configuration.
|
Modifier and Type | Method and Description |
---|---|
CheckpointRecoveryFactory |
getCheckpointRecoveryFactory()
Gets the checkpoint recovery factory for the job manager
|
RunningJobsRegistry |
getRunningJobsRegistry()
Gets the registry that holds information about whether jobs are currently running.
|
SubmittedJobGraphStore |
getSubmittedJobGraphStore()
Gets the submitted job graph store for the job manager
|
close, closeAndCleanupAllData, createBlobStore, forSingleJobAppMaster, forYarnTaskManager, isClosed
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getJobManagerLeaderElectionService, getJobManagerLeaderRetriever, getResourceManagerLeaderElectionService, getResourceManagerLeaderRetriever
protected AbstractYarnNonHaServices(Configuration config, org.apache.hadoop.conf.Configuration hadoopConf) throws IOException
This class requires that the default Hadoop file system configured in the given Hadoop configuration is an HDFS.
config
- The Flink configuration of this component / process.hadoopConf
- The Hadoop configuration for the YARN cluster.IOException
- Thrown, if the initialization of the Hadoop file system used by YARN fails.public RunningJobsRegistry getRunningJobsRegistry() throws IOException
HighAvailabilityServices
IOException
public CheckpointRecoveryFactory getCheckpointRecoveryFactory()
HighAvailabilityServices
public SubmittedJobGraphStore getSubmittedJobGraphStore() throws Exception
HighAvailabilityServices
Exception
- if the submitted job graph store could not be createdCopyright © 2014–2018 The Apache Software Foundation. All rights reserved.