public class ZooKeeperSubmittedJobGraphStore extends Object implements SubmittedJobGraphStore
SubmittedJobGraph
instances for JobManagers running in HighAvailabilityMode.ZOOKEEPER
.
Each job graph creates ZNode:
+----O /flink/jobgraphs/<job-id> 1 [persistent] . . . +----O /flink/jobgraphs/<job-id> N [persistent]
The root path is watched to detect concurrent modifications in corner situations where
multiple instances operate concurrently. The job manager acts as a SubmittedJobGraphListener
to react to such situations.
SubmittedJobGraphStore.SubmittedJobGraphListener
Constructor and Description |
---|
ZooKeeperSubmittedJobGraphStore(org.apache.curator.framework.CuratorFramework client,
String currentJobsPath,
RetrievableStateStorageHelper<SubmittedJobGraph> stateStorage,
Executor executor)
Submitted job graph store backed by ZooKeeper
|
Modifier and Type | Method and Description |
---|---|
Collection<JobID> |
getJobIds()
Get all job ids of submitted job graphs to the submitted job graph store.
|
static String |
getPathForJob(JobID jobId)
Returns the JobID as a String (with leading slash).
|
static JobID |
jobIdfromPath(String path)
Returns the JobID from the given path in ZooKeeper.
|
void |
putJobGraph(SubmittedJobGraph jobGraph)
Adds the
SubmittedJobGraph instance. |
SubmittedJobGraph |
recoverJobGraph(JobID jobId)
Returns the
SubmittedJobGraph with the given JobID . |
void |
removeJobGraph(JobID jobId)
Removes the
SubmittedJobGraph with the given JobID if it exists. |
void |
start(SubmittedJobGraphStore.SubmittedJobGraphListener jobGraphListener)
Starts the
SubmittedJobGraphStore service. |
void |
stop()
Stops the
SubmittedJobGraphStore service. |
public ZooKeeperSubmittedJobGraphStore(org.apache.curator.framework.CuratorFramework client, String currentJobsPath, RetrievableStateStorageHelper<SubmittedJobGraph> stateStorage, Executor executor) throws Exception
client
- ZooKeeper clientcurrentJobsPath
- ZooKeeper path for current job graphsstateStorage
- State storage used to persist the submitted jobsexecutor
- to give to the ZooKeeperStateHandleStore to run ZooKeeper callbacksException
public void start(SubmittedJobGraphStore.SubmittedJobGraphListener jobGraphListener) throws Exception
SubmittedJobGraphStore
SubmittedJobGraphStore
service.start
in interface SubmittedJobGraphStore
Exception
public void stop() throws Exception
SubmittedJobGraphStore
SubmittedJobGraphStore
service.stop
in interface SubmittedJobGraphStore
Exception
public SubmittedJobGraph recoverJobGraph(JobID jobId) throws Exception
SubmittedJobGraphStore
SubmittedJobGraph
with the given JobID
.
An Exception is thrown, if no job graph with the given ID exists.
recoverJobGraph
in interface SubmittedJobGraphStore
Exception
public void putJobGraph(SubmittedJobGraph jobGraph) throws Exception
SubmittedJobGraphStore
SubmittedJobGraph
instance.
If a job graph with the same JobID
exists, it is replaced.
putJobGraph
in interface SubmittedJobGraphStore
Exception
public void removeJobGraph(JobID jobId) throws Exception
SubmittedJobGraphStore
SubmittedJobGraph
with the given JobID
if it exists.removeJobGraph
in interface SubmittedJobGraphStore
Exception
public Collection<JobID> getJobIds() throws Exception
SubmittedJobGraphStore
getJobIds
in interface SubmittedJobGraphStore
Exception
- if the operation failspublic static String getPathForJob(JobID jobId)
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.