public class ZooKeeperSubmittedJobGraphStore extends Object implements SubmittedJobGraphStore
SubmittedJobGraph
instances for JobManagers running in RecoveryMode.ZOOKEEPER
.
Each job graph creates ZNode:
+----O /flink/jobgraphs/<job-id> 1 [persistent] . . . +----O /flink/jobgraphs/<job-id> N [persistent]
The root path is watched to detect concurrent modifications in corner situations where
multiple instances operate concurrently. The job manager acts as a SubmittedJobGraphListener
to react to such situations.
SubmittedJobGraphStore.SubmittedJobGraphListener
Constructor and Description |
---|
ZooKeeperSubmittedJobGraphStore(org.apache.curator.framework.CuratorFramework client,
String currentJobsPath,
StateStorageHelper<SubmittedJobGraph> stateStorage)
Submitted job graph store backed by ZooKeeper
|
Modifier and Type | Method and Description |
---|---|
static String |
getPathForJob(JobID jobId)
Returns the JobID as a String (with leading slash).
|
void |
putJobGraph(SubmittedJobGraph jobGraph)
Adds the
SubmittedJobGraph instance. |
scala.Option<SubmittedJobGraph> |
recoverJobGraph(JobID jobId)
Returns the
SubmittedJobGraph with the given JobID . |
List<SubmittedJobGraph> |
recoverJobGraphs()
Returns a list of all submitted
JobGraph instances. |
void |
removeJobGraph(JobID jobId)
Removes the
SubmittedJobGraph with the given JobID if it exists. |
void |
start(SubmittedJobGraphStore.SubmittedJobGraphListener jobGraphListener)
Starts the
SubmittedJobGraphStore service. |
void |
stop()
Stops the
SubmittedJobGraphStore service. |
public ZooKeeperSubmittedJobGraphStore(org.apache.curator.framework.CuratorFramework client, String currentJobsPath, StateStorageHelper<SubmittedJobGraph> stateStorage) throws Exception
client
- ZooKeeper clientcurrentJobsPath
- ZooKeeper path for current job graphsstateStorage
- State storage used to persist the submitted jobsException
public void start(SubmittedJobGraphStore.SubmittedJobGraphListener jobGraphListener) throws Exception
SubmittedJobGraphStore
SubmittedJobGraphStore
service.start
in interface SubmittedJobGraphStore
Exception
public void stop() throws Exception
SubmittedJobGraphStore
SubmittedJobGraphStore
service.stop
in interface SubmittedJobGraphStore
Exception
public List<SubmittedJobGraph> recoverJobGraphs() throws Exception
SubmittedJobGraphStore
JobGraph
instances.recoverJobGraphs
in interface SubmittedJobGraphStore
Exception
public scala.Option<SubmittedJobGraph> recoverJobGraph(JobID jobId) throws Exception
SubmittedJobGraphStore
SubmittedJobGraph
with the given JobID
.
An Exception is thrown, if no job graph with the given ID exists.
recoverJobGraph
in interface SubmittedJobGraphStore
Exception
public void putJobGraph(SubmittedJobGraph jobGraph) throws Exception
SubmittedJobGraphStore
SubmittedJobGraph
instance.
If a job graph with the same JobID
exists, it is replaced.
putJobGraph
in interface SubmittedJobGraphStore
Exception
public void removeJobGraph(JobID jobId) throws Exception
SubmittedJobGraphStore
SubmittedJobGraph
with the given JobID
if it exists.removeJobGraph
in interface SubmittedJobGraphStore
Exception
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.