Modifier and Type | Method and Description |
---|---|
static JobID |
JobID.fromByteArray(byte[] bytes)
Creates a new JobID from the given byte sequence.
|
static JobID |
JobID.fromByteBuffer(ByteBuffer buf) |
static JobID |
JobID.fromHexString(String hexString)
Parses a JobID from the given string.
|
static JobID |
JobID.generate()
Creates a new (statistically) random JobID.
|
JobID |
Plan.getJobId()
Gets the ID of the job that the dataflow plan belongs to.
|
JobID |
JobSubmissionResult.getJobID()
Returns the JobID assigned to the job by the Flink runtime.
|
Modifier and Type | Method and Description |
---|---|
void |
Plan.setJobId(JobID jobId)
Sets the ID of the job that the dataflow plan belongs to.
|
Constructor and Description |
---|
JobExecutionResult(JobID jobID,
long netRuntime,
Map<String,OptionalFailure<Object>> accumulators)
Creates a new JobExecutionResult.
|
JobSubmissionResult(JobID jobID) |
Modifier and Type | Method and Description |
---|---|
JobID |
ClusterClientJobClientAdapter.getJobID() |
Constructor and Description |
---|
ClusterClientJobClientAdapter(ClusterClientProvider<ClusterID> clusterClientProvider,
JobID jobID) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<JobID> |
ClusterClient.submitJob(JobGraph jobGraph)
Submit the given
JobGraph to the cluster. |
CompletableFuture<JobID> |
MiniClusterClient.submitJob(JobGraph jobGraph) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
ClusterClient.cancel(JobID jobId)
Cancels a job identified by the job id.
|
CompletableFuture<Acknowledge> |
MiniClusterClient.cancel(JobID jobId) |
CompletableFuture<String> |
ClusterClient.cancelWithSavepoint(JobID jobId,
String savepointDirectory)
Cancels a job identified by the job id and triggers a savepoint.
|
CompletableFuture<String> |
MiniClusterClient.cancelWithSavepoint(JobID jobId,
String savepointDirectory) |
static JobGraph |
PackagedProgramUtils.createJobGraph(PackagedProgram packagedProgram,
Configuration configuration,
int defaultParallelism,
JobID jobID,
boolean suppressOutput)
|
default CompletableFuture<Map<String,Object>> |
ClusterClient.getAccumulators(JobID jobID)
Requests and returns the accumulators for the given job identifier.
|
CompletableFuture<Map<String,Object>> |
ClusterClient.getAccumulators(JobID jobID,
ClassLoader loader)
Requests and returns the accumulators for the given job identifier.
|
CompletableFuture<Map<String,Object>> |
MiniClusterClient.getAccumulators(JobID jobID,
ClassLoader loader) |
CompletableFuture<JobStatus> |
ClusterClient.getJobStatus(JobID jobId)
|
CompletableFuture<JobStatus> |
MiniClusterClient.getJobStatus(JobID jobId) |
CompletableFuture<JobResult> |
ClusterClient.requestJobResult(JobID jobId)
|
CompletableFuture<JobResult> |
MiniClusterClient.requestJobResult(JobID jobId) |
CompletableFuture<String> |
ClusterClient.stopWithSavepoint(JobID jobId,
boolean advanceToEndOfEventTime,
String savepointDirectory)
Stops a program on Flink cluster whose job-manager is configured in this client's configuration.
|
CompletableFuture<String> |
MiniClusterClient.stopWithSavepoint(JobID jobId,
boolean advanceToEndOfEventTime,
String savepointDirector) |
CompletableFuture<String> |
ClusterClient.triggerSavepoint(JobID jobId,
String savepointDirectory)
Triggers a savepoint for the job identified by the job id.
|
CompletableFuture<String> |
MiniClusterClient.triggerSavepoint(JobID jobId,
String savepointDirectory) |
Constructor and Description |
---|
ProgramInvocationException(String message,
JobID jobID)
Creates a ProgramInvocationException with the given message which contains job id.
|
ProgramInvocationException(String message,
JobID jobID,
Throwable cause)
Creates a ProgramInvocationException for the given exception with an
additional message which contains job id.
|
Modifier and Type | Method and Description |
---|---|
CompletableFuture<JobID> |
RestClusterClient.submitJob(JobGraph jobGraph) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
RestClusterClient.cancel(JobID jobID) |
CompletableFuture<String> |
RestClusterClient.cancelWithSavepoint(JobID jobId,
String savepointDirectory) |
CompletableFuture<Map<String,Object>> |
RestClusterClient.getAccumulators(JobID jobID,
ClassLoader loader) |
CompletableFuture<JobDetailsInfo> |
RestClusterClient.getJobDetails(JobID jobId)
Requests the job details.
|
CompletableFuture<JobStatus> |
RestClusterClient.getJobStatus(JobID jobId) |
CompletableFuture<JobResult> |
RestClusterClient.requestJobResult(JobID jobId)
|
CompletableFuture<String> |
RestClusterClient.stopWithSavepoint(JobID jobId,
boolean advanceToEndOfTime,
String savepointDirectory) |
CompletableFuture<String> |
RestClusterClient.triggerSavepoint(JobID jobId,
String savepointDirectory) |
Modifier and Type | Field and Description |
---|---|
static JobID |
StandaloneJobClusterEntryPoint.ZERO_JOB_ID |
Modifier and Type | Method and Description |
---|---|
CheckpointStorage |
RocksDBStateBackend.createCheckpointStorage(JobID jobId) |
<K> AbstractKeyedStateBackend<K> |
RocksDBStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry) |
Modifier and Type | Method and Description |
---|---|
JobID |
DetachedJobExecutionResult.getJobID() |
JobID |
JobClient.getJobID()
Returns the
JobID that uniquely identifies the job this client is scoped to. |
Constructor and Description |
---|
DetachedJobExecutionResult(JobID jobID) |
Modifier and Type | Method and Description |
---|---|
JobGraph |
JobGraphGenerator.compileJobGraph(OptimizedPlan program,
JobID jobId) |
Modifier and Type | Method and Description |
---|---|
<K,S extends State,V> |
QueryableStateClient.getKvState(JobID jobId,
String queryableStateName,
K key,
TypeHint<K> keyTypeHint,
StateDescriptor<S,V> stateDescriptor)
Returns a future holding the request result.
|
<K,S extends State,V> |
QueryableStateClient.getKvState(JobID jobId,
String queryableStateName,
K key,
TypeInformation<K> keyTypeInfo,
StateDescriptor<S,V> stateDescriptor)
Returns a future holding the request result.
|
Modifier and Type | Method and Description |
---|---|
KvStateLocationOracle |
KvStateClientProxyImpl.getKvStateLocationOracle(JobID jobId) |
void |
KvStateClientProxyImpl.updateKvStateLocationOracle(JobID jobId,
KvStateLocationOracle kvStateLocationOracle) |
Modifier and Type | Method and Description |
---|---|
JobID |
KvStateRequest.getJobId() |
Constructor and Description |
---|
KvStateRequest(JobID jobId,
String stateName,
int keyHashCode,
byte[] serializedKeyAndNamespace) |
Modifier and Type | Field and Description |
---|---|
protected JobID |
AccumulatorRegistry.jobID |
Modifier and Type | Method and Description |
---|---|
JobID |
AccumulatorSnapshot.getJobID() |
Constructor and Description |
---|
AccumulatorRegistry(JobID jobID,
ExecutionAttemptID taskID) |
AccumulatorSnapshot(JobID jobID,
ExecutionAttemptID executionAttemptID,
Map<String,Accumulator<?,?>> userAccumulators) |
Modifier and Type | Method and Description |
---|---|
boolean |
BlobServer.cleanupJob(JobID jobId,
boolean cleanupBlobStoreFiles)
Removes all BLOBs from local and HA store belonging to the given job ID.
|
boolean |
FileSystemBlobStore.delete(JobID jobId,
BlobKey blobKey) |
boolean |
BlobStore.delete(JobID jobId,
BlobKey blobKey)
Tries to delete a blob from storage.
|
boolean |
VoidBlobStore.delete(JobID jobId,
BlobKey blobKey) |
boolean |
FileSystemBlobStore.deleteAll(JobID jobId) |
boolean |
BlobStore.deleteAll(JobID jobId)
Tries to delete all blobs for the given job from storage.
|
boolean |
VoidBlobStore.deleteAll(JobID jobId) |
boolean |
TransientBlobService.deleteFromCache(JobID jobId,
TransientBlobKey key)
Deletes the file associated with the provided job ID and blob key from the local cache.
|
boolean |
TransientBlobCache.deleteFromCache(JobID jobId,
TransientBlobKey key) |
boolean |
BlobServer.deleteFromCache(JobID jobId,
TransientBlobKey key)
Deletes the file associated with the blob key in the local storage of the blob server.
|
boolean |
BlobView.get(JobID jobId,
BlobKey blobKey,
File localFile)
Copies a blob to a local file.
|
boolean |
FileSystemBlobStore.get(JobID jobId,
BlobKey blobKey,
File localFile) |
boolean |
VoidBlobStore.get(JobID jobId,
BlobKey blobKey,
File localFile) |
File |
PermanentBlobService.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
File |
BlobServer.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
File |
PermanentBlobCache.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
File |
TransientBlobService.getFile(JobID jobId,
TransientBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
File |
TransientBlobCache.getFile(JobID jobId,
TransientBlobKey key) |
File |
BlobServer.getFile(JobID jobId,
TransientBlobKey key)
Retrieves the local path of a file associated with a job and a blob key.
|
protected File |
TransientBlobCache.getFileInternal(JobID jobId,
BlobKey blobKey) |
protected File |
AbstractBlobCache.getFileInternal(JobID jobId,
BlobKey blobKey)
Returns local copy of the file for the BLOB with the given key.
|
int |
PermanentBlobCache.getNumberOfReferenceHolders(JobID jobId) |
File |
TransientBlobCache.getStorageLocation(JobID jobId,
BlobKey key)
Returns a file handle to the file associated with the given blob key on the blob
server.
|
File |
BlobServer.getStorageLocation(JobID jobId,
BlobKey key)
Returns a file handle to the file associated with the given blob key on the blob
server.
|
File |
PermanentBlobCache.getStorageLocation(JobID jobId,
BlobKey key)
Returns a file handle to the file associated with the given blob key on the blob
server.
|
boolean |
FileSystemBlobStore.put(File localFile,
JobID jobId,
BlobKey blobKey) |
boolean |
BlobStore.put(File localFile,
JobID jobId,
BlobKey blobKey)
Copies the local file to the blob store.
|
boolean |
VoidBlobStore.put(File localFile,
JobID jobId,
BlobKey blobKey) |
PermanentBlobKey |
BlobWriter.putPermanent(JobID jobId,
byte[] value)
Uploads the data of the given byte array for the given job to the BLOB server and makes it
a permanent BLOB.
|
PermanentBlobKey |
BlobServer.putPermanent(JobID jobId,
byte[] value) |
PermanentBlobKey |
VoidBlobWriter.putPermanent(JobID jobId,
byte[] value) |
PermanentBlobKey |
BlobWriter.putPermanent(JobID jobId,
InputStream inputStream)
Uploads the data from the given input stream for the given job to the BLOB server and makes it
a permanent BLOB.
|
PermanentBlobKey |
BlobServer.putPermanent(JobID jobId,
InputStream inputStream) |
PermanentBlobKey |
VoidBlobWriter.putPermanent(JobID jobId,
InputStream inputStream) |
TransientBlobKey |
TransientBlobService.putTransient(JobID jobId,
byte[] value)
Uploads the data of the given byte array for the given job to the BLOB server.
|
TransientBlobKey |
TransientBlobCache.putTransient(JobID jobId,
byte[] value) |
TransientBlobKey |
BlobServer.putTransient(JobID jobId,
byte[] value) |
TransientBlobKey |
TransientBlobService.putTransient(JobID jobId,
InputStream inputStream)
Uploads the data from the given input stream for the given job to the BLOB server.
|
TransientBlobKey |
TransientBlobCache.putTransient(JobID jobId,
InputStream inputStream) |
TransientBlobKey |
BlobServer.putTransient(JobID jobId,
InputStream inputStream) |
void |
PermanentBlobCache.registerJob(JobID jobId)
Registers use of job-related BLOBs.
|
void |
PermanentBlobCache.releaseJob(JobID jobId)
Unregisters use of job-related BLOBs and allow them to be released.
|
static <T> Either<SerializedValue<T>,PermanentBlobKey> |
BlobWriter.serializeAndTryOffload(T value,
JobID jobId,
BlobWriter blobWriter)
Serializes the given value and offloads it to the BlobServer if its size exceeds the minimum
offloading size of the BlobServer.
|
PermanentBlobKey |
BlobClient.uploadFile(JobID jobId,
Path file)
Uploads a single file to the
PermanentBlobService of the given BlobServer . |
static List<PermanentBlobKey> |
BlobClient.uploadFiles(InetSocketAddress serverAddress,
Configuration clientConfig,
JobID jobId,
List<Path> files)
Uploads the JAR files to the
PermanentBlobService of the BlobServer at the
given address with HA as configured. |
Modifier and Type | Method and Description |
---|---|
JobID |
PendingCheckpoint.getJobId() |
JobID |
CompletedCheckpoint.getJobId() |
Modifier and Type | Method and Description |
---|---|
void |
CheckpointCoordinatorGateway.acknowledgeCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
CheckpointMetrics checkpointMetrics,
TaskStateSnapshot subtaskState) |
CheckpointIDCounter |
StandaloneCheckpointRecoveryFactory.createCheckpointIDCounter(JobID ignored) |
CheckpointIDCounter |
ZooKeeperCheckpointRecoveryFactory.createCheckpointIDCounter(JobID jobID) |
CheckpointIDCounter |
CheckpointRecoveryFactory.createCheckpointIDCounter(JobID jobId)
Creates a
CheckpointIDCounter instance for a job. |
CompletedCheckpointStore |
StandaloneCheckpointRecoveryFactory.createCheckpointStore(JobID jobId,
int maxNumberOfCheckpointsToRetain,
ClassLoader userClassLoader) |
CompletedCheckpointStore |
ZooKeeperCheckpointRecoveryFactory.createCheckpointStore(JobID jobId,
int maxNumberOfCheckpointsToRetain,
ClassLoader userClassLoader) |
CompletedCheckpointStore |
CheckpointRecoveryFactory.createCheckpointStore(JobID jobId,
int maxNumberOfCheckpointsToRetain,
ClassLoader userClassLoader)
Creates a
CompletedCheckpointStore instance for a job. |
void |
CheckpointCoordinatorDeActivator.jobStatusChanges(JobID jobId,
JobStatus newJobStatus,
long timestamp,
Throwable error) |
static CompletedCheckpoint |
Checkpoints.loadAndValidateCheckpoint(JobID jobId,
Map<JobVertexID,ExecutionJobVertex> tasks,
CompletedCheckpointStorageLocation location,
ClassLoader classLoader,
boolean allowNonRestoredState) |
Constructor and Description |
---|
CheckpointCoordinator(JobID job,
CheckpointCoordinatorConfiguration chkConfig,
ExecutionVertex[] tasksToTrigger,
ExecutionVertex[] tasksToWaitFor,
ExecutionVertex[] tasksToCommitTo,
CheckpointIDCounter checkpointIDCounter,
CompletedCheckpointStore completedCheckpointStore,
StateBackend checkpointStateBackend,
Executor executor,
ScheduledExecutor timer,
SharedStateRegistryFactory sharedStateRegistryFactory,
CheckpointFailureManager failureManager) |
CheckpointCoordinator(JobID job,
CheckpointCoordinatorConfiguration chkConfig,
ExecutionVertex[] tasksToTrigger,
ExecutionVertex[] tasksToWaitFor,
ExecutionVertex[] tasksToCommitTo,
CheckpointIDCounter checkpointIDCounter,
CompletedCheckpointStore completedCheckpointStore,
StateBackend checkpointStateBackend,
Executor executor,
ScheduledExecutor timer,
SharedStateRegistryFactory sharedStateRegistryFactory,
CheckpointFailureManager failureManager,
Clock clock) |
CompletedCheckpoint(JobID job,
long checkpointID,
long timestamp,
long completionTimestamp,
Map<OperatorID,OperatorState> operatorStates,
Collection<MasterState> masterHookStates,
CheckpointProperties props,
CompletedCheckpointStorageLocation storageLocation) |
PendingCheckpoint(JobID jobId,
long checkpointId,
long checkpointTimestamp,
Map<ExecutionAttemptID,ExecutionVertex> verticesToConfirm,
Collection<String> masterStateIdentifiers,
CheckpointProperties props,
CheckpointStorageLocation targetLocation,
Executor executor) |
Modifier and Type | Method and Description |
---|---|
JobID |
JobStatusMessage.getJobId() |
JobID |
SerializedJobExecutionResult.getJobId() |
JobID |
JobExecutionException.getJobID() |
Modifier and Type | Method and Description |
---|---|
JobID |
TaskDeploymentDescriptor.getJobId()
Returns the task's job ID.
|
Constructor and Description |
---|
TaskDeploymentDescriptor(JobID jobId,
TaskDeploymentDescriptor.MaybeOffloaded<JobInformation> serializedJobInformation,
TaskDeploymentDescriptor.MaybeOffloaded<TaskInformation> serializedTaskInformation,
ExecutionAttemptID executionAttemptId,
AllocationID allocationId,
int subtaskIndex,
int attemptNumber,
int targetSlotNumber,
JobManagerTaskRestore taskRestore,
Collection<ResultPartitionDeploymentDescriptor> resultPartitionDeploymentDescriptors,
Collection<InputGateDeploymentDescriptor> inputGateDeploymentDescriptors) |
Modifier and Type | Method and Description |
---|---|
Collection<JobID> |
SingleJobJobGraphStore.getJobIds() |
CompletableFuture<Collection<JobID>> |
DispatcherGateway.listJobs(Time timeout)
List the current set of submitted jobs.
|
CompletableFuture<Collection<JobID>> |
Dispatcher.listJobs(Time timeout) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
Dispatcher.cancelJob(JobID jobId,
Time timeout) |
CompletableFuture<Acknowledge> |
MiniDispatcher.cancelJob(JobID jobId,
Time timeout) |
ArchivedExecutionGraph |
ArchivedExecutionGraphStore.get(JobID jobId)
Get the
ArchivedExecutionGraph for the given job id. |
ArchivedExecutionGraph |
MemoryArchivedExecutionGraphStore.get(JobID jobId) |
ArchivedExecutionGraph |
FileArchivedExecutionGraphStore.get(JobID jobId) |
JobDetails |
ArchivedExecutionGraphStore.getAvailableJobDetails(JobID jobId)
Return the
JobDetails } for the given job. |
JobDetails |
MemoryArchivedExecutionGraphStore.getAvailableJobDetails(JobID jobId) |
JobDetails |
FileArchivedExecutionGraphStore.getAvailableJobDetails(JobID jobId) |
protected void |
Dispatcher.jobNotFinished(JobID jobId) |
protected void |
MiniDispatcher.jobNotFinished(JobID jobId) |
CompletableFuture<Void> |
Dispatcher.onRemovedJobGraph(JobID jobId) |
JobGraph |
SingleJobJobGraphStore.recoverJobGraph(JobID jobId) |
void |
SingleJobJobGraphStore.releaseJobGraph(JobID jobId) |
void |
SingleJobJobGraphStore.removeJobGraph(JobID jobId) |
CompletableFuture<ArchivedExecutionGraph> |
DispatcherGateway.requestJob(JobID jobId,
Time timeout)
Requests the
ArchivedExecutionGraph for the given jobId. |
CompletableFuture<ArchivedExecutionGraph> |
Dispatcher.requestJob(JobID jobId,
Time timeout) |
CompletableFuture<JobResult> |
Dispatcher.requestJobResult(JobID jobId,
Time timeout) |
CompletableFuture<JobResult> |
MiniDispatcher.requestJobResult(JobID jobId,
Time timeout) |
CompletableFuture<JobStatus> |
Dispatcher.requestJobStatus(JobID jobId,
Time timeout) |
CompletableFuture<OperatorBackPressureStatsResponse> |
Dispatcher.requestOperatorBackPressureStats(JobID jobId,
JobVertexID jobVertexId) |
CompletableFuture<String> |
Dispatcher.stopWithSavepoint(JobID jobId,
String targetDirectory,
boolean advanceToEndOfEventTime,
Time timeout) |
CompletableFuture<String> |
Dispatcher.triggerSavepoint(JobID jobId,
String targetDirectory,
boolean cancelJob,
Time timeout) |
Modifier and Type | Method and Description |
---|---|
void |
SessionDispatcherLeaderProcess.onAddedJobGraph(JobID jobId) |
void |
SessionDispatcherLeaderProcess.onRemovedJobGraph(JobID jobId) |
Modifier and Type | Method and Description |
---|---|
JobID |
Environment.getJobID()
Returns the ID of the job that the task belongs to.
|
Modifier and Type | Method and Description |
---|---|
ClassLoader |
BlobLibraryCacheManager.getClassLoader(JobID jobId) |
ClassLoader |
LibraryCacheManager.getClassLoader(JobID id)
Returns the user code class loader associated with id.
|
boolean |
BlobLibraryCacheManager.hasClassLoader(JobID jobId) |
boolean |
LibraryCacheManager.hasClassLoader(JobID jobId)
True if the LibraryCacheManager has a user code class loader registered
for the given job id.
|
void |
BlobLibraryCacheManager.registerJob(JobID id,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
LibraryCacheManager.registerJob(JobID id,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Registers a job with its required jar files and classpaths.
|
void |
BlobLibraryCacheManager.registerTask(JobID jobId,
ExecutionAttemptID task,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
LibraryCacheManager.registerTask(JobID id,
ExecutionAttemptID execution,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Registers a job task execution with its required jar files and classpaths.
|
void |
BlobLibraryCacheManager.unregisterJob(JobID id) |
void |
LibraryCacheManager.unregisterJob(JobID id)
Unregisters a job from the library cache manager.
|
void |
BlobLibraryCacheManager.unregisterTask(JobID jobId,
ExecutionAttemptID task) |
void |
LibraryCacheManager.unregisterTask(JobID id,
ExecutionAttemptID execution)
Unregisters a job task execution from the library cache manager.
|
Modifier and Type | Method and Description |
---|---|
JobID |
JobInformation.getJobId() |
JobID |
ExecutionVertex.getJobId() |
JobID |
ExecutionJobVertex.getJobId() |
JobID |
AccessExecutionGraph.getJobID()
Returns the
JobID for this execution graph. |
JobID |
ExecutionGraph.getJobID() |
JobID |
ArchivedExecutionGraph.getJobID() |
Modifier and Type | Method and Description |
---|---|
void |
JobStatusListener.jobStatusChanges(JobID jobId,
JobStatus newJobStatus,
long timestamp,
Throwable error)
This method is called whenever the status of the job changes.
|
Constructor and Description |
---|
ArchivedExecutionGraph(JobID jobID,
String jobName,
Map<JobVertexID,ArchivedExecutionJobVertex> tasks,
List<ArchivedExecutionJobVertex> verticesInCreationOrder,
long[] stateTimestamps,
JobStatus state,
ErrorInfo failureCause,
String jsonPlan,
StringifiedAccumulatorResult[] archivedUserAccumulators,
Map<String,SerializedValue<OptionalFailure<Object>>> serializedUserAccumulators,
ArchivedExecutionConfig executionConfig,
boolean isStoppable,
CheckpointCoordinatorConfiguration jobCheckpointingConfiguration,
CheckpointStatsSnapshot checkpointStatsSnapshot,
String stateBackendName) |
JobInformation(JobID jobId,
String jobName,
SerializedValue<ExecutionConfig> serializedExecutionConfig,
Configuration jobConfiguration,
Collection<PermanentBlobKey> requiredJarFileBlobKeys,
Collection<URL> requiredClasspathURLs) |
Modifier and Type | Method and Description |
---|---|
Future<Path> |
FileCache.createTmpFile(String name,
DistributedCache.DistributedCacheEntry entry,
JobID jobID,
ExecutionAttemptID executionId)
If the file doesn't exists locally, retrieve the file from the blob-service.
|
void |
FileCache.releaseJob(JobID jobId,
ExecutionAttemptID executionId) |
Modifier and Type | Field and Description |
---|---|
static JobID |
HighAvailabilityServices.DEFAULT_JOB_ID
This JobID should be used to identify the old JobManager when using the
HighAvailabilityServices . |
Modifier and Type | Method and Description |
---|---|
void |
RunningJobsRegistry.clearJob(JobID jobID)
Clear job state form the registry, usually called after job finish.
|
LeaderElectionService |
HighAvailabilityServices.getJobManagerLeaderElectionService(JobID jobID)
Gets the leader election service for the given job.
|
LeaderRetrievalService |
HighAvailabilityServices.getJobManagerLeaderRetriever(JobID jobID)
Deprecated.
This method should only be used by the legacy code where the JobManager acts as the master.
|
LeaderRetrievalService |
HighAvailabilityServices.getJobManagerLeaderRetriever(JobID jobID,
String defaultJobManagerAddress)
Gets the leader retriever for the job JobMaster which is responsible for the given job.
|
RunningJobsRegistry.JobSchedulingStatus |
RunningJobsRegistry.getJobSchedulingStatus(JobID jobID)
Gets the scheduling status of a job.
|
void |
RunningJobsRegistry.setJobFinished(JobID jobID)
Marks a job as completed.
|
void |
RunningJobsRegistry.setJobRunning(JobID jobID)
Marks a job as running.
|
Modifier and Type | Method and Description |
---|---|
LeaderElectionService |
EmbeddedHaServices.getJobManagerLeaderElectionService(JobID jobID) |
LeaderRetrievalService |
EmbeddedHaServices.getJobManagerLeaderRetriever(JobID jobID) |
LeaderRetrievalService |
EmbeddedHaServices.getJobManagerLeaderRetriever(JobID jobID,
String defaultJobManagerAddress) |
Modifier and Type | Method and Description |
---|---|
void |
StandaloneRunningJobsRegistry.clearJob(JobID jobID) |
LeaderElectionService |
StandaloneHaServices.getJobManagerLeaderElectionService(JobID jobID) |
LeaderRetrievalService |
StandaloneHaServices.getJobManagerLeaderRetriever(JobID jobID) |
LeaderRetrievalService |
StandaloneHaServices.getJobManagerLeaderRetriever(JobID jobID,
String defaultJobManagerAddress) |
RunningJobsRegistry.JobSchedulingStatus |
StandaloneRunningJobsRegistry.getJobSchedulingStatus(JobID jobID) |
void |
StandaloneRunningJobsRegistry.setJobFinished(JobID jobID) |
void |
StandaloneRunningJobsRegistry.setJobRunning(JobID jobID) |
Modifier and Type | Method and Description |
---|---|
void |
ZooKeeperRunningJobsRegistry.clearJob(JobID jobID) |
LeaderElectionService |
ZooKeeperHaServices.getJobManagerLeaderElectionService(JobID jobID) |
LeaderRetrievalService |
ZooKeeperHaServices.getJobManagerLeaderRetriever(JobID jobID) |
LeaderRetrievalService |
ZooKeeperHaServices.getJobManagerLeaderRetriever(JobID jobID,
String defaultJobManagerAddress) |
RunningJobsRegistry.JobSchedulingStatus |
ZooKeeperRunningJobsRegistry.getJobSchedulingStatus(JobID jobID) |
void |
ZooKeeperRunningJobsRegistry.setJobFinished(JobID jobID) |
void |
ZooKeeperRunningJobsRegistry.setJobRunning(JobID jobID) |
Modifier and Type | Method and Description |
---|---|
static Path |
FsJobArchivist.archiveJob(Path rootPath,
JobID jobId,
Collection<ArchivedJson> jsonToArchive)
Writes the given
AccessExecutionGraph to the FileSystem pointed to by
JobManagerOptions.ARCHIVE_DIR . |
Modifier and Type | Method and Description |
---|---|
void |
ResultPartitionConsumableNotifier.notifyPartitionConsumable(JobID jobId,
ResultPartitionID partitionId,
TaskActions taskActions) |
void |
TaskExecutorPartitionTrackerImpl.startTrackingPartition(JobID producingJobId,
TaskExecutorPartitionInfo partitionInfo) |
void |
TaskExecutorPartitionTracker.startTrackingPartition(JobID producingJobId,
TaskExecutorPartitionInfo partitionInfo)
Starts the tracking of the given partition for the given job.
|
void |
TaskExecutorPartitionTrackerImpl.stopTrackingAndReleaseJobPartitionsFor(JobID producingJobId) |
void |
TaskExecutorPartitionTracker.stopTrackingAndReleaseJobPartitionsFor(JobID producingJobId)
Releases all partitions for the given job and stop the tracking of partitions that were released.
|
Constructor and Description |
---|
JobMasterPartitionTrackerImpl(JobID jobId,
ShuffleMaster<?> shuffleMaster,
PartitionTrackerFactory.TaskExecutorGatewayLookup taskExecutorGatewayLookup) |
Modifier and Type | Method and Description |
---|---|
JobID |
JobGraph.getJobID()
Returns the ID of the job.
|
Modifier and Type | Method and Description |
---|---|
void |
JobGraph.setJobID(JobID jobID)
Sets the ID of the job.
|
Constructor and Description |
---|
JobGraph(JobID jobId,
String jobName)
Constructs a new job graph with the given job ID (or a random ID, if
null is passed),
the given name and the given execution configuration (see ExecutionConfig ). |
JobGraph(JobID jobId,
String jobName,
JobVertex... vertices)
Constructs a new job graph with the given name, the given
ExecutionConfig ,
the given jobId or a random one if null supplied, and the given job vertices. |
Modifier and Type | Method and Description |
---|---|
static JobID |
ZooKeeperJobGraphStore.jobIdfromPath(String path)
Returns the JobID from the given path in ZooKeeper.
|
Modifier and Type | Method and Description |
---|---|
Collection<JobID> |
ZooKeeperJobGraphStore.getJobIds() |
Collection<JobID> |
JobGraphStore.getJobIds()
Get all job ids of submitted job graphs to the submitted job graph store.
|
Collection<JobID> |
StandaloneJobGraphStore.getJobIds() |
Modifier and Type | Method and Description |
---|---|
static String |
ZooKeeperJobGraphStore.getPathForJob(JobID jobId)
Returns the JobID as a String (with leading slash).
|
void |
JobGraphStore.JobGraphListener.onAddedJobGraph(JobID jobId)
Callback for
JobGraph instances added by a different JobGraphStore instance. |
void |
JobGraphStore.JobGraphListener.onRemovedJobGraph(JobID jobId)
Callback for
JobGraph instances removed by a different JobGraphStore instance. |
JobGraph |
ZooKeeperJobGraphStore.recoverJobGraph(JobID jobId) |
JobGraph |
JobGraphStore.recoverJobGraph(JobID jobId)
|
JobGraph |
StandaloneJobGraphStore.recoverJobGraph(JobID jobId) |
void |
ThrowingJobGraphWriter.releaseJobGraph(JobID jobId) |
void |
ZooKeeperJobGraphStore.releaseJobGraph(JobID jobId) |
void |
StandaloneJobGraphStore.releaseJobGraph(JobID jobId) |
void |
JobGraphWriter.releaseJobGraph(JobID jobId)
Releases the locks on the specified
JobGraph . |
void |
ThrowingJobGraphWriter.removeJobGraph(JobID jobId) |
void |
ZooKeeperJobGraphStore.removeJobGraph(JobID jobId) |
void |
StandaloneJobGraphStore.removeJobGraph(JobID jobId) |
void |
JobGraphWriter.removeJobGraph(JobID jobId)
|
Modifier and Type | Method and Description |
---|---|
void |
TaskManagerGateway.notifyCheckpointComplete(ExecutionAttemptID executionAttemptID,
JobID jobId,
long checkpointId,
long timestamp)
Notify the given task about a completed checkpoint.
|
void |
TaskManagerGateway.releasePartitions(JobID jobId,
Set<ResultPartitionID> partitionIds)
Batch release intermediate result partitions.
|
void |
TaskManagerGateway.triggerCheckpoint(ExecutionAttemptID executionAttemptID,
JobID jobId,
long checkpointId,
long timestamp,
CheckpointOptions checkpointOptions,
boolean advanceToEndOfEventTime)
Trigger for the given task a checkpoint.
|
Modifier and Type | Method and Description |
---|---|
JobID |
AllocatedSlotReport.getJobId() |
JobID |
JobResult.getJobId() |
JobID |
JobManagerRunner.getJobID()
Get the job id of the executed job.
|
JobID |
JobManagerRunnerImpl.getJobID() |
Modifier and Type | Method and Description |
---|---|
void |
JobMaster.acknowledgeCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
CheckpointMetrics checkpointMetrics,
TaskStateSnapshot checkpointState) |
JobResult.Builder |
JobResult.Builder.jobId(JobID jobId) |
void |
RpcTaskManagerGateway.notifyCheckpointComplete(ExecutionAttemptID executionAttemptID,
JobID jobId,
long checkpointId,
long timestamp) |
CompletableFuture<Acknowledge> |
KvStateRegistryGateway.notifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId,
InetSocketAddress kvStateServerAddress)
Notifies that queryable state has been registered.
|
CompletableFuture<Acknowledge> |
JobMaster.notifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId,
InetSocketAddress kvStateServerAddress) |
CompletableFuture<Acknowledge> |
KvStateRegistryGateway.notifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName)
Notifies that queryable state has been unregistered.
|
CompletableFuture<Acknowledge> |
JobMaster.notifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName) |
void |
RpcTaskManagerGateway.releasePartitions(JobID jobId,
Set<ResultPartitionID> partitionIds) |
CompletableFuture<KvStateLocation> |
KvStateLocationOracle.requestKvStateLocation(JobID jobId,
String registrationName)
Requests a
KvStateLocation for the specified InternalKvState registration name. |
CompletableFuture<KvStateLocation> |
JobMaster.requestKvStateLocation(JobID jobId,
String registrationName) |
void |
RpcTaskManagerGateway.triggerCheckpoint(ExecutionAttemptID executionAttemptID,
JobID jobId,
long checkpointId,
long timestamp,
CheckpointOptions checkpointOptions,
boolean advanceToEndOfEventTime) |
Constructor and Description |
---|
AllocatedSlotReport(JobID jobId,
Collection<AllocatedSlotInfo> allocatedSlotInfos) |
JobNotFinishedException(JobID jobId) |
Modifier and Type | Method and Description |
---|---|
SlotPool |
SlotPoolFactory.createSlotPool(JobID jobId) |
SlotPool |
DefaultSlotPoolFactory.createSlotPool(JobID jobId) |
Constructor and Description |
---|
SlotPoolImpl(JobID jobId,
Clock clock,
Time rpcTimeout,
Time idleSlotTimeout,
Time batchSlotTimeout) |
Constructor and Description |
---|
FlinkJobNotFoundException(JobID jobId) |
Modifier and Type | Method and Description |
---|---|
JobID |
AbstractCheckpointMessage.getJob() |
Constructor and Description |
---|
AbstractCheckpointMessage(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId) |
AcknowledgeCheckpoint(JobID jobId,
ExecutionAttemptID taskExecutionId,
long checkpointId) |
AcknowledgeCheckpoint(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId,
CheckpointMetrics checkpointMetrics,
TaskStateSnapshot subtaskState) |
DeclineCheckpoint(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId) |
DeclineCheckpoint(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId,
Throwable reason) |
Modifier and Type | Method and Description |
---|---|
JobID |
JobIdsWithStatusOverview.JobIdWithStatus.getJobId() |
JobID |
JobDetails.getJobId() |
Constructor and Description |
---|
JobDetails(JobID jobId,
String jobName,
long startTime,
long endTime,
long duration,
JobStatus status,
long lastUpdateTime,
int[] tasksPerState,
int numTasks) |
JobIdWithStatus(JobID jobId,
JobStatus jobStatus) |
Modifier and Type | Field and Description |
---|---|
protected JobID |
JobMetricGroup.jobId
The ID of the job represented by this metrics group.
|
Modifier and Type | Method and Description |
---|---|
JobID |
JobMetricGroup.jobId() |
Modifier and Type | Method and Description |
---|---|
TaskMetricGroup |
UnregisteredMetricGroups.UnregisteredTaskManagerMetricGroup.addTaskForJob(JobID jobId,
String jobName,
JobVertexID jobVertexId,
ExecutionAttemptID executionAttemptId,
String taskName,
int subtaskIndex,
int attemptNumber) |
TaskMetricGroup |
TaskManagerMetricGroup.addTaskForJob(JobID jobId,
String jobName,
JobVertexID jobVertexId,
ExecutionAttemptID executionAttemptId,
String taskName,
int subtaskIndex,
int attemptNumber) |
void |
JobManagerMetricGroup.removeJob(JobID jobId) |
void |
TaskManagerMetricGroup.removeJobMetricsGroup(JobID jobId,
TaskManagerJobMetricGroup group) |
Constructor and Description |
---|
JobManagerJobMetricGroup(MetricRegistry registry,
JobManagerMetricGroup parent,
JobID jobId,
String jobName) |
JobMetricGroup(MetricRegistry registry,
C parent,
JobID jobId,
String jobName,
String[] scope) |
TaskManagerJobMetricGroup(MetricRegistry registry,
TaskManagerMetricGroup parent,
JobID jobId,
String jobName) |
Modifier and Type | Method and Description |
---|---|
String[] |
JobManagerJobScopeFormat.formatScope(JobManagerMetricGroup parent,
JobID jid,
String jobName) |
String[] |
TaskManagerJobScopeFormat.formatScope(TaskManagerMetricGroup parent,
JobID jid,
String jobName) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
MiniCluster.cancelJob(JobID jobId) |
CompletableFuture<? extends AccessExecutionGraph> |
MiniCluster.getExecutionGraph(JobID jobId) |
CompletableFuture<JobStatus> |
MiniCluster.getJobStatus(JobID jobId) |
CompletableFuture<JobResult> |
MiniCluster.requestJobResult(JobID jobId) |
CompletableFuture<String> |
MiniCluster.stopWithSavepoint(JobID jobId,
String targetDirectory,
boolean advanceToEndOfEventTime) |
CompletableFuture<String> |
MiniCluster.triggerSavepoint(JobID jobId,
String targetDirectory,
boolean cancelJob) |
Modifier and Type | Method and Description |
---|---|
JobID |
KvStateLocation.getJobId()
Returns the JobID the KvState instances belong to.
|
Modifier and Type | Method and Description |
---|---|
TaskKvStateRegistry |
KvStateRegistry.createTaskRegistry(JobID jobId,
JobVertexID jobVertexId)
Creates a
TaskKvStateRegistry facade for the Task
identified by the given JobID and JobVertexID instance. |
KvStateLocationOracle |
KvStateClientProxy.getKvStateLocationOracle(JobID jobId)
Retrieves a future containing the currently leading key-value state location oracle.
|
void |
KvStateRegistryListener.notifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId)
Notifies the listener about a registered KvState instance.
|
void |
KvStateRegistryListener.notifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName)
Notifies the listener about an unregistered KvState instance.
|
KvStateID |
KvStateRegistry.registerKvState(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
InternalKvState<?,?,?> kvState)
Registers the KvState instance and returns the assigned ID.
|
void |
KvStateRegistry.registerListener(JobID jobId,
KvStateRegistryListener listener)
Registers a listener with the registry.
|
void |
KvStateRegistry.unregisterKvState(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId)
Unregisters the KvState instance identified by the given KvStateID.
|
void |
KvStateRegistry.unregisterListener(JobID jobId)
Unregisters the listener with the registry.
|
void |
KvStateClientProxy.updateKvStateLocationOracle(JobID jobId,
KvStateLocationOracle kvStateLocationOracle)
Updates the active
Job Manager
in case of change. |
Constructor and Description |
---|
KvStateLocation(JobID jobId,
JobVertexID jobVertexId,
int numKeyGroups,
String registrationName)
Creates the location information.
|
KvStateLocationRegistry(JobID jobId,
Map<JobVertexID,ExecutionJobVertex> jobVertices)
Creates the registry for the job.
|
Modifier and Type | Method and Description |
---|---|
JobID |
SlotRequest.getJobId()
Get the JobID of the slot requested for.
|
Modifier and Type | Method and Description |
---|---|
void |
JobLeaderIdService.addJob(JobID jobId)
Add a job to be monitored to retrieve the job leader id.
|
protected void |
ResourceManager.closeJobManagerConnection(JobID jobId,
Exception cause)
This method should be called by the framework once it detects that a currently registered
job manager has failed.
|
boolean |
JobLeaderIdService.containsJob(JobID jobId)
Check whether the given job is being monitored or not.
|
void |
ResourceManagerGateway.disconnectJobManager(JobID jobId,
Exception cause)
Disconnects a JobManager specified by the given resourceID from the
ResourceManager . |
void |
ResourceManager.disconnectJobManager(JobID jobId,
Exception cause) |
CompletableFuture<JobMasterId> |
JobLeaderIdService.getLeaderId(JobID jobId) |
boolean |
JobLeaderIdService.isValidTimeout(JobID jobId,
UUID timeoutId) |
void |
JobLeaderIdActions.jobLeaderLostLeadership(JobID jobId,
JobMasterId oldJobMasterId)
Callback when a monitored job leader lost its leadership.
|
protected void |
ResourceManager.jobLeaderLostLeadership(JobID jobId,
JobMasterId oldJobMasterId) |
void |
JobLeaderIdActions.notifyJobTimeout(JobID jobId,
UUID timeoutId)
Notify a job timeout.
|
CompletableFuture<RegistrationResponse> |
ResourceManagerGateway.registerJobManager(JobMasterId jobMasterId,
ResourceID jobMasterResourceId,
String jobMasterAddress,
JobID jobId,
Time timeout)
Register a
JobMaster at the resource manager. |
CompletableFuture<RegistrationResponse> |
ResourceManager.registerJobManager(JobMasterId jobMasterId,
ResourceID jobManagerResourceId,
String jobManagerAddress,
JobID jobId,
Time timeout) |
void |
JobLeaderIdService.removeJob(JobID jobId)
Remove the given job from being monitored by the service.
|
protected void |
ResourceManager.removeJob(JobID jobId) |
Constructor and Description |
---|
SlotRequest(JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress) |
Modifier and Type | Method and Description |
---|---|
JobID |
JobManagerRegistration.getJobID() |
Constructor and Description |
---|
JobManagerRegistration(JobID jobID,
ResourceID jobManagerResourceID,
JobMasterGateway jobManagerGateway) |
Modifier and Type | Method and Description |
---|---|
JobID |
TaskManagerSlot.getJobId() |
JobID |
PendingSlotRequest.getJobId() |
Modifier and Type | Method and Description |
---|---|
void |
TaskManagerSlot.completeAllocation(AllocationID allocationId,
JobID jobId) |
void |
ResourceActions.notifyAllocationFailure(JobID jobId,
AllocationID allocationId,
Exception cause)
Notifies that an allocation failure has occurred.
|
void |
TaskManagerSlot.updateAllocation(AllocationID allocationId,
JobID jobId) |
Modifier and Type | Method and Description |
---|---|
static AsynchronousJobOperationKey |
AsynchronousJobOperationKey.of(TriggerId triggerId,
JobID jobId) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<AccessExecutionGraph> |
DefaultExecutionGraphCache.getExecutionGraph(JobID jobId,
RestfulGateway restfulGateway) |
CompletableFuture<AccessExecutionGraph> |
ExecutionGraphCache.getExecutionGraph(JobID jobId,
RestfulGateway restfulGateway)
Gets the
AccessExecutionGraph for the given JobID and caches it. |
Modifier and Type | Method and Description |
---|---|
protected JobID |
JobIDPathParameter.convertFromString(String value) |
JobID |
JobConfigInfo.getJobId() |
Modifier and Type | Method and Description |
---|---|
protected String |
JobIDPathParameter.convertToString(JobID value) |
Constructor and Description |
---|
JobConfigInfo(JobID jobId,
String jobName,
JobConfigInfo.ExecutionConfigInfo executionConfigInfo) |
Modifier and Type | Method and Description |
---|---|
JobID |
JobDetailsInfo.getJobId() |
Modifier and Type | Method and Description |
---|---|
static SubtaskExecutionAttemptDetailsInfo |
SubtaskExecutionAttemptDetailsInfo.create(AccessExecution execution,
MetricFetcher metricFetcher,
JobID jobID,
JobVertexID jobVertexID) |
Constructor and Description |
---|
JobDetailsInfo(JobID jobId,
String name,
boolean isStoppable,
JobStatus jobStatus,
long startTime,
long endTime,
long duration,
long now,
Map<JobStatus,Long> timestamps,
Collection<JobDetailsInfo.JobVertexDetailsInfo> jobVertexInfos,
Map<ExecutionState,Integer> jobVerticesPerState,
String jsonPlan) |
Modifier and Type | Method and Description |
---|---|
JobID |
JobsFilterQueryParameter.convertStringToValue(String value) |
Modifier and Type | Method and Description |
---|---|
String |
JobsFilterQueryParameter.convertValueToString(JobID value) |
Modifier and Type | Method and Description |
---|---|
JobID |
JobIDDeserializer.deserialize(org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParser p,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.DeserializationContext ctxt) |
Modifier and Type | Method and Description |
---|---|
void |
JobIDSerializer.serialize(JobID value,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonGenerator gen,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.SerializerProvider provider) |
Modifier and Type | Method and Description |
---|---|
void |
SchedulerBase.acknowledgeCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
CheckpointMetrics checkpointMetrics,
TaskStateSnapshot checkpointState) |
void |
SchedulerNG.acknowledgeCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
CheckpointMetrics checkpointMetrics,
TaskStateSnapshot checkpointState) |
void |
SchedulerBase.notifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId,
InetSocketAddress kvStateServerAddress) |
void |
SchedulerNG.notifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId,
InetSocketAddress kvStateServerAddress) |
void |
SchedulerBase.notifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName) |
void |
SchedulerNG.notifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName) |
KvStateLocation |
SchedulerBase.requestKvStateLocation(JobID jobId,
String registrationName) |
KvStateLocation |
SchedulerNG.requestKvStateLocation(JobID jobId,
String registrationName) |
Modifier and Type | Method and Description |
---|---|
CheckpointStorage |
StateBackend.createCheckpointStorage(JobID jobId)
Creates a storage for checkpoints for the given job.
|
<K> AbstractKeyedStateBackend<K> |
StateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry)
Creates a new
AbstractKeyedStateBackend that is responsible for holding keyed state
and checkpointing it. |
abstract <K> AbstractKeyedStateBackend<K> |
AbstractStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry) |
TaskLocalStateStore |
TaskExecutorLocalStateStoresManager.localStateStoreForSubtask(JobID jobId,
AllocationID allocationID,
JobVertexID jobVertexID,
int subtaskIndex) |
Constructor and Description |
---|
LocalRecoveryDirectoryProviderImpl(File[] allocationBaseDirs,
JobID jobID,
JobVertexID jobVertexID,
int subtaskIndex) |
LocalRecoveryDirectoryProviderImpl(File allocationBaseDir,
JobID jobID,
JobVertexID jobVertexID,
int subtaskIndex) |
TaskLocalStateStoreImpl(JobID jobID,
AllocationID allocationID,
JobVertexID jobVertexID,
int subtaskIndex,
LocalRecoveryConfig localRecoveryConfig,
Executor discardExecutor) |
TaskStateManagerImpl(JobID jobId,
ExecutionAttemptID executionAttemptID,
TaskLocalStateStore localStateStore,
JobManagerTaskRestore jobManagerTaskRestore,
CheckpointResponder checkpointResponder) |
Modifier and Type | Method and Description |
---|---|
CheckpointStorage |
FsStateBackend.createCheckpointStorage(JobID jobId) |
<K> AbstractKeyedStateBackend<K> |
FsStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry) |
protected static Path |
AbstractFsCheckpointStorage.getCheckpointDirectoryForJob(Path baseCheckpointPath,
JobID jobId)
Builds directory into which a specific job checkpoints, meaning the directory inside which
it creates the checkpoint-specific subdirectories.
|
Constructor and Description |
---|
AbstractFsCheckpointStorage(JobID jobId,
Path defaultSavepointDirectory)
Creates a new checkpoint storage.
|
FsCheckpointStorage(FileSystem fs,
Path checkpointBaseDirectory,
Path defaultSavepointDirectory,
JobID jobId,
int fileSizeThreshold,
int writeBufferSize) |
FsCheckpointStorage(Path checkpointBaseDirectory,
Path defaultSavepointDirectory,
JobID jobId,
int fileSizeThreshold,
int writeBufferSize) |
Modifier and Type | Method and Description |
---|---|
CheckpointStorage |
MemoryStateBackend.createCheckpointStorage(JobID jobId) |
<K> AbstractKeyedStateBackend<K> |
MemoryStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry) |
Constructor and Description |
---|
MemoryBackendCheckpointStorage(JobID jobId,
Path checkpointsBaseDirectory,
Path defaultSavepointLocation,
int maxStateSize)
Creates a new MemoryBackendCheckpointStorage.
|
Modifier and Type | Method and Description |
---|---|
JobID |
JobManagerConnection.getJobID() |
JobID |
SlotStatus.getJobID()
Get the job id of the slot allocated for.
|
Modifier and Type | Method and Description |
---|---|
void |
JobLeaderService.addJob(JobID jobId,
String defaultTargetAddress)
Add the given job to be monitored.
|
boolean |
JobManagerTable.contains(JobID jobId) |
boolean |
JobLeaderService.containsJob(JobID jobId)
Check whether the service monitors the given job.
|
TaskKvStateRegistry |
KvStateService.createKvStateTaskRegistry(JobID jobId,
JobVertexID jobVertexId) |
void |
TaskExecutorGateway.disconnectJobManager(JobID jobId,
Exception cause)
Disconnects the given JobManager from the TaskManager.
|
void |
TaskExecutor.disconnectJobManager(JobID jobId,
Exception cause) |
JobManagerConnection |
JobManagerTable.get(JobID jobId) |
void |
JobLeaderListener.jobManagerGainedLeadership(JobID jobId,
JobMasterGateway jobManagerGateway,
JMTMRegistrationSuccess registrationMessage)
Callback if a job manager has gained leadership for the job identified by the job id and a
connection could be established to this job manager.
|
void |
JobLeaderListener.jobManagerLostLeadership(JobID jobId,
JobMasterId jobMasterId)
Callback if the job leader for the job with the given job id lost its leadership.
|
boolean |
JobManagerTable.put(JobID jobId,
JobManagerConnection jobManagerConnection) |
void |
JobLeaderService.reconnect(JobID jobId)
Triggers reconnection to the last known leader of the given job.
|
void |
TaskExecutorGateway.releaseOrPromotePartitions(JobID jobId,
Set<ResultPartitionID> partitionToRelease,
Set<ResultPartitionID> partitionsToPromote)
Batch release/promote intermediate result partitions.
|
void |
TaskExecutor.releaseOrPromotePartitions(JobID jobId,
Set<ResultPartitionID> partitionToRelease,
Set<ResultPartitionID> partitionsToPromote) |
JobManagerConnection |
JobManagerTable.remove(JobID jobId) |
void |
JobLeaderService.removeJob(JobID jobId)
Remove the given job from being monitored by the job leader service.
|
CompletableFuture<ExecutionState> |
PartitionProducerStateChecker.requestPartitionProducerState(JobID jobId,
IntermediateDataSetID intermediateDataSetId,
ResultPartitionID resultPartitionId)
Requests the execution state of the execution producing a result partition.
|
CompletableFuture<Acknowledge> |
TaskExecutorGateway.requestSlot(SlotID slotId,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress,
ResourceManagerId resourceManagerId,
Time timeout)
Requests a slot from the TaskManager.
|
CompletableFuture<Acknowledge> |
TaskExecutor.requestSlot(SlotID slotId,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress,
ResourceManagerId resourceManagerId,
Time timeout) |
Constructor and Description |
---|
JobManagerConnection(JobID jobID,
ResourceID resourceID,
JobMasterGateway jobMasterGateway,
TaskManagerActions taskManagerActions,
CheckpointResponder checkpointResponder,
GlobalAggregateManager aggregateManager,
LibraryCacheManager libraryCacheManager,
ResultPartitionConsumableNotifier resultPartitionConsumableNotifier,
PartitionProducerStateChecker partitionStateChecker) |
SlotStatus(SlotID slotID,
ResourceProfile resourceProfile,
JobID jobID,
AllocationID allocationID) |
Modifier and Type | Method and Description |
---|---|
JobID |
SlotOccupiedException.getJobId() |
Constructor and Description |
---|
SlotOccupiedException(String message,
AllocationID allocationId,
JobID jobId) |
Modifier and Type | Method and Description |
---|---|
void |
RpcCheckpointResponder.acknowledgeCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
CheckpointMetrics checkpointMetrics,
TaskStateSnapshot subtaskState) |
void |
RpcCheckpointResponder.declineCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
Throwable cause) |
void |
RpcKvStateRegistryListener.notifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId) |
void |
RpcKvStateRegistryListener.notifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName) |
void |
RpcResultPartitionConsumableNotifier.notifyPartitionConsumable(JobID jobId,
ResultPartitionID partitionId,
TaskActions taskActions) |
CompletableFuture<ExecutionState> |
RpcPartitionStateChecker.requestPartitionProducerState(JobID jobId,
IntermediateDataSetID resultId,
ResultPartitionID partitionId) |
Modifier and Type | Method and Description |
---|---|
JobID |
TaskSlot.getJobId() |
JobID |
TaskSlotPayload.getJobID() |
JobID |
TaskSlotTableImpl.getOwningJob(AllocationID allocationId) |
JobID |
TaskSlotTable.getOwningJob(AllocationID allocationId)
Returns the owning job of the
TaskSlot identified by the
given AllocationID . |
Modifier and Type | Method and Description |
---|---|
boolean |
TaskSlotTableImpl.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
Time slotTimeout) |
boolean |
TaskSlotTable.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
Time slotTimeout)
Allocate the slot with the given index for the given job and allocation id.
|
boolean |
TaskSlotTableImpl.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
Time slotTimeout) |
boolean |
TaskSlotTable.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
Time slotTimeout)
Allocate the slot with the given index for the given job and allocation id.
|
Set<AllocationID> |
TaskSlotTableImpl.getActiveTaskAllocationIdsPerJob(JobID jobId) |
Set<AllocationID> |
TaskSlotTable.getActiveTaskAllocationIdsPerJob(JobID jobId)
|
Iterator<TaskSlot<T>> |
TaskSlotTableImpl.getAllocatedSlots(JobID jobId) |
Iterator<TaskSlot<T>> |
TaskSlotTable.getAllocatedSlots(JobID jobId)
Return an iterator of allocated slots for the given job id.
|
Set<AllocationID> |
TaskSlotTableImpl.getAllocationIdsPerJob(JobID jobId) |
Set<AllocationID> |
TaskSlotTable.getAllocationIdsPerJob(JobID jobId)
Returns the all
AllocationID for the given job. |
Iterator<T> |
TaskSlotTableImpl.getTasks(JobID jobId) |
Iterator<T> |
TaskSlotTable.getTasks(JobID jobId)
Return an iterator over all tasks for a given job.
|
boolean |
TaskSlotTableImpl.hasAllocatedSlots(JobID jobId) |
boolean |
TaskSlotTable.hasAllocatedSlots(JobID jobId)
Check whether the job has allocated (not active) slots.
|
boolean |
TaskSlot.isActive(JobID activeJobId,
AllocationID activeAllocationId) |
boolean |
TaskSlotTableImpl.isAllocated(int index,
JobID jobId,
AllocationID allocationId) |
boolean |
TaskSlotTable.isAllocated(int index,
JobID jobId,
AllocationID allocationId)
Check whether the slot for the given index is allocated for the given job and allocation id.
|
boolean |
TaskSlot.isAllocated(JobID jobIdToCheck,
AllocationID allocationIDToCheck) |
boolean |
TaskSlotTableImpl.tryMarkSlotActive(JobID jobId,
AllocationID allocationId) |
boolean |
TaskSlotTable.tryMarkSlotActive(JobID jobId,
AllocationID allocationId)
Try to mark the specified slot as active if it has been allocated by the given job.
|
Constructor and Description |
---|
SlotNotActiveException(JobID jobId,
AllocationID allocationId) |
TaskSlot(int index,
ResourceProfile resourceProfile,
int memoryPageSize,
JobID jobId,
AllocationID allocationId,
Executor asyncExecutor) |
Modifier and Type | Method and Description |
---|---|
JobID |
RuntimeEnvironment.getJobID() |
JobID |
TaskExecutionState.getJobID()
The ID of the job the task belongs to
|
JobID |
Task.getJobID() |
Modifier and Type | Method and Description |
---|---|
void |
CheckpointResponder.acknowledgeCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
CheckpointMetrics checkpointMetrics,
TaskStateSnapshot subtaskState)
Acknowledges the given checkpoint.
|
void |
CheckpointResponder.declineCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
Throwable cause)
Declines the given checkpoint.
|
static ResultPartitionWriter[] |
ConsumableNotifyingResultPartitionWriterDecorator.decorate(Collection<ResultPartitionDeploymentDescriptor> descs,
ResultPartitionWriter[] partitionWriters,
TaskActions taskActions,
JobID jobId,
ResultPartitionConsumableNotifier notifier) |
Constructor and Description |
---|
ConsumableNotifyingResultPartitionWriterDecorator(TaskActions taskActions,
JobID jobId,
ResultPartitionWriter partitionWriter,
ResultPartitionConsumableNotifier partitionConsumableNotifier) |
RuntimeEnvironment(JobID jobId,
JobVertexID jobVertexId,
ExecutionAttemptID executionId,
ExecutionConfig executionConfig,
TaskInfo taskInfo,
Configuration jobConfiguration,
Configuration taskConfiguration,
ClassLoader userCodeClassLoader,
MemoryManager memManager,
IOManager ioManager,
BroadcastVariableManager bcVarManager,
TaskStateManager taskStateManager,
GlobalAggregateManager aggregateManager,
AccumulatorRegistry accumulatorRegistry,
TaskKvStateRegistry kvStateRegistry,
InputSplitProvider splitProvider,
Map<String,Future<Path>> distCacheEntries,
ResultPartitionWriter[] writers,
InputGate[] inputGates,
TaskEventDispatcher taskEventDispatcher,
CheckpointResponder checkpointResponder,
TaskManagerRuntimeInfo taskManagerInfo,
TaskMetricGroup metrics,
Task containingTask) |
TaskExecutionState(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState executionState)
Creates a new task execution state update, with no attached exception and no accumulators.
|
TaskExecutionState(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState executionState,
Throwable error)
Creates a new task execution state update, with an attached exception but no accumulators.
|
TaskExecutionState(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState executionState,
Throwable error,
AccumulatorSnapshot accumulators,
IOMetrics ioMetrics)
Creates a new task execution state update, with an attached exception.
|
Modifier and Type | Method and Description |
---|---|
static ZooKeeperCheckpointIDCounter |
ZooKeeperUtils.createCheckpointIDCounter(org.apache.curator.framework.CuratorFramework client,
Configuration configuration,
JobID jobId)
Creates a
ZooKeeperCheckpointIDCounter instance. |
static CompletedCheckpointStore |
ZooKeeperUtils.createCompletedCheckpoints(org.apache.curator.framework.CuratorFramework client,
Configuration configuration,
JobID jobId,
int maxNumberOfCheckpointsToRetain,
Executor executor)
Creates a
ZooKeeperCompletedCheckpointStore instance. |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
RestfulGateway.cancelJob(JobID jobId,
Time timeout)
Cancel the given job.
|
CompletableFuture<ArchivedExecutionGraph> |
RestfulGateway.requestJob(JobID jobId,
Time timeout)
Requests the
ArchivedExecutionGraph for the given jobId. |
CompletableFuture<JobResult> |
RestfulGateway.requestJobResult(JobID jobId,
Time timeout)
Requests the
JobResult of a job specified by the given jobId. |
default CompletableFuture<JobStatus> |
RestfulGateway.requestJobStatus(JobID jobId,
Time timeout)
Request the
JobStatus of the given job. |
default CompletableFuture<OperatorBackPressureStatsResponse> |
RestfulGateway.requestOperatorBackPressureStats(JobID jobId,
JobVertexID jobVertexId)
Requests the statistics on operator back pressure.
|
default CompletableFuture<String> |
RestfulGateway.stopWithSavepoint(JobID jobId,
String targetDirectory,
boolean advanceToEndOfEventTime,
Time timeout)
Stops the job with a savepoint.
|
default CompletableFuture<String> |
RestfulGateway.triggerSavepoint(JobID jobId,
String targetDirectory,
boolean cancelJob,
Time timeout)
Triggers a savepoint with the given savepoint directory as a target.
|
Modifier and Type | Method and Description |
---|---|
JobID |
JarRequestBody.getJobId() |
JobID |
JarRunResponseBody.getJobId() |
Constructor and Description |
---|
JarRunRequestBody(String entryClassName,
String programArguments,
List<String> programArgumentsList,
Integer parallelism,
JobID jobId,
Boolean allowNonRestoredState,
String savepointPath) |
JarRunResponseBody(JobID jobId) |
Modifier and Type | Method and Description |
---|---|
JobID |
SavepointEnvironment.getJobID() |
Modifier and Type | Method and Description |
---|---|
static JobGraph |
StreamingJobGraphGenerator.createJobGraph(StreamGraph streamGraph,
JobID jobID) |
JobGraph |
StreamGraph.getJobGraph(JobID jobID)
|
Modifier and Type | Method and Description |
---|---|
static String |
StreamIterationHead.createBrokerIdString(JobID jid,
String iterationID,
int subtaskIndex)
Creates the identification string with which head and tail task find the shared blocking
queue for the back channel.
|
Modifier and Type | Method and Description |
---|---|
static ProgramTargetDescriptor |
ProgramTargetDescriptor.of(JobID jobId)
Creates a program target description from deployment classes.
|
Modifier and Type | Method and Description |
---|---|
JobID |
FlinkDistribution.submitJob(JobSubmission jobSubmission) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.