public interface JobMasterGateway extends CheckpointCoordinatorGateway
JobMaster
rpc gateway interfaceModifier and Type | Method and Description |
---|---|
void |
disconnectResourceManager(UUID jobManagerLeaderId,
UUID resourceManagerLeaderId,
Exception cause)
Disconnects the resource manager from the job manager because of the given cause.
|
void |
disconnectTaskManager(ResourceID resourceID,
Exception cause)
Disconnects the given
TaskExecutor from the
JobMaster . |
void |
failSlot(ResourceID taskManagerId,
AllocationID allocationId,
UUID leaderId,
Exception cause)
Fail the slot with the given allocation id and cause.
|
void |
heartbeatFromResourceManager(ResourceID resourceID)
Heartbeat request from the resource manager
|
void |
heartbeatFromTaskManager(ResourceID resourceID)
Send the heartbeat to job manager from task manager
|
Future<KvStateLocation> |
lookupKvStateLocation(String registrationName)
Requests a
KvStateLocation for the specified InternalKvState registration name. |
void |
notifyKvStateRegistered(JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId,
KvStateServerAddress kvStateServerAddress) |
void |
notifyKvStateUnregistered(JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName) |
Future<Iterable<SlotOffer>> |
offerSlots(ResourceID taskManagerId,
Iterable<SlotOffer> slots,
UUID leaderId,
Time timeout)
Offer the given slots to the job manager.
|
Future<RegistrationResponse> |
registerTaskManager(String taskManagerRpcAddress,
TaskManagerLocation taskManagerLocation,
UUID leaderId,
Time timeout)
Register the task manager at the job manager.
|
Future<ClassloadingProps> |
requestClassloadingProps()
Request the classloading props of this job.
|
Future<SerializedInputSplit> |
requestNextInputSplit(UUID leaderSessionID,
JobVertexID vertexID,
ExecutionAttemptID executionAttempt)
Requesting next input split for the
ExecutionJobVertex . |
Future<ExecutionState> |
requestPartitionState(UUID leaderSessionID,
IntermediateDataSetID intermediateResultId,
ResultPartitionID partitionId)
Requests the current state of the partition.
|
Future<Acknowledge> |
scheduleOrUpdateConsumers(UUID leaderSessionID,
ResultPartitionID partitionID,
Time timeout)
Notifies the JobManager about available data for a produced partition.
|
void |
startJobExecution() |
void |
suspendExecution(Throwable cause) |
Future<Acknowledge> |
updateTaskExecutionState(UUID leaderSessionID,
TaskExecutionState taskExecutionState)
Updates the task execution state for a given task.
|
acknowledgeCheckpoint, declineCheckpoint
getAddress, getHostname
void startJobExecution()
void suspendExecution(Throwable cause)
Future<Acknowledge> updateTaskExecutionState(UUID leaderSessionID, TaskExecutionState taskExecutionState)
leaderSessionID
- The leader id of JobManagertaskExecutionState
- New task execution state for a given taskFuture<SerializedInputSplit> requestNextInputSplit(UUID leaderSessionID, JobVertexID vertexID, ExecutionAttemptID executionAttempt)
ExecutionJobVertex
. The next input split is sent back to the sender
as a SerializedInputSplit
message.leaderSessionID
- The leader id of JobManagervertexID
- The job vertex idexecutionAttempt
- The execution attempt idFuture<ExecutionState> requestPartitionState(UUID leaderSessionID, IntermediateDataSetID intermediateResultId, ResultPartitionID partitionId)
leaderSessionID
- The leader id of JobManagerintermediateResultId
- The execution attempt ID of the task requesting the partition state.partitionId
- The partition ID of the partition to request the state of.Future<Acknowledge> scheduleOrUpdateConsumers(UUID leaderSessionID, ResultPartitionID partitionID, Time timeout)
There is a call to this method for each ExecutionVertex
instance once per produced
ResultPartition
instance, either when first producing data (for pipelined executions)
or when all data has been produced (for staged executions).
The JobManager then can decide when to schedule the partition consumers of the given session.
leaderSessionID
- The leader id of JobManagerpartitionID
- The partition which has already produced datatimeout
- before the rpc call failsvoid disconnectTaskManager(ResourceID resourceID, Exception cause)
TaskExecutor
from the
JobMaster
.resourceID
- identifying the TaskManager to disconnectcause
- for the disconnection of the TaskManagervoid disconnectResourceManager(UUID jobManagerLeaderId, UUID resourceManagerLeaderId, Exception cause)
jobManagerLeaderId
- identifying the job manager leader idresourceManagerLeaderId
- identifying the resource manager leader idcause
- of the disconnectFuture<KvStateLocation> lookupKvStateLocation(String registrationName)
KvStateLocation
for the specified InternalKvState
registration name.registrationName
- Name under which the KvState has been registered.InternalKvState
locationvoid notifyKvStateRegistered(JobVertexID jobVertexId, KeyGroupRange keyGroupRange, String registrationName, KvStateID kvStateId, KvStateServerAddress kvStateServerAddress)
jobVertexId
- JobVertexID the KvState instance belongs to.keyGroupRange
- Key group range the KvState instance belongs to.registrationName
- Name under which the KvState has been registered.kvStateId
- ID of the registered KvState instance.kvStateServerAddress
- Server address where to find the KvState instance.void notifyKvStateUnregistered(JobVertexID jobVertexId, KeyGroupRange keyGroupRange, String registrationName)
jobVertexId
- JobVertexID the KvState instance belongs to.keyGroupRange
- Key group index the KvState instance belongs to.registrationName
- Name under which the KvState has been registered.Future<ClassloadingProps> requestClassloadingProps()
Future<Iterable<SlotOffer>> offerSlots(ResourceID taskManagerId, Iterable<SlotOffer> slots, UUID leaderId, Time timeout)
taskManagerId
- identifying the task managerslots
- to offer to the job managerleaderId
- identifying the job leadertimeout
- for the rpc callvoid failSlot(ResourceID taskManagerId, AllocationID allocationId, UUID leaderId, Exception cause)
taskManagerId
- identifying the task managerallocationId
- identifying the slot to failleaderId
- identifying the job leadercause
- of the failingFuture<RegistrationResponse> registerTaskManager(String taskManagerRpcAddress, TaskManagerLocation taskManagerLocation, UUID leaderId, Time timeout)
taskManagerRpcAddress
- the rpc address of the task managertaskManagerLocation
- location of the task managerleaderId
- identifying the job leadertimeout
- for the rpc callvoid heartbeatFromTaskManager(ResourceID resourceID)
resourceID
- unique id of the task managervoid heartbeatFromResourceManager(ResourceID resourceID)
resourceID
- unique id of the resource managerCopyright © 2014–2018 The Apache Software Foundation. All rights reserved.