Modifier and Type | Method and Description |
---|---|
Collection<AllocationID> |
SlotProfile.getPreferredAllocations()
Returns the desired allocation ids for the slot.
|
Set<AllocationID> |
SlotProfile.getPreviousExecutionGraphAllocations()
Returns a set of all previous allocation ids from the execution graph.
|
Modifier and Type | Method and Description |
---|---|
static SlotProfile |
SlotProfile.priorAllocation(ResourceProfile taskResourceProfile,
ResourceProfile physicalSlotResourceProfile,
Collection<TaskManagerLocation> preferredLocations,
Collection<AllocationID> priorAllocations,
Set<AllocationID> previousExecutionGraphAllocations)
Returns a slot profile for the given resource profile, prior allocations and all prior
allocation ids from the whole execution graph.
|
static SlotProfile |
SlotProfile.priorAllocation(ResourceProfile taskResourceProfile,
ResourceProfile physicalSlotResourceProfile,
Collection<TaskManagerLocation> preferredLocations,
Collection<AllocationID> priorAllocations,
Set<AllocationID> previousExecutionGraphAllocations)
Returns a slot profile for the given resource profile, prior allocations and all prior
allocation ids from the whole execution graph.
|
Modifier and Type | Method and Description |
---|---|
AllocationID |
TaskDeploymentDescriptor.getAllocationId() |
Modifier and Type | Method and Description |
---|---|
TaskDeploymentDescriptor |
TaskDeploymentDescriptorFactory.createDeploymentDescriptor(AllocationID allocationID,
int targetSlotNumber,
JobManagerTaskRestore taskRestore,
Collection<ResultPartitionDeploymentDescriptor> producedPartitions) |
Constructor and Description |
---|
TaskDeploymentDescriptor(JobID jobId,
TaskDeploymentDescriptor.MaybeOffloaded<JobInformation> serializedJobInformation,
TaskDeploymentDescriptor.MaybeOffloaded<TaskInformation> serializedTaskInformation,
ExecutionAttemptID executionAttemptId,
AllocationID allocationId,
int subtaskIndex,
int attemptNumber,
int targetSlotNumber,
JobManagerTaskRestore taskRestore,
List<ResultPartitionDeploymentDescriptor> resultPartitionDeploymentDescriptors,
List<InputGateDeploymentDescriptor> inputGateDeploymentDescriptors) |
Modifier and Type | Method and Description |
---|---|
AllocationID |
Execution.getAssignedAllocationID() |
AllocationID |
ArchivedExecution.getAssignedAllocationID() |
AllocationID |
ExecutionVertex.getLatestPriorAllocation() |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Void> |
Execution.scheduleForExecution(SlotProviderStrategy slotProviderStrategy,
LocationPreferenceConstraint locationPreferenceConstraint,
Set<AllocationID> allPreviousExecutionGraphAllocationIds)
NOTE: This method only throws exceptions if it is in an illegal state to be scheduled, or if
the tasks needs to be scheduled immediately and no resource is available.
|
CompletableFuture<Void> |
ExecutionVertex.scheduleForExecution(SlotProviderStrategy slotProviderStrategy,
LocationPreferenceConstraint locationPreferenceConstraint,
Set<AllocationID> allPreviousExecutionGraphAllocationIds)
Schedules the current execution of this ExecutionVertex.
|
Constructor and Description |
---|
ArchivedExecution(StringifiedAccumulatorResult[] userAccumulators,
IOMetrics ioMetrics,
ExecutionAttemptID attemptId,
int attemptNumber,
ExecutionState state,
String failureCause,
TaskManagerLocation assignedResourceLocation,
AllocationID assignedAllocationID,
int parallelSubtaskIndex,
long[] stateTimestamps) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
TaskManagerGateway.freeSlot(AllocationID allocationId,
Throwable cause,
Time timeout)
Frees the slot with the given allocation ID.
|
Modifier and Type | Method and Description |
---|---|
AllocationID |
SlotInfo.getAllocationId()
Gets the id under which the slot has been allocated on the TaskManager.
|
AllocationID |
LogicalSlot.getAllocationId()
Gets the allocation id of this slot.
|
AllocationID |
AllocatedSlotInfo.getAllocationId() |
Modifier and Type | Method and Description |
---|---|
void |
JobMasterGateway.failSlot(ResourceID taskManagerId,
AllocationID allocationId,
Exception cause)
Fails the slot with the given allocation id and cause.
|
void |
JobMaster.failSlot(ResourceID taskManagerId,
AllocationID allocationId,
Exception cause) |
CompletableFuture<Acknowledge> |
RpcTaskManagerGateway.freeSlot(AllocationID allocationId,
Throwable cause,
Time timeout) |
void |
JobMasterGateway.notifyAllocationFailure(AllocationID allocationID,
Exception cause)
Notifies that the allocation has failed.
|
void |
JobMaster.notifyAllocationFailure(AllocationID allocationID,
Exception cause) |
Constructor and Description |
---|
AllocatedSlotInfo(int index,
AllocationID allocationId) |
Modifier and Type | Method and Description |
---|---|
AllocationID |
SingleLogicalSlot.getAllocationId() |
AllocationID |
SlotInfoWithUtilization.getAllocationId() |
Modifier and Type | Method and Description |
---|---|
Optional<PhysicalSlot> |
SlotPool.allocateAvailableSlot(SlotRequestId slotRequestId,
AllocationID allocationID)
Allocates the available slot with the given allocation id under the given request id.
|
Optional<PhysicalSlot> |
SlotPoolImpl.allocateAvailableSlot(SlotRequestId slotRequestId,
AllocationID allocationID) |
Optional<ResourceID> |
SlotPool.failAllocation(AllocationID allocationID,
Exception cause)
Fails the slot with the given allocation id.
|
Optional<ResourceID> |
SlotPoolImpl.failAllocation(AllocationID allocationID,
Exception cause)
Fail the specified allocation and release the corresponding slot if we have one.
|
Modifier and Type | Method and Description |
---|---|
AllocationID |
SlotRequest.getAllocationId()
Get the unique identification of this request
|
Modifier and Type | Method and Description |
---|---|
void |
ResourceManagerGateway.cancelSlotRequest(AllocationID allocationID)
Cancel the slot allocation requests from the resource manager.
|
void |
ResourceManager.cancelSlotRequest(AllocationID allocationID) |
void |
ResourceManagerGateway.notifySlotAvailable(InstanceID instanceId,
SlotID slotID,
AllocationID oldAllocationId)
Sent by the TaskExecutor to notify the ResourceManager that a slot has become available.
|
void |
ResourceManager.notifySlotAvailable(InstanceID instanceID,
SlotID slotId,
AllocationID allocationId) |
Constructor and Description |
---|
SlotRequest(JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress) |
Constructor and Description |
---|
UnfulfillableSlotRequestException(AllocationID allocationId,
ResourceProfile resourceProfile) |
Modifier and Type | Method and Description |
---|---|
AllocationID |
TaskManagerSlot.getAllocationId() |
AllocationID |
PendingSlotRequest.getAllocationId() |
Modifier and Type | Method and Description |
---|---|
void |
TaskManagerSlot.completeAllocation(AllocationID allocationId,
JobID jobId) |
void |
SlotManager.freeSlot(SlotID slotId,
AllocationID allocationId)
Free the given slot from the given allocation.
|
void |
SlotManagerImpl.freeSlot(SlotID slotId,
AllocationID allocationId)
Free the given slot from the given allocation.
|
void |
ResourceActions.notifyAllocationFailure(JobID jobId,
AllocationID allocationId,
Exception cause)
Notifies that an allocation failure has occurred.
|
boolean |
SlotManager.unregisterSlotRequest(AllocationID allocationId)
Cancels and removes a pending slot request with the given allocation id.
|
boolean |
SlotManagerImpl.unregisterSlotRequest(AllocationID allocationId)
Cancels and removes a pending slot request with the given allocation id.
|
void |
TaskManagerSlot.updateAllocation(AllocationID allocationId,
JobID jobId) |
Modifier and Type | Method and Description |
---|---|
AllocationID |
ExecutionVertexSchedulingRequirements.getPreviousAllocationId() |
Modifier and Type | Method and Description |
---|---|
ExecutionVertexSchedulingRequirements.Builder |
ExecutionVertexSchedulingRequirements.Builder.withPreviousAllocationId(AllocationID previousAllocationId) |
Modifier and Type | Method and Description |
---|---|
TaskLocalStateStore |
TaskExecutorLocalStateStoresManager.localStateStoreForSubtask(JobID jobId,
AllocationID allocationID,
JobVertexID jobVertexID,
int subtaskIndex) |
void |
TaskExecutorLocalStateStoresManager.releaseLocalStateForAllocationId(AllocationID allocationID) |
Constructor and Description |
---|
TaskLocalStateStoreImpl(JobID jobID,
AllocationID allocationID,
JobVertexID jobVertexID,
int subtaskIndex,
LocalRecoveryConfig localRecoveryConfig,
Executor discardExecutor) |
Modifier and Type | Method and Description |
---|---|
AllocationID |
SlotStatus.getAllocationID()
Get the allocation id of this slot.
|
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
TaskExecutor.freeSlot(AllocationID allocationId,
Throwable cause,
Time timeout) |
CompletableFuture<Acknowledge> |
TaskExecutorGateway.freeSlot(AllocationID allocationId,
Throwable cause,
Time timeout)
Frees the slot with the given allocation ID.
|
CompletableFuture<Acknowledge> |
TaskExecutor.requestSlot(SlotID slotId,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress,
ResourceManagerId resourceManagerId,
Time timeout) |
CompletableFuture<Acknowledge> |
TaskExecutorGateway.requestSlot(SlotID slotId,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress,
ResourceManagerId resourceManagerId,
Time timeout)
Requests a slot from the TaskManager.
|
Constructor and Description |
---|
SlotStatus(SlotID slotID,
ResourceProfile resourceProfile,
JobID jobID,
AllocationID allocationID) |
Modifier and Type | Method and Description |
---|---|
AllocationID |
SlotOccupiedException.getAllocationId() |
Constructor and Description |
---|
SlotOccupiedException(String message,
AllocationID allocationId,
JobID jobId) |
Modifier and Type | Method and Description |
---|---|
AllocationID |
TaskSlotPayload.getAllocationId() |
AllocationID |
TaskSlot.getAllocationId() |
AllocationID |
SlotOffer.getAllocationId() |
AllocationID |
TaskSlotTableImpl.getCurrentAllocation(int index) |
AllocationID |
TaskSlotTable.getCurrentAllocation(int index)
Get the current allocation for the task slot with the given index.
|
Modifier and Type | Method and Description |
---|---|
Set<AllocationID> |
TaskSlotTableImpl.getActiveTaskAllocationIdsPerJob(JobID jobId) |
Set<AllocationID> |
TaskSlotTable.getActiveTaskAllocationIdsPerJob(JobID jobId)
|
Set<AllocationID> |
TaskSlotTableImpl.getAllocationIdsPerJob(JobID jobId) |
Set<AllocationID> |
TaskSlotTable.getAllocationIdsPerJob(JobID jobId)
Returns the all
AllocationID for the given job. |
Modifier and Type | Method and Description |
---|---|
boolean |
TaskSlotTableImpl.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
Time slotTimeout) |
boolean |
TaskSlotTable.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
Time slotTimeout)
Allocate the slot with the given index for the given job and allocation id.
|
boolean |
TaskSlotTableImpl.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
Time slotTimeout) |
boolean |
TaskSlotTable.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
Time slotTimeout)
Allocate the slot with the given index for the given job and allocation id.
|
void |
SlotActions.freeSlot(AllocationID allocationId)
Free the task slot with the given allocation id.
|
default int |
TaskSlotTable.freeSlot(AllocationID allocationId)
Try to free the slot.
|
int |
TaskSlotTableImpl.freeSlot(AllocationID allocationId,
Throwable cause) |
int |
TaskSlotTable.freeSlot(AllocationID allocationId,
Throwable cause)
Tries to free the slot.
|
JobID |
TaskSlotTableImpl.getOwningJob(AllocationID allocationId) |
JobID |
TaskSlotTable.getOwningJob(AllocationID allocationId)
Returns the owning job of the
TaskSlot identified by the given AllocationID . |
MemoryManager |
TaskSlotTableImpl.getTaskMemoryManager(AllocationID allocationID) |
MemoryManager |
TaskSlotTable.getTaskMemoryManager(AllocationID allocationID)
Get the memory manager of the slot allocated for the task.
|
boolean |
TaskSlot.isActive(JobID activeJobId,
AllocationID activeAllocationId) |
boolean |
TaskSlotTableImpl.isAllocated(int index,
JobID jobId,
AllocationID allocationId) |
boolean |
TaskSlotTable.isAllocated(int index,
JobID jobId,
AllocationID allocationId)
Check whether the slot for the given index is allocated for the given job and allocation id.
|
boolean |
TaskSlot.isAllocated(JobID jobIdToCheck,
AllocationID allocationIDToCheck) |
boolean |
TaskSlotTableImpl.isValidTimeout(AllocationID allocationId,
UUID ticket) |
boolean |
TaskSlotTable.isValidTimeout(AllocationID allocationId,
UUID ticket)
Check whether the timeout with ticket is valid for the given allocation id.
|
boolean |
TaskSlotTableImpl.markSlotActive(AllocationID allocationId) |
boolean |
TaskSlotTable.markSlotActive(AllocationID allocationId)
Marks the slot under the given allocation id as active.
|
boolean |
TaskSlotTableImpl.markSlotInactive(AllocationID allocationId,
Time slotTimeout) |
boolean |
TaskSlotTable.markSlotInactive(AllocationID allocationId,
Time slotTimeout)
Marks the slot under the given allocation id as inactive.
|
void |
TaskSlotTableImpl.notifyTimeout(AllocationID key,
UUID ticket) |
void |
SlotActions.timeoutSlot(AllocationID allocationId,
UUID ticket)
Timeout the task slot for the given allocation id.
|
boolean |
TaskSlotTableImpl.tryMarkSlotActive(JobID jobId,
AllocationID allocationId) |
boolean |
TaskSlotTable.tryMarkSlotActive(JobID jobId,
AllocationID allocationId)
Try to mark the specified slot as active if it has been allocated by the given job.
|
Constructor and Description |
---|
SlotNotActiveException(JobID jobId,
AllocationID allocationId) |
SlotNotFoundException(AllocationID allocationId) |
SlotOffer(AllocationID allocationID,
int index,
ResourceProfile resourceProfile) |
TaskSlot(int index,
ResourceProfile resourceProfile,
int memoryPageSize,
JobID jobId,
AllocationID allocationId,
Executor asyncExecutor) |
Constructor and Description |
---|
TaskSlotTableImpl(int numberSlots,
ResourceProfile totalAvailableResourceProfile,
ResourceProfile defaultSlotResourceProfile,
int memoryPageSize,
TimerService<AllocationID> timerService,
Executor memoryVerificationExecutor) |
Modifier and Type | Method and Description |
---|---|
AllocationID |
Task.getAllocationId() |
Constructor and Description |
---|
Task(JobInformation jobInformation,
TaskInformation taskInformation,
ExecutionAttemptID executionAttemptID,
AllocationID slotAllocationId,
int subtaskIndex,
int attemptNumber,
List<ResultPartitionDeploymentDescriptor> resultPartitionDeploymentDescriptors,
List<InputGateDeploymentDescriptor> inputGateDeploymentDescriptors,
int targetSlotNumber,
MemoryManager memManager,
IOManager ioManager,
ShuffleEnvironment<?,?> shuffleEnvironment,
KvStateService kvStateService,
BroadcastVariableManager bcVarManager,
TaskEventDispatcher taskEventDispatcher,
ExternalResourceInfoProvider externalResourceInfoProvider,
TaskStateManager taskStateManager,
TaskManagerActions taskManagerActions,
InputSplitProvider inputSplitProvider,
CheckpointResponder checkpointResponder,
TaskOperatorEventGateway operatorCoordinatorEventGateway,
GlobalAggregateManager aggregateManager,
LibraryCacheManager.ClassLoaderHandle classLoaderHandle,
FileCache fileCache,
TaskManagerRuntimeInfo taskManagerConfig,
TaskMetricGroup metricGroup,
ResultPartitionConsumableNotifier resultPartitionConsumableNotifier,
PartitionProducerStateChecker partitionProducerStateChecker,
Executor executor)
IMPORTANT: This constructor may not start any work that would need to be undone in the
case of a failing task deployment.
|
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.