Modifier and Type | Method and Description |
---|---|
Collection<ExecutionJobVertex> |
CheckpointPlan.getFullyFinishedJobVertex()
Returns the job vertices whose tasks are all finished when taking the checkpoint.
|
Collection<ExecutionJobVertex> |
DefaultCheckpointPlan.getFullyFinishedJobVertex() |
Modifier and Type | Method and Description |
---|---|
static CompletedCheckpoint |
Checkpoints.loadAndValidateCheckpoint(JobID jobId,
Map<JobVertexID,ExecutionJobVertex> tasks,
CompletedCheckpointStorageLocation location,
ClassLoader classLoader,
boolean allowNonRestoredState,
CheckpointProperties checkpointProperties) |
boolean |
CheckpointCoordinator.restoreInitialCheckpointIfPresent(Set<ExecutionJobVertex> tasks)
Restores the latest checkpointed at the beginning of the job execution.
|
boolean |
CheckpointCoordinator.restoreLatestCheckpointedStateToAll(Set<ExecutionJobVertex> tasks,
boolean allowNonRestoredState)
Restores the latest checkpointed state to all tasks and all coordinators.
|
OptionalLong |
CheckpointCoordinator.restoreLatestCheckpointedStateToSubtasks(Set<ExecutionJobVertex> tasks)
Restores the latest checkpointed state to a set of subtasks.
|
boolean |
CheckpointCoordinator.restoreSavepoint(SavepointRestoreSettings restoreSettings,
Map<JobVertexID,ExecutionJobVertex> tasks,
ClassLoader userClassLoader)
Restore the state with given savepoint.
|
Modifier and Type | Class and Description |
---|---|
class |
SpeculativeExecutionJobVertex
The ExecutionJobVertex which supports speculative execution.
|
Modifier and Type | Method and Description |
---|---|
ExecutionJobVertex |
ExecutionVertex.getJobVertex() |
ExecutionJobVertex |
DefaultExecutionGraph.getJobVertex(JobVertexID id) |
ExecutionJobVertex |
InternalExecutionGraphAccessor.getJobVertex(JobVertexID id) |
ExecutionJobVertex |
ExecutionGraph.getJobVertex(JobVertexID id) |
ExecutionJobVertex |
IntermediateResult.getProducer() |
Modifier and Type | Method and Description |
---|---|
Map<JobVertexID,ExecutionJobVertex> |
DefaultExecutionGraph.getAllVertices() |
Map<JobVertexID,ExecutionJobVertex> |
ExecutionGraph.getAllVertices() |
Iterable<ExecutionJobVertex> |
DefaultExecutionGraph.getVerticesTopologically() |
Iterable<ExecutionJobVertex> |
ExecutionGraph.getVerticesTopologically() |
Modifier and Type | Method and Description |
---|---|
protected ExecutionVertex |
ExecutionJobVertex.createExecutionVertex(ExecutionJobVertex jobVertex,
int subTaskIndex,
IntermediateResult[] producedDataSets,
Time timeout,
long createTimestamp,
int executionHistorySizeLimit,
int initialAttemptCount) |
protected ExecutionVertex |
SpeculativeExecutionJobVertex.createExecutionVertex(ExecutionJobVertex jobVertex,
int subTaskIndex,
IntermediateResult[] producedDataSets,
Time timeout,
long createTimestamp,
int executionHistorySizeLimit,
int initialAttemptCount) |
void |
DefaultExecutionGraph.initializeJobVertex(ExecutionJobVertex ejv,
long createTimestamp) |
void |
ExecutionGraph.initializeJobVertex(ExecutionJobVertex ejv,
long createTimestamp)
Initialize the given execution job vertex, mainly includes creating execution vertices
according to the parallelism, and connecting to the predecessors.
|
Modifier and Type | Method and Description |
---|---|
void |
DefaultExecutionGraph.notifyNewlyInitializedJobVertices(List<ExecutionJobVertex> vertices) |
void |
ExecutionGraph.notifyNewlyInitializedJobVertices(List<ExecutionJobVertex> vertices)
Notify that some job vertices have been newly initialized, execution graph will try to update
scheduling topology.
|
Constructor and Description |
---|
ArchivedExecutionJobVertex(ExecutionJobVertex jobVertex) |
ExecutionVertex(ExecutionJobVertex jobVertex,
int subTaskIndex,
IntermediateResult[] producedDataSets,
Time timeout,
long createTimestamp,
int executionHistorySizeLimit,
int initialAttemptCount)
Creates an ExecutionVertex.
|
IntermediateResult(IntermediateDataSet intermediateDataSet,
ExecutionJobVertex producer,
int numParallelProducers,
ResultPartitionType resultType) |
SpeculativeExecutionVertex(ExecutionJobVertex jobVertex,
int subTaskIndex,
IntermediateResult[] producedDataSets,
Time timeout,
long createTimestamp,
int executionHistorySizeLimit,
int initialAttemptCount) |
Modifier and Type | Method and Description |
---|---|
static OperatorCoordinatorHolder |
OperatorCoordinatorHolder.create(SerializedValue<OperatorCoordinator.Provider> serializedProvider,
ExecutionJobVertex jobVertex,
ClassLoader classLoader,
CoordinatorStore coordinatorStore,
boolean supportsConcurrentExecutionAttempts) |
Constructor and Description |
---|
KvStateLocationRegistry(JobID jobId,
Map<JobVertexID,ExecutionJobVertex> jobVertices)
Creates the registry for the job.
|
Modifier and Type | Method and Description |
---|---|
ExecutionJobVertex |
SchedulerBase.getExecutionJobVertex(JobVertexID jobVertexId) |
Modifier and Type | Method and Description |
---|---|
static void |
SsgNetworkMemoryCalculationUtils.enrichNetworkMemory(SlotSharingGroup ssg,
java.util.function.Function<JobVertexID,ExecutionJobVertex> ejvs,
ShuffleMaster<?> shuffleMaster)
Calculates network memory requirement of
ExecutionJobVertex and update ResourceProfile of corresponding slot sharing group. |
Modifier and Type | Method and Description |
---|---|
void |
DefaultExecutionTopology.notifyExecutionGraphUpdated(DefaultExecutionGraph executionGraph,
List<ExecutionJobVertex> newlyInitializedJobVertices) |
Modifier and Type | Method and Description |
---|---|
static Map<JobVertexID,ForwardGroup> |
ForwardGroupComputeUtil.computeForwardGroups(Iterable<JobVertex> topologicallySortedVertices,
java.util.function.Function<JobVertexID,ExecutionJobVertex> executionJobVertexRetriever) |
Constructor and Description |
---|
ForwardGroup(Set<ExecutionJobVertex> jobVertices) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.