Package | Description |
---|---|
org.apache.flink.runtime.accumulators | |
org.apache.flink.runtime.checkpoint | |
org.apache.flink.runtime.deployment | |
org.apache.flink.runtime.execution | |
org.apache.flink.runtime.execution.librarycache | |
org.apache.flink.runtime.executiongraph | |
org.apache.flink.runtime.io.network.partition | |
org.apache.flink.runtime.io.network.partition.consumer | |
org.apache.flink.runtime.jobmanager.slots | |
org.apache.flink.runtime.messages |
This package contains the messages that are sent between actors, like the
JobManager and
TaskManager to coordinate the distributed operations. |
org.apache.flink.runtime.messages.checkpoint |
This package contains the messages that are sent between
JobManager
and TaskManager to coordinate the checkpoint snapshots of the
distributed dataflow. |
org.apache.flink.runtime.metrics.groups | |
org.apache.flink.runtime.taskmanager | |
org.apache.flink.runtime.webmonitor |
Modifier and Type | Field and Description |
---|---|
protected ExecutionAttemptID |
AccumulatorRegistry.taskID |
Modifier and Type | Method and Description |
---|---|
ExecutionAttemptID |
AccumulatorSnapshot.getExecutionAttemptID() |
Constructor and Description |
---|
AccumulatorRegistry(JobID jobID,
ExecutionAttemptID taskID) |
AccumulatorSnapshot(JobID jobID,
ExecutionAttemptID executionAttemptID,
Map<String,Accumulator<?,?>> userAccumulators) |
Modifier and Type | Method and Description |
---|---|
PendingCheckpoint.TaskAcknowledgeResult |
PendingCheckpoint.acknowledgeTask(ExecutionAttemptID executionAttemptId,
SubtaskState subtaskState,
CheckpointMetaData checkpointMetaData)
Acknowledges the task with the given execution attempt id and the given subtask state.
|
Constructor and Description |
---|
PendingCheckpoint(JobID jobId,
long checkpointId,
long checkpointTimestamp,
Map<ExecutionAttemptID,ExecutionVertex> verticesToConfirm,
CheckpointProperties props,
String targetDirectory,
Executor executor) |
Modifier and Type | Method and Description |
---|---|
ExecutionAttemptID |
TaskDeploymentDescriptor.getExecutionAttemptId() |
Constructor and Description |
---|
TaskDeploymentDescriptor(SerializedValue<JobInformation> serializedJobInformation,
SerializedValue<TaskInformation> serializedTaskInformation,
ExecutionAttemptID executionAttemptId,
int subtaskIndex,
int attemptNumber,
int targetSlotNumber,
TaskStateHandles taskStateHandles,
Collection<ResultPartitionDeploymentDescriptor> resultPartitionDeploymentDescriptors,
Collection<InputGateDeploymentDescriptor> inputGateDeploymentDescriptors) |
Modifier and Type | Method and Description |
---|---|
ExecutionAttemptID |
Environment.getExecutionId()
Gets the ID of the task execution attempt.
|
Modifier and Type | Method and Description |
---|---|
void |
LibraryCacheManager.registerTask(JobID id,
ExecutionAttemptID execution,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Registers a job task execution with its required jar files and classpaths.
|
void |
FallbackLibraryCacheManager.registerTask(JobID id,
ExecutionAttemptID execution,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
BlobLibraryCacheManager.registerTask(JobID jobId,
ExecutionAttemptID task,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
LibraryCacheManager.unregisterTask(JobID id,
ExecutionAttemptID execution)
Unregisters a job from the library cache manager.
|
void |
FallbackLibraryCacheManager.unregisterTask(JobID id,
ExecutionAttemptID execution) |
void |
BlobLibraryCacheManager.unregisterTask(JobID jobId,
ExecutionAttemptID task) |
Modifier and Type | Method and Description |
---|---|
static ExecutionAttemptID |
ExecutionAttemptID.fromByteBuf(io.netty.buffer.ByteBuf buf) |
ExecutionAttemptID |
Execution.getAttemptId() |
ExecutionAttemptID |
ArchivedExecution.getAttemptId() |
ExecutionAttemptID |
AccessExecution.getAttemptId()
Returns the
ExecutionAttemptID for this Execution. |
Modifier and Type | Method and Description |
---|---|
Map<ExecutionAttemptID,Execution> |
ExecutionGraph.getRegisteredExecutions() |
Modifier and Type | Method and Description |
---|---|
void |
StatusListenerMessenger.executionStatusChanged(JobID jobID,
JobVertexID vertexID,
String taskName,
int taskParallelism,
int subtaskIndex,
ExecutionAttemptID executionID,
ExecutionState newExecutionState,
long timestamp,
String optionalMessage) |
void |
ExecutionStatusListener.executionStatusChanged(JobID jobID,
JobVertexID vertexID,
String taskName,
int totalNumberOfSubTasks,
int subtaskIndex,
ExecutionAttemptID executionID,
ExecutionState newExecutionState,
long timestamp,
String optionalMessage)
Called whenever the execution status of a task changes.
|
Modifier and Type | Field and Description |
---|---|
com.google.common.collect.Table<ExecutionAttemptID,IntermediateResultPartitionID,ResultPartition> |
ResultPartitionManager.registeredPartitions |
Modifier and Type | Method and Description |
---|---|
ExecutionAttemptID |
ResultPartitionID.getProducerId() |
Modifier and Type | Method and Description |
---|---|
void |
ResultPartitionManager.releasePartitionsProducedBy(ExecutionAttemptID executionId) |
void |
ResultPartitionManager.releasePartitionsProducedBy(ExecutionAttemptID executionId,
Throwable cause) |
Constructor and Description |
---|
ResultPartitionID(IntermediateResultPartitionID partitionId,
ExecutionAttemptID producerId) |
Modifier and Type | Method and Description |
---|---|
static SingleInputGate |
SingleInputGate.create(String owningTaskName,
JobID jobId,
ExecutionAttemptID executionId,
InputGateDeploymentDescriptor igdd,
NetworkEnvironment networkEnvironment,
TaskActions taskActions,
TaskIOMetricGroup metrics)
Creates an input gate and all of its input channels.
|
Modifier and Type | Method and Description |
---|---|
Future<Acknowledge> |
TaskManagerGateway.cancelTask(ExecutionAttemptID executionAttemptID,
Time timeout)
Cancel the given task.
|
Future<Acknowledge> |
ActorTaskManagerGateway.cancelTask(ExecutionAttemptID executionAttemptID,
Time timeout) |
void |
TaskManagerGateway.failPartition(ExecutionAttemptID executionAttemptID)
Fail all intermediate result partitions of the given task.
|
void |
ActorTaskManagerGateway.failPartition(ExecutionAttemptID executionAttemptID) |
void |
TaskManagerGateway.notifyCheckpointComplete(ExecutionAttemptID executionAttemptID,
JobID jobId,
long checkpointId,
long timestamp)
Notify the given task about a completed checkpoint.
|
void |
ActorTaskManagerGateway.notifyCheckpointComplete(ExecutionAttemptID executionAttemptID,
JobID jobId,
long checkpointId,
long timestamp) |
Future<StackTraceSampleResponse> |
TaskManagerGateway.requestStackTraceSample(ExecutionAttemptID executionAttemptID,
int sampleId,
int numSamples,
Time delayBetweenSamples,
int maxStackTraceDepth,
Time timeout)
Request a stack trace sample from the given task.
|
Future<StackTraceSampleResponse> |
ActorTaskManagerGateway.requestStackTraceSample(ExecutionAttemptID executionAttemptID,
int sampleId,
int numSamples,
Time delayBetweenSamples,
int maxStackTraceDepth,
Time timeout) |
Future<Acknowledge> |
TaskManagerGateway.stopTask(ExecutionAttemptID executionAttemptID,
Time timeout)
Stop the given task.
|
Future<Acknowledge> |
ActorTaskManagerGateway.stopTask(ExecutionAttemptID executionAttemptID,
Time timeout) |
void |
TaskManagerGateway.triggerCheckpoint(ExecutionAttemptID executionAttemptID,
JobID jobId,
long checkpointId,
long timestamp)
Trigger for the given task a checkpoint.
|
void |
ActorTaskManagerGateway.triggerCheckpoint(ExecutionAttemptID executionAttemptID,
JobID jobId,
long checkpointId,
long timestamp) |
Future<Acknowledge> |
TaskManagerGateway.updatePartitions(ExecutionAttemptID executionAttemptID,
Iterable<PartitionInfo> partitionInfos,
Time timeout)
Update the task where the given partitions can be found.
|
Future<Acknowledge> |
ActorTaskManagerGateway.updatePartitions(ExecutionAttemptID executionAttemptID,
Iterable<PartitionInfo> partitionInfos,
Time timeout) |
Modifier and Type | Method and Description |
---|---|
ExecutionAttemptID |
TaskMessages.CancelTask.attemptID() |
ExecutionAttemptID |
TaskMessages.StopTask.attemptID() |
ExecutionAttemptID |
JobManagerMessages.RequestNextInputSplit.executionAttempt() |
ExecutionAttemptID |
StackTraceSampleMessages.TriggerStackTraceSample.executionId() |
ExecutionAttemptID |
StackTraceSampleMessages.SampleTaskStackTrace.executionId() |
ExecutionAttemptID |
TaskMessages.FailTask.executionID() |
ExecutionAttemptID |
TaskMessages.TaskInFinalState.executionID() |
ExecutionAttemptID |
TaskMessages.UpdateTaskSinglePartitionInfo.executionID() |
ExecutionAttemptID |
TaskMessages.UpdateTaskMultiplePartitionInfos.executionID() |
ExecutionAttemptID |
TaskMessages.FailIntermediateResultPartitions.executionID() |
abstract ExecutionAttemptID |
TaskMessages.UpdatePartitionInfo.executionID() |
ExecutionAttemptID |
ExecutionGraphMessages.ExecutionStateChanged.executionID() |
ExecutionAttemptID |
StackTraceSampleResponse.getExecutionAttemptID() |
Modifier and Type | Method and Description |
---|---|
static TaskMessages.UpdateTaskMultiplePartitionInfos |
TaskMessages.createUpdateTaskMultiplePartitionInfos(ExecutionAttemptID executionID,
List<IntermediateDataSetID> resultIDs,
List<InputChannelDeploymentDescriptor> partitionInfos) |
TaskMessages.UpdateTaskMultiplePartitionInfos |
TaskMessages$.createUpdateTaskMultiplePartitionInfos(ExecutionAttemptID executionID,
List<IntermediateDataSetID> resultIDs,
List<InputChannelDeploymentDescriptor> partitionInfos) |
Modifier and Type | Method and Description |
---|---|
ExecutionAttemptID |
AbstractCheckpointMessage.getTaskExecutionId() |
Constructor and Description |
---|
AbstractCheckpointMessage(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId) |
AcknowledgeCheckpoint(JobID job,
ExecutionAttemptID taskExecutionId,
CheckpointMetaData checkpointMetaData) |
AcknowledgeCheckpoint(JobID job,
ExecutionAttemptID taskExecutionId,
CheckpointMetaData checkpointMetaData,
SubtaskState subtaskState) |
DeclineCheckpoint(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId) |
DeclineCheckpoint(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId,
Throwable reason) |
NotifyCheckpointComplete(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId,
long timestamp) |
TriggerCheckpoint(JobID job,
ExecutionAttemptID taskExecutionId,
long checkpointId,
long timestamp) |
Modifier and Type | Method and Description |
---|---|
TaskMetricGroup |
TaskManagerJobMetricGroup.addTask(JobVertexID jobVertexId,
ExecutionAttemptID executionAttemptID,
String taskName,
int subtaskIndex,
int attemptNumber) |
TaskMetricGroup |
TaskManagerMetricGroup.addTaskForJob(JobID jobId,
String jobName,
JobVertexID jobVertexId,
ExecutionAttemptID executionAttemptId,
String taskName,
int subtaskIndex,
int attemptNumber) |
Modifier and Type | Method and Description |
---|---|
ExecutionAttemptID |
Task.getExecutionId() |
ExecutionAttemptID |
RuntimeEnvironment.getExecutionId() |
ExecutionAttemptID |
TaskExecutionState.getID()
Returns the ID of the task this result belongs to
|
Modifier and Type | Method and Description |
---|---|
protected HashMap<ExecutionAttemptID,Task> |
TaskManager.runningTasks()
Registry of all tasks currently executed by this TaskManager
|
Modifier and Type | Method and Description |
---|---|
void |
CheckpointResponder.acknowledgeCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
CheckpointMetaData checkpointMetaData,
SubtaskState subtaskState)
Acknowledges the given checkpoint.
|
void |
ActorGatewayCheckpointResponder.acknowledgeCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
CheckpointMetaData checkpointMetaData,
SubtaskState checkpointStateHandles) |
void |
CheckpointResponder.declineCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
Throwable cause)
Declines the given checkpoint.
|
void |
ActorGatewayCheckpointResponder.declineCheckpoint(JobID jobID,
ExecutionAttemptID executionAttemptID,
long checkpointId,
Throwable reason) |
void |
TaskManagerConnection.failTask(ExecutionAttemptID executionAttemptID,
Throwable cause)
Tells the task manager to fail the given task.
|
void |
ActorGatewayTaskManagerConnection.failTask(ExecutionAttemptID executionAttemptID,
Throwable cause) |
void |
TaskManagerConnection.notifyFinalState(ExecutionAttemptID executionAttemptID)
Notifies the task manager that the given task is in a final state.
|
void |
ActorGatewayTaskManagerConnection.notifyFinalState(ExecutionAttemptID executionAttemptID) |
Constructor and Description |
---|
RuntimeEnvironment(JobID jobId,
JobVertexID jobVertexId,
ExecutionAttemptID executionId,
ExecutionConfig executionConfig,
TaskInfo taskInfo,
Configuration jobConfiguration,
Configuration taskConfiguration,
ClassLoader userCodeClassLoader,
MemoryManager memManager,
IOManager ioManager,
BroadcastVariableManager bcVarManager,
AccumulatorRegistry accumulatorRegistry,
TaskKvStateRegistry kvStateRegistry,
InputSplitProvider splitProvider,
Map<String,Future<Path>> distCacheEntries,
ResultPartitionWriter[] writers,
InputGate[] inputGates,
CheckpointResponder checkpointResponder,
TaskManagerRuntimeInfo taskManagerInfo,
TaskMetricGroup metrics,
Task containingTask) |
Task(JobInformation jobInformation,
TaskInformation taskInformation,
ExecutionAttemptID executionAttemptID,
int subtaskIndex,
int attemptNumber,
Collection<ResultPartitionDeploymentDescriptor> resultPartitionDeploymentDescriptors,
Collection<InputGateDeploymentDescriptor> inputGateDeploymentDescriptors,
int targetSlotNumber,
TaskStateHandles taskStateHandles,
MemoryManager memManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
BroadcastVariableManager bcVarManager,
TaskManagerConnection taskManagerConnection,
InputSplitProvider inputSplitProvider,
CheckpointResponder checkpointResponder,
LibraryCacheManager libraryCache,
FileCache fileCache,
TaskManagerRuntimeInfo taskManagerConfig,
TaskMetricGroup metricGroup,
ResultPartitionConsumableNotifier resultPartitionConsumableNotifier,
PartitionProducerStateChecker partitionProducerStateChecker,
Executor executor)
IMPORTANT: This constructor may not start any work that would need to
be undone in the case of a failing task deployment.
|
TaskExecutionState(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState executionState)
Creates a new task execution state update, with no attached exception and no accumulators.
|
TaskExecutionState(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState executionState,
Throwable error)
Creates a new task execution state update, with an attached exception but no accumulators.
|
TaskExecutionState(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState executionState,
Throwable error,
AccumulatorSnapshot accumulators,
IOMetrics ioMetrics)
Creates a new task execution state update, with an attached exception.
|
TaskInputSplitProvider(ActorGateway jobManager,
JobID jobID,
JobVertexID vertexID,
ExecutionAttemptID executionID,
scala.concurrent.duration.FiniteDuration timeout) |
Modifier and Type | Method and Description |
---|---|
Map<ExecutionAttemptID,List<StackTraceElement[]>> |
StackTraceSample.getStackTraces()
Returns the a map of stack traces by execution ID.
|
Modifier and Type | Method and Description |
---|---|
void |
StackTraceSampleCoordinator.collectStackTraces(int sampleId,
ExecutionAttemptID executionId,
List<StackTraceElement[]> stackTraces)
Collects stack traces of a task.
|
Constructor and Description |
---|
StackTraceSample(int sampleId,
long startTime,
long endTime,
Map<ExecutionAttemptID,List<StackTraceElement[]>> stackTracesByTask)
Creates a stack trace sample
|
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.