Modifier and Type | Method and Description |
---|---|
ResourceID |
KubernetesWorkerNode.getResourceID() |
Modifier and Type | Method and Description |
---|---|
protected KubernetesWorkerNode |
KubernetesResourceManager.workerStarted(ResourceID resourceID) |
Constructor and Description |
---|
KubernetesResourceManager(RpcService rpcService,
ResourceID resourceId,
Configuration flinkConfig,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
ResourceManagerMetricGroup resourceManagerMetricGroup,
FlinkKubeClient kubeClient,
KubernetesResourceManagerConfiguration configuration) |
Modifier and Type | Method and Description |
---|---|
ResourceManager<KubernetesWorkerNode> |
KubernetesResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
ResourceManagerMetricGroup resourceManagerMetricGroup,
ResourceManagerRuntimeServices resourceManagerRuntimeServices) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
RegisteredMesosWorkerNode.getResourceID() |
Modifier and Type | Method and Description |
---|---|
ResourceManager<RegisteredMesosWorkerNode> |
MesosResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
ResourceManagerMetricGroup resourceManagerMetricGroup,
ResourceManagerRuntimeServices resourceManagerRuntimeServices) |
protected RegisteredMesosWorkerNode |
MesosResourceManager.workerStarted(ResourceID resourceID)
Callback when a worker was started.
|
Constructor and Description |
---|
MesosResourceManager(RpcService rpcService,
ResourceID resourceId,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
Configuration flinkConfig,
MesosServices mesosServices,
MesosConfiguration mesosConfig,
MesosTaskManagerParameters taskManagerParameters,
ContainerSpecification taskManagerContainerSpec,
String webUiUrl,
ResourceManagerMetricGroup resourceManagerMetricGroup) |
Modifier and Type | Method and Description |
---|---|
static ResourceID |
ResourceID.generate()
Generate a random resource id.
|
ResourceID |
SlotID.getResourceID() |
ResourceID |
ResourceIDRetrievable.getResourceID()
Gets the ResourceID of the object.
|
ResourceID |
ResourceID.getResourceID()
A ResourceID can always retrieve a ResourceID.
|
Modifier and Type | Method and Description |
---|---|
static SlotID |
SlotID.generateDynamicSlotID(ResourceID resourceID)
Generate a SlotID without actual slot index for dynamic slot allocation.
|
Constructor and Description |
---|
SlotID(ResourceID resourceId,
int slotNumber) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Collection<Tuple2<ResourceID,String>>> |
Dispatcher.requestTaskManagerMetricQueryServiceAddresses(Time timeout) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
HeartbeatMonitorImpl.getHeartbeatTargetId() |
ResourceID |
HeartbeatMonitor.getHeartbeatTargetId()
Gets heartbeat target id.
|
Modifier and Type | Method and Description |
---|---|
<I,O> HeartbeatManager<I,O> |
HeartbeatServices.createHeartbeatManager(ResourceID resourceId,
HeartbeatListener<I,O> heartbeatListener,
ScheduledExecutor mainThreadExecutor,
org.slf4j.Logger log)
Creates a heartbeat manager which does not actively send heartbeats.
|
<I,O> HeartbeatManager<I,O> |
HeartbeatServices.createHeartbeatManagerSender(ResourceID resourceId,
HeartbeatListener<I,O> heartbeatListener,
ScheduledExecutor mainThreadExecutor,
org.slf4j.Logger log)
Creates a heartbeat manager which actively sends heartbeats to monitoring targets.
|
HeartbeatMonitor<O> |
HeartbeatMonitor.Factory.createHeartbeatMonitor(ResourceID resourceID,
HeartbeatTarget<O> heartbeatTarget,
ScheduledExecutor mainThreadExecutor,
HeartbeatListener<?,O> heartbeatListener,
long heartbeatTimeoutIntervalMs)
Create heartbeat monitor heartbeat monitor.
|
long |
NoOpHeartbeatManager.getLastHeartbeatFrom(ResourceID resourceId) |
long |
HeartbeatManagerImpl.getLastHeartbeatFrom(ResourceID resourceId) |
long |
HeartbeatManager.getLastHeartbeatFrom(ResourceID resourceId)
Returns the last received heartbeat from the given target.
|
void |
NoOpHeartbeatManager.monitorTarget(ResourceID resourceID,
HeartbeatTarget<O> heartbeatTarget) |
void |
HeartbeatManagerImpl.monitorTarget(ResourceID resourceID,
HeartbeatTarget<O> heartbeatTarget) |
void |
HeartbeatManager.monitorTarget(ResourceID resourceID,
HeartbeatTarget<O> heartbeatTarget)
Start monitoring a
HeartbeatTarget . |
void |
HeartbeatListener.notifyHeartbeatTimeout(ResourceID resourceID)
Callback which is called if a heartbeat for the machine identified by the given resource ID
times out.
|
void |
HeartbeatTarget.receiveHeartbeat(ResourceID heartbeatOrigin,
I heartbeatPayload)
Sends a heartbeat response to the target.
|
void |
NoOpHeartbeatManager.receiveHeartbeat(ResourceID heartbeatOrigin,
I heartbeatPayload) |
void |
HeartbeatManagerImpl.receiveHeartbeat(ResourceID heartbeatOrigin,
I heartbeatPayload) |
void |
HeartbeatListener.reportPayload(ResourceID resourceID,
I payload)
Callback which is called whenever a heartbeat with an associated payload is received.
|
void |
HeartbeatTarget.requestHeartbeat(ResourceID requestOrigin,
I heartbeatPayload)
Requests a heartbeat from the target.
|
void |
NoOpHeartbeatManager.requestHeartbeat(ResourceID requestOrigin,
I heartbeatPayload) |
void |
HeartbeatManagerImpl.requestHeartbeat(ResourceID requestOrigin,
I heartbeatPayload) |
O |
HeartbeatListener.retrievePayload(ResourceID resourceID)
Retrieves the payload value for the next heartbeat message.
|
void |
NoOpHeartbeatManager.unmonitorTarget(ResourceID resourceID) |
void |
HeartbeatManagerImpl.unmonitorTarget(ResourceID resourceID) |
void |
HeartbeatManager.unmonitorTarget(ResourceID resourceID)
Stops monitoring the heartbeat target with the associated resource ID.
|
Constructor and Description |
---|
HeartbeatManagerImpl(long heartbeatTimeoutIntervalMs,
ResourceID ownResourceID,
HeartbeatListener<I,O> heartbeatListener,
ScheduledExecutor mainThreadExecutor,
org.slf4j.Logger log) |
HeartbeatManagerImpl(long heartbeatTimeoutIntervalMs,
ResourceID ownResourceID,
HeartbeatListener<I,O> heartbeatListener,
ScheduledExecutor mainThreadExecutor,
org.slf4j.Logger log,
HeartbeatMonitor.Factory<O> heartbeatMonitorFactory) |
Modifier and Type | Method and Description |
---|---|
Optional<TaskExecutorGateway> |
PartitionTrackerFactory.TaskExecutorGatewayLookup.lookup(ResourceID taskExecutorId)
Returns a
TaskExecutorGateway corresponding to the given ResourceID. |
void |
ResourceManagerPartitionTracker.processTaskExecutorClusterPartitionReport(ResourceID taskExecutorId,
ClusterPartitionReport clusterPartitionReport)
Processes
ClusterPartitionReport of a task executor. |
void |
ResourceManagerPartitionTrackerImpl.processTaskExecutorClusterPartitionReport(ResourceID taskExecutorId,
ClusterPartitionReport clusterPartitionReport) |
void |
ResourceManagerPartitionTracker.processTaskExecutorShutdown(ResourceID taskExecutorId)
Processes the shutdown of task executor.
|
void |
ResourceManagerPartitionTrackerImpl.processTaskExecutorShutdown(ResourceID taskExecutorId) |
void |
TaskExecutorClusterPartitionReleaser.releaseClusterPartitions(ResourceID taskExecutorId,
Set<IntermediateDataSetID> dataSetsToRelease) |
void |
JobMasterPartitionTracker.startTrackingPartition(ResourceID producingTaskExecutorId,
ResultPartitionDeploymentDescriptor resultPartitionDeploymentDescriptor)
Starts the tracking of the given partition for the given task executor ID.
|
void |
JobMasterPartitionTrackerImpl.startTrackingPartition(ResourceID producingTaskExecutorId,
ResultPartitionDeploymentDescriptor resultPartitionDeploymentDescriptor) |
void |
JobMasterPartitionTracker.stopTrackingAndReleaseOrPromotePartitionsFor(ResourceID producingTaskExecutorId)
Releases all job partitions and promotes all cluster partitions for the given task executor
ID, and stops the tracking of partitions that were released/promoted.
|
void |
JobMasterPartitionTrackerImpl.stopTrackingAndReleaseOrPromotePartitionsFor(ResourceID producingTaskExecutorId) |
void |
JobMasterPartitionTracker.stopTrackingAndReleasePartitionsFor(ResourceID producingTaskExecutorId)
Releases all partitions for the given task executor ID, and stop the tracking of partitions
that were released.
|
void |
JobMasterPartitionTrackerImpl.stopTrackingAndReleasePartitionsFor(ResourceID producingTaskExecutorId) |
Modifier and Type | Field and Description |
---|---|
protected ResourceID |
SingleInputGateFactory.taskExecutorResourceId |
Modifier and Type | Method and Description |
---|---|
void |
SingleInputGate.updateInputChannel(ResourceID localLocation,
NettyShuffleDescriptor shuffleDescriptor) |
Constructor and Description |
---|
SingleInputGateFactory(ResourceID taskExecutorResourceId,
NettyShuffleEnvironmentConfiguration networkConfig,
ConnectionManager connectionManager,
ResultPartitionManager partitionManager,
TaskEventPublisher taskEventPublisher,
NetworkBufferPool networkBufferPool) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
JMTMRegistrationSuccess.getResourceID() |
ResourceID |
JobMasterRegistrationSuccess.getResourceManagerResourceId() |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
JobMasterGateway.disconnectTaskManager(ResourceID resourceID,
Exception cause)
Disconnects the given
TaskExecutor from the
JobMaster . |
CompletableFuture<Acknowledge> |
JobMaster.disconnectTaskManager(ResourceID resourceID,
Exception cause) |
void |
JobMasterGateway.failSlot(ResourceID taskManagerId,
AllocationID allocationId,
Exception cause)
Fails the slot with the given allocation id and cause.
|
void |
JobMaster.failSlot(ResourceID taskManagerId,
AllocationID allocationId,
Exception cause) |
void |
JobMasterGateway.heartbeatFromResourceManager(ResourceID resourceID)
Sends heartbeat request from the resource manager.
|
void |
JobMaster.heartbeatFromResourceManager(ResourceID resourceID) |
void |
JobMasterGateway.heartbeatFromTaskManager(ResourceID resourceID,
AccumulatorReport accumulatorReport)
Sends the heartbeat to job manager from task manager.
|
void |
JobMaster.heartbeatFromTaskManager(ResourceID resourceID,
AccumulatorReport accumulatorReport) |
CompletableFuture<Collection<SlotOffer>> |
JobMasterGateway.offerSlots(ResourceID taskManagerId,
Collection<SlotOffer> slots,
Time timeout)
Offers the given slots to the job manager.
|
CompletableFuture<Collection<SlotOffer>> |
JobMaster.offerSlots(ResourceID taskManagerId,
Collection<SlotOffer> slots,
Time timeout) |
Constructor and Description |
---|
JMTMRegistrationSuccess(ResourceID resourceID) |
JobMaster(RpcService rpcService,
JobMasterConfiguration jobMasterConfiguration,
ResourceID resourceId,
JobGraph jobGraph,
HighAvailabilityServices highAvailabilityService,
SlotPoolFactory slotPoolFactory,
SchedulerFactory schedulerFactory,
JobManagerSharedServices jobManagerSharedServices,
HeartbeatServices heartbeatServices,
JobManagerJobMetricGroupFactory jobMetricGroupFactory,
OnCompletionActions jobCompletionActions,
FatalErrorHandler fatalErrorHandler,
ClassLoader userCodeLoader,
SchedulerNGFactory schedulerNGFactory,
ShuffleMaster<?> shuffleMaster,
PartitionTrackerFactory partitionTrackerFactory) |
JobMasterRegistrationSuccess(ResourceManagerId resourceManagerId,
ResourceID resourceManagerResourceId) |
Modifier and Type | Method and Description |
---|---|
Optional<ResourceID> |
SlotPool.failAllocation(AllocationID allocationID,
Exception cause)
Fails the slot with the given allocation id.
|
Optional<ResourceID> |
SlotPoolImpl.failAllocation(AllocationID allocationID,
Exception cause)
Fail the specified allocation and release the corresponding slot if we have one.
|
Modifier and Type | Method and Description |
---|---|
AllocatedSlotReport |
SlotPool.createAllocatedSlotReport(ResourceID taskManagerId)
Create report about the allocated slots belonging to the specified task manager.
|
AllocatedSlotReport |
SlotPoolImpl.createAllocatedSlotReport(ResourceID taskManagerId) |
boolean |
SlotPool.registerTaskManager(ResourceID resourceID)
Registers a TaskExecutor with the given
ResourceID at SlotPool . |
boolean |
SlotPoolImpl.registerTaskManager(ResourceID resourceID)
Register TaskManager to this pool, only those slots come from registered TaskManager will be
considered valid.
|
boolean |
SlotPool.releaseTaskManager(ResourceID resourceId,
Exception cause)
Releases a TaskExecutor with the given
ResourceID from the SlotPool . |
boolean |
SlotPoolImpl.releaseTaskManager(ResourceID resourceId,
Exception cause)
Unregister TaskManager from this pool, all the related slots will be released and tasks be
canceled.
|
Modifier and Type | Method and Description |
---|---|
void |
MetricRegistryImpl.startQueryService(RpcService rpcService,
ResourceID resourceID)
Initializes the MetricQueryService.
|
Modifier and Type | Method and Description |
---|---|
static MetricQueryService |
MetricQueryService.createMetricQueryService(RpcService rpcService,
ResourceID resourceID,
long maximumFrameSize)
Starts the MetricQueryService actor in the given actor system.
|
Modifier and Type | Method and Description |
---|---|
static Tuple2<TaskManagerMetricGroup,MetricGroup> |
MetricUtils.instantiateTaskManagerMetricGroup(MetricRegistry metricRegistry,
String hostName,
ResourceID resourceID,
Optional<Time> systemResourceProbeInterval) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
TaskExecutorRegistration.getResourceId() |
protected ResourceID |
StandaloneResourceManager.workerStarted(ResourceID resourceID) |
Modifier and Type | Method and Description |
---|---|
protected ResourceManager<ResourceID> |
StandaloneResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
ResourceManagerMetricGroup resourceManagerMetricGroup,
ResourceManagerRuntimeServices resourceManagerRuntimeServices) |
CompletableFuture<Collection<Tuple2<ResourceID,String>>> |
ResourceManagerGateway.requestTaskManagerMetricQueryServiceAddresses(Time timeout)
Requests the paths for the TaskManager's
MetricQueryService to query. |
CompletableFuture<Collection<Tuple2<ResourceID,String>>> |
ResourceManager.requestTaskManagerMetricQueryServiceAddresses(Time timeout) |
Modifier and Type | Method and Description |
---|---|
protected void |
ResourceManager.closeTaskManagerConnection(ResourceID resourceID,
Exception cause)
This method should be called by the framework once it detects that a currently registered
task executor has failed.
|
ResourceManager<T> |
ActiveResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
MetricRegistry metricRegistry,
String hostname) |
ResourceManager<T> |
ResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
MetricRegistry metricRegistry,
String hostname) |
protected ResourceManager<ResourceID> |
StandaloneResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
ResourceManagerMetricGroup resourceManagerMetricGroup,
ResourceManagerRuntimeServices resourceManagerRuntimeServices) |
protected abstract ResourceManager<T> |
ResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
ResourceManagerMetricGroup resourceManagerMetricGroup,
ResourceManagerRuntimeServices resourceManagerRuntimeServices) |
void |
ResourceManagerGateway.disconnectTaskManager(ResourceID resourceID,
Exception cause)
Disconnects a TaskManager specified by the given resourceID from the
ResourceManager . |
void |
ResourceManager.disconnectTaskManager(ResourceID resourceId,
Exception cause) |
void |
ResourceManagerGateway.heartbeatFromJobManager(ResourceID heartbeatOrigin)
Sends the heartbeat to resource manager from job manager
|
void |
ResourceManager.heartbeatFromJobManager(ResourceID resourceID) |
void |
ResourceManagerGateway.heartbeatFromTaskManager(ResourceID heartbeatOrigin,
TaskExecutorHeartbeatPayload heartbeatPayload)
Sends the heartbeat to resource manager from task manager
|
void |
ResourceManager.heartbeatFromTaskManager(ResourceID resourceID,
TaskExecutorHeartbeatPayload heartbeatPayload) |
protected void |
ActiveResourceManager.notifyAllocatedWorkerStopped(ResourceID resourceID)
Notify that a worker with the given resource spec has been stopped.
|
protected ActiveResourceManager.PendingWorkerNums |
ActiveResourceManager.notifyNewWorkerAllocated(WorkerResourceSpec workerResourceSpec,
ResourceID resourceID)
Notify that a worker with the given resource spec has been allocated.
|
CompletableFuture<RegistrationResponse> |
ResourceManagerGateway.registerJobManager(JobMasterId jobMasterId,
ResourceID jobMasterResourceId,
String jobMasterAddress,
JobID jobId,
Time timeout)
Register a
JobMaster at the resource manager. |
CompletableFuture<RegistrationResponse> |
ResourceManager.registerJobManager(JobMasterId jobMasterId,
ResourceID jobManagerResourceId,
String jobManagerAddress,
JobID jobId,
Time timeout) |
CompletableFuture<TransientBlobKey> |
ResourceManagerGateway.requestTaskManagerFileUploadByName(ResourceID taskManagerId,
String fileName,
Time timeout)
Request the file upload from the given
TaskExecutor to the cluster's BlobServer . |
CompletableFuture<TransientBlobKey> |
ResourceManager.requestTaskManagerFileUploadByName(ResourceID taskManagerId,
String fileName,
Time timeout) |
CompletableFuture<TransientBlobKey> |
ResourceManagerGateway.requestTaskManagerFileUploadByType(ResourceID taskManagerId,
FileType fileType,
Time timeout)
Request the file upload from the given
TaskExecutor to the cluster's BlobServer . |
CompletableFuture<TransientBlobKey> |
ResourceManager.requestTaskManagerFileUploadByType(ResourceID taskManagerId,
FileType fileType,
Time timeout) |
CompletableFuture<TaskManagerInfo> |
ResourceManagerGateway.requestTaskManagerInfo(ResourceID taskManagerId,
Time timeout)
Requests information about the given
TaskExecutor . |
CompletableFuture<TaskManagerInfo> |
ResourceManager.requestTaskManagerInfo(ResourceID resourceId,
Time timeout) |
CompletableFuture<Collection<LogInfo>> |
ResourceManagerGateway.requestTaskManagerLogList(ResourceID taskManagerId,
Time timeout)
Request log list from the given
TaskExecutor . |
CompletableFuture<Collection<LogInfo>> |
ResourceManager.requestTaskManagerLogList(ResourceID taskManagerId,
Time timeout) |
CompletableFuture<ThreadDumpInfo> |
ResourceManagerGateway.requestThreadDump(ResourceID taskManagerId,
Time timeout)
Requests the thread dump from the given
TaskExecutor . |
CompletableFuture<ThreadDumpInfo> |
ResourceManager.requestThreadDump(ResourceID taskManagerId,
Time timeout) |
CompletableFuture<Acknowledge> |
ResourceManagerGateway.sendSlotReport(ResourceID taskManagerResourceId,
InstanceID taskManagerRegistrationId,
SlotReport slotReport,
Time timeout)
Sends the given
SlotReport to the ResourceManager. |
CompletableFuture<Acknowledge> |
ResourceManager.sendSlotReport(ResourceID taskManagerResourceId,
InstanceID taskManagerRegistrationId,
SlotReport slotReport,
Time timeout) |
boolean |
StandaloneResourceManager.stopWorker(ResourceID resourceID) |
protected ResourceID |
StandaloneResourceManager.workerStarted(ResourceID resourceID) |
protected abstract WorkerType |
ResourceManager.workerStarted(ResourceID resourceID)
Callback when a worker was started.
|
Constructor and Description |
---|
ActiveResourceManager(Configuration flinkConfig,
Map<String,String> env,
RpcService rpcService,
ResourceID resourceId,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
ResourceManagerMetricGroup resourceManagerMetricGroup) |
ResourceManager(RpcService rpcService,
ResourceID resourceId,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
ResourceManagerMetricGroup resourceManagerMetricGroup,
Time rpcTimeout) |
StandaloneResourceManager(RpcService rpcService,
ResourceID resourceId,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
ResourceManagerMetricGroup resourceManagerMetricGroup,
Time startupPeriodTime,
Time rpcTimeout) |
TaskExecutorRegistration(String taskExecutorAddress,
ResourceID resourceId,
int dataPort,
HardwareDescription hardwareDescription,
ResourceProfile defaultSlotResourceProfile,
ResourceProfile totalResourceProfile) |
Constructor and Description |
---|
UnknownTaskExecutorException(ResourceID taskExecutorId) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
JobManagerRegistration.getJobManagerResourceID() |
ResourceID |
TaskExecutorConnection.getResourceID() |
Constructor and Description |
---|
JobManagerRegistration(JobID jobID,
ResourceID jobManagerResourceID,
JobMasterGateway jobManagerGateway) |
TaskExecutorConnection(ResourceID resourceID,
TaskExecutorGateway taskExecutorGateway) |
Modifier and Type | Method and Description |
---|---|
protected abstract CompletableFuture<TransientBlobKey> |
AbstractTaskManagerFileHandler.requestFileUpload(ResourceManagerGateway resourceManagerGateway,
Tuple2<ResourceID,String> taskManagerIdAndFileName) |
protected CompletableFuture<TransientBlobKey> |
TaskManagerLogFileHandler.requestFileUpload(ResourceManagerGateway resourceManagerGateway,
Tuple2<ResourceID,String> taskManagerIdAndFileName) |
protected CompletableFuture<TransientBlobKey> |
TaskManagerStdoutFileHandler.requestFileUpload(ResourceManagerGateway resourceManagerGateway,
Tuple2<ResourceID,String> taskManagerIdAndFileName) |
protected CompletableFuture<TransientBlobKey> |
TaskManagerCustomLogHandler.requestFileUpload(ResourceManagerGateway resourceManagerGateway,
Tuple2<ResourceID,String> taskManagerIdAndFileName) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
TaskManagersFilterQueryParameter.convertStringToValue(String value) |
Modifier and Type | Method and Description |
---|---|
String |
TaskManagersFilterQueryParameter.convertValueToString(ResourceID value) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
ResourceIDDeserializer.deserialize(org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParser p,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.DeserializationContext ctxt) |
Modifier and Type | Method and Description |
---|---|
void |
ResourceIDSerializer.serialize(ResourceID value,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonGenerator gen,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.SerializerProvider provider) |
Modifier and Type | Method and Description |
---|---|
protected ResourceID |
TaskManagerIdPathParameter.convertFromString(String value) |
ResourceID |
TaskManagerInfo.getResourceId() |
Modifier and Type | Method and Description |
---|---|
protected String |
TaskManagerIdPathParameter.convertToString(ResourceID value) |
Constructor and Description |
---|
TaskManagerDetailsInfo(ResourceID resourceId,
String address,
int dataPort,
long lastHeartbeat,
int numberSlots,
int numberAvailableSlots,
ResourceProfileInfo totalResource,
ResourceProfileInfo freeResource,
HardwareDescription hardwareDescription,
TaskManagerMetricsInfo taskManagerMetrics) |
TaskManagerInfo(ResourceID resourceId,
String address,
int dataPort,
long lastHeartbeat,
int numberSlots,
int numberAvailableSlots,
ResourceProfileInfo totalResource,
ResourceProfileInfo freeResource,
HardwareDescription hardwareDescription) |
TaskManagerInfo(ResourceID resourceId,
String address,
int dataPort,
long lastHeartbeat,
int numberSlots,
int numberAvailableSlots,
ResourceProfile totalResource,
ResourceProfile freeResource,
HardwareDescription hardwareDescription) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
ProducerDescriptor.getProducerLocation() |
ResourceID |
ShuffleEnvironmentContext.getTaskExecutorResourceId() |
Modifier and Type | Method and Description |
---|---|
Optional<ResourceID> |
ShuffleDescriptor.storesLocalResourcesOn()
Returns the location of the producing task executor if the partition occupies local resources
there.
|
Optional<ResourceID> |
UnknownShuffleDescriptor.storesLocalResourcesOn() |
Optional<ResourceID> |
NettyShuffleDescriptor.storesLocalResourcesOn() |
Modifier and Type | Method and Description |
---|---|
boolean |
NettyShuffleDescriptor.isLocalTo(ResourceID consumerLocation) |
Constructor and Description |
---|
NettyShuffleDescriptor(ResourceID producerLocation,
NettyShuffleDescriptor.PartitionConnectionInfo partitionConnectionInfo,
ResultPartitionID resultPartitionID) |
ProducerDescriptor(ResourceID producerLocation,
ExecutionAttemptID producerExecutionId,
InetAddress address,
int dataPort) |
ShuffleEnvironmentContext(Configuration configuration,
ResourceID taskExecutorResourceId,
MemorySize networkMemorySize,
boolean localCommunicationOnly,
InetAddress hostAddress,
TaskEventPublisher eventPublisher,
MetricGroup parentMetricGroup,
Executor ioExecutor) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
JobTable.Connection.getResourceId() |
ResourceID |
TaskManagerServicesConfiguration.getResourceID() |
ResourceID |
TaskExecutor.getResourceID() |
ResourceID |
TaskExecutorRegistrationSuccess.getResourceManagerId()
Gets the unique ID that identifies the ResourceManager.
|
Modifier and Type | Method and Description |
---|---|
JobTable.Connection |
JobTable.Job.connect(ResourceID resourceId,
JobMasterGateway jobMasterGateway,
TaskManagerActions taskManagerActions,
CheckpointResponder checkpointResponder,
GlobalAggregateManager aggregateManager,
ResultPartitionConsumableNotifier resultPartitionConsumableNotifier,
PartitionProducerStateChecker partitionStateChecker)
Connects the job to a JobManager and associates the provided services with this
connection.
|
TaskManagerRunner.TaskExecutorService |
TaskManagerRunner.TaskExecutorServiceFactory.createTaskExecutor(Configuration configuration,
ResourceID resourceID,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
BlobCacheService blobCacheService,
boolean localCommunicationOnly,
ExternalResourceInfoProvider externalResourceInfoProvider,
FatalErrorHandler fatalErrorHandler) |
static TaskManagerRunner.TaskExecutorService |
TaskManagerRunner.createTaskExecutorService(Configuration configuration,
ResourceID resourceID,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
BlobCacheService blobCacheService,
boolean localCommunicationOnly,
ExternalResourceInfoProvider externalResourceInfoProvider,
FatalErrorHandler fatalErrorHandler) |
static TaskManagerServicesConfiguration |
TaskManagerServicesConfiguration.fromConfiguration(Configuration configuration,
ResourceID resourceID,
String externalAddress,
boolean localCommunicationOnly,
TaskExecutorResourceSpec taskExecutorResourceSpec)
Utility method to extract TaskManager config parameters from the configuration and to sanity
check them.
|
Optional<JobTable.Connection> |
DefaultJobTable.getConnection(ResourceID resourceId) |
Optional<JobTable.Connection> |
JobTable.getConnection(ResourceID resourceId)
Gets the connection registered under resourceId.
|
void |
TaskExecutor.heartbeatFromJobManager(ResourceID resourceID,
AllocatedSlotReport allocatedSlotReport) |
void |
TaskExecutorGateway.heartbeatFromJobManager(ResourceID heartbeatOrigin,
AllocatedSlotReport allocatedSlotReport)
Heartbeat request from the job manager.
|
void |
TaskExecutor.heartbeatFromResourceManager(ResourceID resourceID) |
void |
TaskExecutorGateway.heartbeatFromResourceManager(ResourceID heartbeatOrigin)
Heartbeat request from the resource manager.
|
static int |
TaskManagerRunner.runTaskManager(Configuration configuration,
ResourceID resourceId,
PluginManager pluginManager) |
static void |
TaskManagerRunner.runTaskManagerProcessSecurely(Configuration configuration,
ResourceID resourceID) |
static void |
TaskManagerRunner.runTaskManagerProcessSecurely(String[] args,
ResourceID resourceID) |
static TaskExecutor |
TaskManagerRunner.startTaskManager(Configuration configuration,
ResourceID resourceID,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
BlobCacheService blobCacheService,
boolean localCommunicationOnly,
ExternalResourceInfoProvider externalResourceInfoProvider,
FatalErrorHandler fatalErrorHandler) |
Constructor and Description |
---|
TaskExecutorRegistrationSuccess(InstanceID registrationId,
ResourceID resourceManagerResourceId,
ClusterInformation clusterInformation)
Create a new
TaskExecutorRegistrationSuccess message. |
TaskManagerRunner(Configuration configuration,
ResourceID resourceId,
PluginManager pluginManager,
TaskManagerRunner.TaskExecutorServiceFactory taskExecutorServiceFactory) |
Modifier and Type | Method and Description |
---|---|
SlotReport |
TaskSlotTableImpl.createSlotReport(ResourceID resourceId) |
SlotReport |
TaskSlotTable.createSlotReport(ResourceID resourceId) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
TaskManagerLocation.getResourceID()
Gets the ID of the resource in which the TaskManager is started.
|
ResourceID |
UnresolvedTaskManagerLocation.getResourceID() |
Constructor and Description |
---|
TaskManagerLocation(ResourceID resourceID,
InetAddress inetAddress,
int dataPort)
Constructs a new instance connection info object.
|
TaskManagerLocation(ResourceID resourceID,
InetAddress inetAddress,
int dataPort,
TaskManagerLocation.HostNameSupplier hostNameSupplier)
Constructs a new instance connection info object.
|
UnresolvedTaskManagerLocation(ResourceID resourceID,
String externalAddress,
int dataPort) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Collection<Tuple2<ResourceID,String>>> |
RestfulGateway.requestTaskManagerMetricQueryServiceAddresses(Time timeout)
Requests the addresses for the TaskManagers'
MetricQueryService to query. |
Modifier and Type | Method and Description |
---|---|
ResourceID |
YarnWorkerNode.getResourceID() |
Modifier and Type | Method and Description |
---|---|
protected YarnWorkerNode |
YarnResourceManager.workerStarted(ResourceID resourceID) |
Constructor and Description |
---|
YarnResourceManager(RpcService rpcService,
ResourceID resourceId,
Configuration flinkConfig,
Map<String,String> env,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
String webInterfaceUrl,
ResourceManagerMetricGroup resourceManagerMetricGroup) |
Modifier and Type | Method and Description |
---|---|
ResourceManager<YarnWorkerNode> |
YarnResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
ResourceManagerMetricGroup resourceManagerMetricGroup,
ResourceManagerRuntimeServices resourceManagerRuntimeServices) |
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.