Modifier and Type | Method and Description |
---|---|
ResourceID |
RegisteredMesosWorkerNode.getResourceID() |
Modifier and Type | Method and Description |
---|---|
ResourceManager<RegisteredMesosWorkerNode> |
MesosResourceManagerFactory.createActiveResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
protected RegisteredMesosWorkerNode |
MesosResourceManager.workerStarted(ResourceID resourceID)
Callback when a worker was started.
|
Constructor and Description |
---|
MesosResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
Configuration flinkConfig,
MesosServices mesosServices,
MesosConfiguration mesosConfig,
MesosTaskManagerParameters taskManagerParameters,
ContainerSpecification taskManagerContainerSpec,
String webUiUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
Modifier and Type | Method and Description |
---|---|
static ResourceID |
ResourceID.generate()
Generate a random resource id.
|
ResourceID |
ResourceIDRetrievable.getResourceID()
Gets the ResourceID of the object.
|
ResourceID |
ResourceID.getResourceID()
A ResourceID can always retrieve a ResourceID.
|
ResourceID |
SlotID.getResourceID() |
Constructor and Description |
---|
SlotID(ResourceID resourceId,
int slotNumber) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Collection<Tuple2<ResourceID,String>>> |
Dispatcher.requestTaskManagerMetricQueryServiceAddresses(Time timeout) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
HeartbeatMonitor.getHeartbeatTargetId()
Gets heartbeat target id.
|
ResourceID |
HeartbeatMonitorImpl.getHeartbeatTargetId() |
Modifier and Type | Method and Description |
---|---|
<I,O> HeartbeatManager<I,O> |
HeartbeatServices.createHeartbeatManager(ResourceID resourceId,
HeartbeatListener<I,O> heartbeatListener,
ScheduledExecutor mainThreadExecutor,
org.slf4j.Logger log)
Creates a heartbeat manager which does not actively send heartbeats.
|
<I,O> HeartbeatManager<I,O> |
HeartbeatServices.createHeartbeatManagerSender(ResourceID resourceId,
HeartbeatListener<I,O> heartbeatListener,
ScheduledExecutor mainThreadExecutor,
org.slf4j.Logger log)
Creates a heartbeat manager which actively sends heartbeats to monitoring targets.
|
HeartbeatMonitor<O> |
HeartbeatMonitor.Factory.createHeartbeatMonitor(ResourceID resourceID,
HeartbeatTarget<O> heartbeatTarget,
ScheduledExecutor mainThreadExecutor,
HeartbeatListener<?,O> heartbeatListener,
long heartbeatTimeoutIntervalMs)
Create heartbeat monitor heartbeat monitor.
|
long |
HeartbeatManager.getLastHeartbeatFrom(ResourceID resourceId)
Returns the last received heartbeat from the given target.
|
long |
NoOpHeartbeatManager.getLastHeartbeatFrom(ResourceID resourceId) |
long |
HeartbeatManagerImpl.getLastHeartbeatFrom(ResourceID resourceId) |
void |
HeartbeatManager.monitorTarget(ResourceID resourceID,
HeartbeatTarget<O> heartbeatTarget)
Start monitoring a
HeartbeatTarget . |
void |
NoOpHeartbeatManager.monitorTarget(ResourceID resourceID,
HeartbeatTarget<O> heartbeatTarget) |
void |
HeartbeatManagerImpl.monitorTarget(ResourceID resourceID,
HeartbeatTarget<O> heartbeatTarget) |
void |
HeartbeatListener.notifyHeartbeatTimeout(ResourceID resourceID)
Callback which is called if a heartbeat for the machine identified by the given resource
ID times out.
|
void |
NoOpHeartbeatManager.receiveHeartbeat(ResourceID heartbeatOrigin,
I heartbeatPayload) |
void |
HeartbeatManagerImpl.receiveHeartbeat(ResourceID heartbeatOrigin,
I heartbeatPayload) |
void |
HeartbeatTarget.receiveHeartbeat(ResourceID heartbeatOrigin,
I heartbeatPayload)
Sends a heartbeat response to the target.
|
void |
HeartbeatListener.reportPayload(ResourceID resourceID,
I payload)
Callback which is called whenever a heartbeat with an associated payload is received.
|
void |
NoOpHeartbeatManager.requestHeartbeat(ResourceID requestOrigin,
I heartbeatPayload) |
void |
HeartbeatManagerImpl.requestHeartbeat(ResourceID requestOrigin,
I heartbeatPayload) |
void |
HeartbeatTarget.requestHeartbeat(ResourceID requestOrigin,
I heartbeatPayload)
Requests a heartbeat from the target.
|
O |
HeartbeatListener.retrievePayload(ResourceID resourceID)
Retrieves the payload value for the next heartbeat message.
|
void |
HeartbeatManager.unmonitorTarget(ResourceID resourceID)
Stops monitoring the heartbeat target with the associated resource ID.
|
void |
NoOpHeartbeatManager.unmonitorTarget(ResourceID resourceID) |
void |
HeartbeatManagerImpl.unmonitorTarget(ResourceID resourceID) |
Constructor and Description |
---|
HeartbeatManagerImpl(long heartbeatTimeoutIntervalMs,
ResourceID ownResourceID,
HeartbeatListener<I,O> heartbeatListener,
ScheduledExecutor mainThreadExecutor,
org.slf4j.Logger log) |
HeartbeatManagerImpl(long heartbeatTimeoutIntervalMs,
ResourceID ownResourceID,
HeartbeatListener<I,O> heartbeatListener,
ScheduledExecutor mainThreadExecutor,
org.slf4j.Logger log,
HeartbeatMonitor.Factory<O> heartbeatMonitorFactory) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
Slot.getTaskManagerID()
Gets the ID of the TaskManager that offers this slot.
|
ResourceID |
Instance.getTaskManagerID() |
Modifier and Type | Method and Description |
---|---|
boolean |
PartitionTrackerImpl.isTrackingPartitionsFor(ResourceID producingTaskExecutorId) |
boolean |
PartitionTracker.isTrackingPartitionsFor(ResourceID producingTaskExecutorId)
Returns whether any partition is being tracked for the given task executor ID.
|
Optional<TaskExecutorGateway> |
PartitionTrackerFactory.TaskExecutorGatewayLookup.lookup(ResourceID taskExecutorId)
Returns a
TaskExecutorGateway corresponding to the given ResourceID. |
void |
PartitionTrackerImpl.startTrackingPartition(ResourceID producingTaskExecutorId,
ResultPartitionDeploymentDescriptor resultPartitionDeploymentDescriptor) |
void |
PartitionTracker.startTrackingPartition(ResourceID producingTaskExecutorId,
ResultPartitionDeploymentDescriptor resultPartitionDeploymentDescriptor)
Starts the tracking of the given partition for the given task executor ID.
|
void |
PartitionTrackerImpl.stopTrackingAndReleasePartitionsFor(ResourceID producingTaskExecutorId) |
void |
PartitionTracker.stopTrackingAndReleasePartitionsFor(ResourceID producingTaskExecutorId)
Releases all partitions for the given task executor ID, and stop the tracking of partitions that were released.
|
void |
PartitionTrackerImpl.stopTrackingPartitionsFor(ResourceID producingTaskExecutorId) |
void |
PartitionTracker.stopTrackingPartitionsFor(ResourceID producingTaskExecutorId)
Stops the tracking of all partitions for the given task executor ID, without issuing any release calls.
|
Modifier and Type | Method and Description |
---|---|
void |
SingleInputGate.updateInputChannel(ResourceID localLocation,
NettyShuffleDescriptor shuffleDescriptor) |
Constructor and Description |
---|
SingleInputGateFactory(ResourceID taskExecutorResourceId,
NettyShuffleEnvironmentConfiguration networkConfig,
ConnectionManager connectionManager,
ResultPartitionManager partitionManager,
TaskEventPublisher taskEventPublisher,
NetworkBufferPool networkBufferPool) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
JMTMRegistrationSuccess.getResourceID() |
ResourceID |
JobMasterRegistrationSuccess.getResourceManagerResourceId() |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
JobMaster.disconnectTaskManager(ResourceID resourceID,
Exception cause) |
CompletableFuture<Acknowledge> |
JobMasterGateway.disconnectTaskManager(ResourceID resourceID,
Exception cause)
Disconnects the given
TaskExecutor from the
JobMaster . |
void |
JobMaster.failSlot(ResourceID taskManagerId,
AllocationID allocationId,
Exception cause) |
void |
JobMasterGateway.failSlot(ResourceID taskManagerId,
AllocationID allocationId,
Exception cause)
Fails the slot with the given allocation id and cause.
|
void |
JobMaster.heartbeatFromResourceManager(ResourceID resourceID) |
void |
JobMasterGateway.heartbeatFromResourceManager(ResourceID resourceID)
Sends heartbeat request from the resource manager.
|
void |
JobMaster.heartbeatFromTaskManager(ResourceID resourceID,
AccumulatorReport accumulatorReport) |
void |
JobMasterGateway.heartbeatFromTaskManager(ResourceID resourceID,
AccumulatorReport accumulatorReport)
Sends the heartbeat to job manager from task manager.
|
CompletableFuture<Collection<SlotOffer>> |
JobMaster.offerSlots(ResourceID taskManagerId,
Collection<SlotOffer> slots,
Time timeout) |
CompletableFuture<Collection<SlotOffer>> |
JobMasterGateway.offerSlots(ResourceID taskManagerId,
Collection<SlotOffer> slots,
Time timeout)
Offers the given slots to the job manager.
|
Constructor and Description |
---|
JMTMRegistrationSuccess(ResourceID resourceID) |
JobMaster(RpcService rpcService,
JobMasterConfiguration jobMasterConfiguration,
ResourceID resourceId,
JobGraph jobGraph,
HighAvailabilityServices highAvailabilityService,
SlotPoolFactory slotPoolFactory,
SchedulerFactory schedulerFactory,
JobManagerSharedServices jobManagerSharedServices,
HeartbeatServices heartbeatServices,
JobManagerJobMetricGroupFactory jobMetricGroupFactory,
OnCompletionActions jobCompletionActions,
FatalErrorHandler fatalErrorHandler,
ClassLoader userCodeLoader,
SchedulerNGFactory schedulerNGFactory,
ShuffleMaster<?> shuffleMaster,
PartitionTrackerFactory partitionTrackerFactory) |
JobMasterRegistrationSuccess(ResourceManagerId resourceManagerId,
ResourceID resourceManagerResourceId) |
Modifier and Type | Method and Description |
---|---|
Optional<ResourceID> |
SlotPoolImpl.failAllocation(AllocationID allocationID,
Exception cause)
Fail the specified allocation and release the corresponding slot if we have one.
|
Optional<ResourceID> |
SlotPool.failAllocation(AllocationID allocationID,
Exception cause)
Fails the slot with the given allocation id.
|
Modifier and Type | Method and Description |
---|---|
AllocatedSlotReport |
SlotPoolImpl.createAllocatedSlotReport(ResourceID taskManagerId) |
AllocatedSlotReport |
SlotPool.createAllocatedSlotReport(ResourceID taskManagerId)
Create report about the allocated slots belonging to the specified task manager.
|
boolean |
SlotPoolImpl.registerTaskManager(ResourceID resourceID)
Register TaskManager to this pool, only those slots come from registered TaskManager will be considered valid.
|
boolean |
SlotPool.registerTaskManager(ResourceID resourceID)
Registers a TaskExecutor with the given
ResourceID at SlotPool . |
boolean |
SlotPoolImpl.releaseTaskManager(ResourceID resourceId,
Exception cause)
Unregister TaskManager from this pool, all the related slots will be released and tasks be canceled.
|
boolean |
SlotPool.releaseTaskManager(ResourceID resourceId,
Exception cause)
Releases a TaskExecutor with the given
ResourceID from the SlotPool . |
Modifier and Type | Method and Description |
---|---|
void |
MetricRegistryImpl.startQueryService(RpcService rpcService,
ResourceID resourceID)
Initializes the MetricQueryService.
|
Modifier and Type | Method and Description |
---|---|
static MetricQueryService |
MetricQueryService.createMetricQueryService(RpcService rpcService,
ResourceID resourceID,
long maximumFrameSize)
Starts the MetricQueryService actor in the given actor system.
|
Modifier and Type | Method and Description |
---|---|
static Tuple2<TaskManagerMetricGroup,MetricGroup> |
MetricUtils.instantiateTaskManagerMetricGroup(MetricRegistry metricRegistry,
String hostName,
ResourceID resourceID,
Optional<Time> systemResourceProbeInterval) |
Modifier and Type | Method and Description |
---|---|
protected ResourceID |
StandaloneResourceManager.workerStarted(ResourceID resourceID) |
Modifier and Type | Method and Description |
---|---|
ResourceManager<ResourceID> |
StandaloneResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
CompletableFuture<Collection<Tuple2<ResourceID,String>>> |
ResourceManagerGateway.requestTaskManagerMetricQueryServiceAddresses(Time timeout)
Requests the paths for the TaskManager's
MetricQueryService to query. |
CompletableFuture<Collection<Tuple2<ResourceID,String>>> |
ResourceManager.requestTaskManagerMetricQueryServiceAddresses(Time timeout) |
Modifier and Type | Method and Description |
---|---|
protected void |
ResourceManager.closeTaskManagerConnection(ResourceID resourceID,
Exception cause)
This method should be called by the framework once it detects that a currently registered
task executor has failed.
|
protected abstract ResourceManager<T> |
ActiveResourceManagerFactory.createActiveResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
ResourceManager<ResourceID> |
StandaloneResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
ResourceManager<T> |
ResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
ResourceManager<T> |
ActiveResourceManagerFactory.createResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
void |
ResourceManagerGateway.disconnectTaskManager(ResourceID resourceID,
Exception cause)
Disconnects a TaskManager specified by the given resourceID from the
ResourceManager . |
void |
ResourceManager.disconnectTaskManager(ResourceID resourceId,
Exception cause) |
void |
ResourceManagerGateway.heartbeatFromJobManager(ResourceID heartbeatOrigin)
Sends the heartbeat to resource manager from job manager
|
void |
ResourceManager.heartbeatFromJobManager(ResourceID resourceID) |
void |
ResourceManagerGateway.heartbeatFromTaskManager(ResourceID heartbeatOrigin,
SlotReport slotReport)
Sends the heartbeat to resource manager from task manager
|
void |
ResourceManager.heartbeatFromTaskManager(ResourceID resourceID,
SlotReport slotReport) |
CompletableFuture<RegistrationResponse> |
ResourceManagerGateway.registerJobManager(JobMasterId jobMasterId,
ResourceID jobMasterResourceId,
String jobMasterAddress,
JobID jobId,
Time timeout)
Register a
JobMaster at the resource manager. |
CompletableFuture<RegistrationResponse> |
ResourceManager.registerJobManager(JobMasterId jobMasterId,
ResourceID jobManagerResourceId,
String jobManagerAddress,
JobID jobId,
Time timeout) |
CompletableFuture<RegistrationResponse> |
ResourceManagerGateway.registerTaskExecutor(String taskExecutorAddress,
ResourceID resourceId,
int dataPort,
HardwareDescription hardwareDescription,
Time timeout)
Register a
TaskExecutor at the resource manager. |
CompletableFuture<RegistrationResponse> |
ResourceManager.registerTaskExecutor(String taskExecutorAddress,
ResourceID taskExecutorResourceId,
int dataPort,
HardwareDescription hardwareDescription,
Time timeout) |
CompletableFuture<TransientBlobKey> |
ResourceManagerGateway.requestTaskManagerFileUpload(ResourceID taskManagerId,
FileType fileType,
Time timeout)
Request the file upload from the given
TaskExecutor to the cluster's BlobServer . |
CompletableFuture<TransientBlobKey> |
ResourceManager.requestTaskManagerFileUpload(ResourceID taskManagerId,
FileType fileType,
Time timeout) |
CompletableFuture<TaskManagerInfo> |
ResourceManagerGateway.requestTaskManagerInfo(ResourceID taskManagerId,
Time timeout)
Requests information about the given
TaskExecutor . |
CompletableFuture<TaskManagerInfo> |
ResourceManager.requestTaskManagerInfo(ResourceID resourceId,
Time timeout) |
CompletableFuture<Acknowledge> |
ResourceManagerGateway.sendSlotReport(ResourceID taskManagerResourceId,
InstanceID taskManagerRegistrationId,
SlotReport slotReport,
Time timeout)
Sends the given
SlotReport to the ResourceManager. |
CompletableFuture<Acknowledge> |
ResourceManager.sendSlotReport(ResourceID taskManagerResourceId,
InstanceID taskManagerRegistrationId,
SlotReport slotReport,
Time timeout) |
boolean |
StandaloneResourceManager.stopWorker(ResourceID resourceID) |
protected abstract WorkerType |
ResourceManager.workerStarted(ResourceID resourceID)
Callback when a worker was started.
|
protected ResourceID |
StandaloneResourceManager.workerStarted(ResourceID resourceID) |
Constructor and Description |
---|
ResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
JobManagerMetricGroup jobManagerMetricGroup) |
StandaloneResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
JobManagerMetricGroup jobManagerMetricGroup,
Time startupPeriodTime) |
Constructor and Description |
---|
UnknownTaskExecutorException(ResourceID taskExecutorId) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
JobManagerRegistration.getJobManagerResourceID() |
ResourceID |
TaskExecutorConnection.getResourceID() |
Constructor and Description |
---|
JobManagerRegistration(JobID jobID,
ResourceID jobManagerResourceID,
JobMasterGateway jobManagerGateway) |
TaskExecutorConnection(ResourceID resourceID,
TaskExecutorGateway taskExecutorGateway) |
Modifier and Type | Method and Description |
---|---|
protected abstract CompletableFuture<TransientBlobKey> |
AbstractTaskManagerFileHandler.requestFileUpload(ResourceManagerGateway resourceManagerGateway,
ResourceID taskManagerResourceId) |
protected CompletableFuture<TransientBlobKey> |
TaskManagerLogFileHandler.requestFileUpload(ResourceManagerGateway resourceManagerGateway,
ResourceID taskManagerResourceId) |
protected CompletableFuture<TransientBlobKey> |
TaskManagerStdoutFileHandler.requestFileUpload(ResourceManagerGateway resourceManagerGateway,
ResourceID taskManagerResourceId) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
TaskManagersFilterQueryParameter.convertStringToValue(String value) |
Modifier and Type | Method and Description |
---|---|
String |
TaskManagersFilterQueryParameter.convertValueToString(ResourceID value) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
ResourceIDDeserializer.deserialize(org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParser p,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.DeserializationContext ctxt) |
Modifier and Type | Method and Description |
---|---|
void |
ResourceIDSerializer.serialize(ResourceID value,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonGenerator gen,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.SerializerProvider provider) |
Modifier and Type | Method and Description |
---|---|
protected ResourceID |
TaskManagerIdPathParameter.convertFromString(String value) |
ResourceID |
TaskManagerInfo.getResourceId() |
Modifier and Type | Method and Description |
---|---|
protected String |
TaskManagerIdPathParameter.convertToString(ResourceID value) |
Constructor and Description |
---|
TaskManagerDetailsInfo(ResourceID resourceId,
String address,
int dataPort,
long lastHeartbeat,
int numberSlots,
int numberAvailableSlots,
HardwareDescription hardwareDescription,
TaskManagerMetricsInfo taskManagerMetrics) |
TaskManagerInfo(ResourceID resourceId,
String address,
int dataPort,
long lastHeartbeat,
int numberSlots,
int numberAvailableSlots,
HardwareDescription hardwareDescription) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
ProducerDescriptor.getProducerLocation() |
ResourceID |
ShuffleEnvironmentContext.getTaskExecutorResourceId() |
Modifier and Type | Method and Description |
---|---|
Optional<ResourceID> |
ShuffleDescriptor.storesLocalResourcesOn()
Returns the location of the producing task executor if the partition occupies local resources there.
|
Optional<ResourceID> |
NettyShuffleDescriptor.storesLocalResourcesOn() |
Optional<ResourceID> |
UnknownShuffleDescriptor.storesLocalResourcesOn() |
Modifier and Type | Method and Description |
---|---|
boolean |
NettyShuffleDescriptor.isLocalTo(ResourceID consumerLocation) |
Constructor and Description |
---|
NettyShuffleDescriptor(ResourceID producerLocation,
NettyShuffleDescriptor.PartitionConnectionInfo partitionConnectionInfo,
ResultPartitionID resultPartitionID) |
ProducerDescriptor(ResourceID producerLocation,
ExecutionAttemptID producerExecutionId,
InetAddress address,
int dataPort) |
ShuffleEnvironmentContext(Configuration configuration,
ResourceID taskExecutorResourceId,
long maxJvmHeapMemory,
boolean localCommunicationOnly,
InetAddress hostAddress,
TaskEventPublisher eventPublisher,
MetricGroup parentMetricGroup) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
TaskExecutor.getResourceID() |
ResourceID |
JobManagerConnection.getResourceID() |
ResourceID |
TaskManagerServicesConfiguration.getResourceID() |
ResourceID |
TaskExecutorRegistrationSuccess.getResourceManagerId()
Gets the unique ID that identifies the ResourceManager.
|
Modifier and Type | Method and Description |
---|---|
static TaskManagerServicesConfiguration |
TaskManagerServicesConfiguration.fromConfiguration(Configuration configuration,
ResourceID resourceID,
InetAddress remoteAddress,
long freeHeapMemoryWithDefrag,
long maxJvmHeapMemory,
boolean localCommunicationOnly)
Utility method to extract TaskManager config parameters from the configuration and to
sanity check them.
|
void |
TaskExecutorGateway.heartbeatFromJobManager(ResourceID heartbeatOrigin,
AllocatedSlotReport allocatedSlotReport)
Heartbeat request from the job manager.
|
void |
TaskExecutor.heartbeatFromJobManager(ResourceID resourceID,
AllocatedSlotReport allocatedSlotReport) |
void |
TaskExecutorGateway.heartbeatFromResourceManager(ResourceID heartbeatOrigin)
Heartbeat request from the resource manager.
|
void |
TaskExecutor.heartbeatFromResourceManager(ResourceID resourceID) |
static void |
TaskManagerRunner.runTaskManager(Configuration configuration,
ResourceID resourceId) |
static TaskExecutor |
TaskManagerRunner.startTaskManager(Configuration configuration,
ResourceID resourceID,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
BlobCacheService blobCacheService,
boolean localCommunicationOnly,
FatalErrorHandler fatalErrorHandler) |
Constructor and Description |
---|
JobManagerConnection(JobID jobID,
ResourceID resourceID,
JobMasterGateway jobMasterGateway,
TaskManagerActions taskManagerActions,
CheckpointResponder checkpointResponder,
GlobalAggregateManager aggregateManager,
LibraryCacheManager libraryCacheManager,
ResultPartitionConsumableNotifier resultPartitionConsumableNotifier,
PartitionProducerStateChecker partitionStateChecker) |
TaskExecutorRegistrationSuccess(InstanceID registrationId,
ResourceID resourceManagerResourceId,
ClusterInformation clusterInformation)
Create a new
TaskExecutorRegistrationSuccess message. |
TaskExecutorToResourceManagerConnection(org.slf4j.Logger log,
RpcService rpcService,
String taskManagerAddress,
ResourceID taskManagerResourceId,
RetryingRegistrationConfiguration retryingRegistrationConfiguration,
int dataPort,
HardwareDescription hardwareDescription,
String resourceManagerAddress,
ResourceManagerId resourceManagerId,
Executor executor,
RegistrationConnectionListener<TaskExecutorToResourceManagerConnection,TaskExecutorRegistrationSuccess> registrationListener) |
TaskManagerRunner(Configuration configuration,
ResourceID resourceId) |
TaskManagerServicesConfiguration(Configuration configuration,
ResourceID resourceID,
InetAddress taskManagerAddress,
boolean localCommunicationOnly,
String[] tmpDirPaths,
String[] localRecoveryStateRootDirectories,
long freeHeapMemoryWithDefrag,
long maxJvmHeapMemory,
boolean localRecoveryEnabled,
QueryableStateConfiguration queryableStateConfig,
int numberOfSlots,
long configuredMemory,
MemoryType memoryType,
boolean preAllocateMemory,
float memoryFraction,
int pageSize,
long timerServiceShutdownTimeout,
RetryingRegistrationConfiguration retryingRegistrationConfiguration,
Optional<Time> systemResourceMetricsProbingInterval) |
Modifier and Type | Method and Description |
---|---|
SlotReport |
TaskSlotTable.createSlotReport(ResourceID resourceId) |
Modifier and Type | Method and Description |
---|---|
ResourceID |
TaskManagerLocation.getResourceID()
Gets the ID of the resource in which the TaskManager is started.
|
Constructor and Description |
---|
TaskManagerLocation(ResourceID resourceID,
InetAddress inetAddress,
int dataPort)
Constructs a new instance connection info object.
|
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Collection<Tuple2<ResourceID,String>>> |
RestfulGateway.requestTaskManagerMetricQueryServiceAddresses(Time timeout)
Requests the addresses for the TaskManagers'
MetricQueryService to query. |
Modifier and Type | Method and Description |
---|---|
ResourceID |
YarnWorkerNode.getResourceID() |
Modifier and Type | Method and Description |
---|---|
protected YarnWorkerNode |
YarnResourceManager.workerStarted(ResourceID resourceID) |
Constructor and Description |
---|
YarnResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
Configuration flinkConfig,
Map<String,String> env,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
ClusterInformation clusterInformation,
FatalErrorHandler fatalErrorHandler,
String webInterfaceUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
Modifier and Type | Method and Description |
---|---|
ResourceManager<YarnWorkerNode> |
YarnResourceManagerFactory.createActiveResourceManager(Configuration configuration,
ResourceID resourceId,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
FatalErrorHandler fatalErrorHandler,
ClusterInformation clusterInformation,
String webInterfaceUrl,
JobManagerMetricGroup jobManagerMetricGroup) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.