Package | Description |
---|---|
org.apache.flink.mesos.runtime.clusterframework | |
org.apache.flink.runtime.client | |
org.apache.flink.runtime.clusterframework |
This package contains the cluster resource management functionality.
|
org.apache.flink.runtime.clusterframework.standalone | |
org.apache.flink.runtime.leaderretrieval | |
org.apache.flink.runtime.minicluster | |
org.apache.flink.runtime.taskmanager | |
org.apache.flink.runtime.util | |
org.apache.flink.runtime.webmonitor | |
org.apache.flink.yarn |
Modifier and Type | Method and Description |
---|---|
static akka.actor.Props |
MesosFlinkResourceManager.createActorProps(Class<? extends MesosFlinkResourceManager> actorClass,
Configuration flinkConfig,
MesosConfiguration mesosConfig,
MesosWorkerStore workerStore,
LeaderRetrievalService leaderRetrievalService,
MesosTaskManagerParameters taskManagerParameters,
ContainerSpecification taskManagerContainerSpec,
MesosArtifactResolver artifactResolver,
org.slf4j.Logger log)
Creates the props needed to instantiate this actor.
|
Constructor and Description |
---|
MesosFlinkResourceManager(Configuration flinkConfig,
MesosConfiguration mesosConfig,
MesosWorkerStore workerStore,
LeaderRetrievalService leaderRetrievalService,
MesosTaskManagerParameters taskManagerParameters,
ContainerSpecification taskManagerContainerSpec,
MesosArtifactResolver artifactResolver,
int maxFailedTasks,
int numInitialTaskManagers) |
MesosTaskManager(TaskManagerConfiguration config,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment network,
int numberOfSlots,
LeaderRetrievalService leaderRetrievalService,
MetricRegistry metricRegistry) |
Modifier and Type | Method and Description |
---|---|
static JobListeningContext |
JobClient.attachToRunningJob(JobID jobID,
ActorGateway jobManagerGateWay,
Configuration configuration,
akka.actor.ActorSystem actorSystem,
LeaderRetrievalService leaderRetrievalService,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates)
Attaches to a running Job using the JobID.
|
static akka.actor.Props |
JobAttachmentClientActor.createActorProps(LeaderRetrievalService leaderRetrievalService,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutUpdates) |
static akka.actor.Props |
JobSubmissionClientActor.createActorProps(LeaderRetrievalService leaderRetrievalService,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutUpdates,
Configuration clientConfig) |
static JobListeningContext |
JobClient.submitJob(akka.actor.ActorSystem actorSystem,
Configuration config,
LeaderRetrievalService leaderRetrievalService,
JobGraph jobGraph,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates,
ClassLoader classLoader)
Submits a job to a Flink cluster (non-blocking) and returns a JobListeningContext which can be
passed to
awaitJobResult to get the result of the submission. |
static JobExecutionResult |
JobClient.submitJobAndWait(akka.actor.ActorSystem actorSystem,
Configuration config,
LeaderRetrievalService leaderRetrievalService,
JobGraph jobGraph,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates,
ClassLoader classLoader)
Sends a [[JobGraph]] to the JobClient actor specified by jobClient which submits it then to
the JobManager.
|
Constructor and Description |
---|
JobAttachmentClientActor(LeaderRetrievalService leaderRetrievalService,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutUpdates) |
JobClientActor(LeaderRetrievalService leaderRetrievalService,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutUpdates) |
JobSubmissionClientActor(LeaderRetrievalService leaderRetrievalService,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutUpdates,
Configuration clientConfig) |
Modifier and Type | Method and Description |
---|---|
static akka.actor.Props |
FlinkResourceManager.getResourceManagerProps(Class<? extends FlinkResourceManager> resourceManagerClass,
Configuration configuration,
LeaderRetrievalService leaderRetrievalService) |
static akka.actor.ActorRef |
FlinkResourceManager.startResourceManagerActors(Configuration configuration,
akka.actor.ActorSystem actorSystem,
LeaderRetrievalService leaderRetriever,
Class<? extends FlinkResourceManager<?>> resourceManagerClass)
Starts the resource manager actors.
|
static akka.actor.ActorRef |
FlinkResourceManager.startResourceManagerActors(Configuration configuration,
akka.actor.ActorSystem actorSystem,
LeaderRetrievalService leaderRetriever,
Class<? extends FlinkResourceManager<?>> resourceManagerClass,
String resourceManagerActorName)
Starts the resource manager actors.
|
Constructor and Description |
---|
FlinkResourceManager(int numInitialTaskManagers,
Configuration flinkConfig,
LeaderRetrievalService leaderRetriever)
Creates a AbstractFrameworkMaster actor.
|
Constructor and Description |
---|
StandaloneResourceManager(Configuration flinkConfig,
LeaderRetrievalService leaderRetriever) |
Modifier and Type | Class and Description |
---|---|
class |
StandaloneLeaderRetrievalService
Standalone implementation of the
LeaderRetrievalService . |
class |
ZooKeeperLeaderRetrievalService
The counterpart to the
ZooKeeperLeaderElectionService . |
Modifier and Type | Method and Description |
---|---|
protected LeaderRetrievalService |
FlinkMiniCluster.createLeaderRetrievalService() |
Modifier and Type | Method and Description |
---|---|
protected scala.Option<LeaderRetrievalService> |
FlinkMiniCluster.jobManagerLeaderRetrievalService() |
Modifier and Type | Method and Description |
---|---|
akka.actor.Props |
LocalFlinkMiniCluster.getResourceManagerProps(Class<? extends FlinkResourceManager<? extends ResourceIDRetrievable>> resourceManagerClass,
Configuration configuration,
LeaderRetrievalService leaderRetrievalService) |
akka.actor.Props |
LocalFlinkMiniCluster.getTaskManagerProps(Class<? extends TaskManager> taskManagerClass,
TaskManagerConfiguration taskManagerConfig,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
LeaderRetrievalService leaderRetrievalService,
MetricRegistry metricsRegistry) |
JobExecutionResult |
FlinkMiniCluster.submitJobAndWait(JobGraph jobGraph,
boolean printUpdates,
scala.concurrent.duration.FiniteDuration timeout,
LeaderRetrievalService leaderRetrievalService) |
Modifier and Type | Method and Description |
---|---|
protected LeaderRetrievalService |
TaskManager.leaderRetrievalService() |
Modifier and Type | Method and Description |
---|---|
scala.Tuple7<TaskManagerConfiguration,TaskManagerLocation,MemoryManager,IOManager,NetworkEnvironment,LeaderRetrievalService,MetricRegistry> |
TaskManager$.createTaskManagerComponents(Configuration configuration,
ResourceID resourceID,
String taskManagerHostname,
boolean localTaskManagerCommunication,
scala.Option<LeaderRetrievalService> leaderRetrievalServiceOption) |
static scala.Tuple7<TaskManagerConfiguration,TaskManagerLocation,MemoryManager,IOManager,NetworkEnvironment,LeaderRetrievalService,MetricRegistry> |
TaskManager.createTaskManagerComponents(Configuration configuration,
ResourceID resourceID,
String taskManagerHostname,
boolean localTaskManagerCommunication,
scala.Option<LeaderRetrievalService> leaderRetrievalServiceOption) |
Modifier and Type | Method and Description |
---|---|
akka.actor.Props |
TaskManager$.getTaskManagerProps(Class<? extends TaskManager> taskManagerClass,
TaskManagerConfiguration taskManagerConfig,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
LeaderRetrievalService leaderRetrievalService,
MetricRegistry metricsRegistry) |
static akka.actor.Props |
TaskManager.getTaskManagerProps(Class<? extends TaskManager> taskManagerClass,
TaskManagerConfiguration taskManagerConfig,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
LeaderRetrievalService leaderRetrievalService,
MetricRegistry metricsRegistry) |
Modifier and Type | Method and Description |
---|---|
scala.Tuple7<TaskManagerConfiguration,TaskManagerLocation,MemoryManager,IOManager,NetworkEnvironment,LeaderRetrievalService,MetricRegistry> |
TaskManager$.createTaskManagerComponents(Configuration configuration,
ResourceID resourceID,
String taskManagerHostname,
boolean localTaskManagerCommunication,
scala.Option<LeaderRetrievalService> leaderRetrievalServiceOption) |
static scala.Tuple7<TaskManagerConfiguration,TaskManagerLocation,MemoryManager,IOManager,NetworkEnvironment,LeaderRetrievalService,MetricRegistry> |
TaskManager.createTaskManagerComponents(Configuration configuration,
ResourceID resourceID,
String taskManagerHostname,
boolean localTaskManagerCommunication,
scala.Option<LeaderRetrievalService> leaderRetrievalServiceOption) |
akka.actor.ActorRef |
TaskManager$.startTaskManagerComponentsAndActor(Configuration configuration,
ResourceID resourceID,
akka.actor.ActorSystem actorSystem,
String taskManagerHostname,
scala.Option<String> taskManagerActorName,
scala.Option<LeaderRetrievalService> leaderRetrievalServiceOption,
boolean localTaskManagerCommunication,
Class<? extends TaskManager> taskManagerClass)
Starts the task manager actor.
|
static akka.actor.ActorRef |
TaskManager.startTaskManagerComponentsAndActor(Configuration configuration,
ResourceID resourceID,
akka.actor.ActorSystem actorSystem,
String taskManagerHostname,
scala.Option<String> taskManagerActorName,
scala.Option<LeaderRetrievalService> leaderRetrievalServiceOption,
boolean localTaskManagerCommunication,
Class<? extends TaskManager> taskManagerClass)
Starts the task manager actor.
|
Constructor and Description |
---|
TaskManager(TaskManagerConfiguration config,
ResourceID resourceID,
TaskManagerLocation location,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment network,
int numberOfSlots,
LeaderRetrievalService leaderRetrievalService,
MetricRegistry metricsRegistry) |
Modifier and Type | Method and Description |
---|---|
static LeaderRetrievalService |
LeaderRetrievalUtils.createLeaderRetrievalService(Configuration configuration)
Creates a
LeaderRetrievalService based on the provided Configuration object. |
static LeaderRetrievalService |
LeaderRetrievalUtils.createLeaderRetrievalService(Configuration configuration,
akka.actor.ActorRef standaloneRef)
Creates a
LeaderRetrievalService that either uses the distributed leader election
configured in the configuration, or, in standalone mode, the given actor reference. |
static LeaderRetrievalService |
LeaderRetrievalUtils.createLeaderRetrievalService(Configuration configuration,
boolean resolveInitialHostName)
Creates a
LeaderRetrievalService based on the provided Configuration object. |
Modifier and Type | Method and Description |
---|---|
static InetAddress |
LeaderRetrievalUtils.findConnectingAddress(LeaderRetrievalService leaderRetrievalService,
scala.concurrent.duration.FiniteDuration timeout) |
static LeaderConnectionInfo |
LeaderRetrievalUtils.retrieveLeaderConnectionInfo(LeaderRetrievalService leaderRetrievalService,
scala.concurrent.duration.FiniteDuration timeout)
Retrieves the leader akka url and the current leader session ID.
|
static ActorGateway |
LeaderRetrievalUtils.retrieveLeaderGateway(LeaderRetrievalService leaderRetrievalService,
akka.actor.ActorSystem actorSystem,
scala.concurrent.duration.FiniteDuration timeout)
Retrieves the current leader gateway using the given
LeaderRetrievalService . |
Modifier and Type | Method and Description |
---|---|
static WebMonitor |
WebMonitorUtils.startWebRuntimeMonitor(Configuration config,
LeaderRetrievalService leaderRetrievalService,
akka.actor.ActorSystem actorSystem)
Starts the web runtime monitor.
|
Constructor and Description |
---|
WebRuntimeMonitor(Configuration config,
LeaderRetrievalService leaderRetrievalService,
akka.actor.ActorSystem actorSystem) |
Modifier and Type | Method and Description |
---|---|
LeaderRetrievalService |
ApplicationClient.leaderRetrievalService() |
Modifier and Type | Method and Description |
---|---|
static akka.actor.Props |
YarnFlinkResourceManager.createActorProps(Class<? extends YarnFlinkResourceManager> actorClass,
Configuration flinkConfig,
org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfig,
LeaderRetrievalService leaderRetrievalService,
String applicationMasterHostName,
String webFrontendURL,
ContaineredTaskManagerParameters taskManagerParameters,
org.apache.hadoop.yarn.api.records.ContainerLaunchContext taskManagerLaunchContext,
int numInitialTaskManagers,
org.slf4j.Logger log)
Creates the props needed to instantiate this actor.
|
Constructor and Description |
---|
ApplicationClient(Configuration flinkConfig,
LeaderRetrievalService leaderRetrievalService) |
YarnFlinkResourceManager(Configuration flinkConfig,
org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfig,
LeaderRetrievalService leaderRetrievalService,
String applicationMasterHostName,
String webInterfaceURL,
ContaineredTaskManagerParameters taskManagerParameters,
org.apache.hadoop.yarn.api.records.ContainerLaunchContext taskManagerLaunchContext,
int yarnHeartbeatIntervalMillis,
int maxFailedContainers,
int numInitialTaskManagers) |
YarnFlinkResourceManager(Configuration flinkConfig,
org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfig,
LeaderRetrievalService leaderRetrievalService,
String applicationMasterHostName,
String webInterfaceURL,
ContaineredTaskManagerParameters taskManagerParameters,
org.apache.hadoop.yarn.api.records.ContainerLaunchContext taskManagerLaunchContext,
int yarnHeartbeatIntervalMillis,
int maxFailedContainers,
int numInitialTaskManagers,
YarnResourceManagerCallbackHandler callbackHandler) |
YarnFlinkResourceManager(Configuration flinkConfig,
org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfig,
LeaderRetrievalService leaderRetrievalService,
String applicationMasterHostName,
String webInterfaceURL,
ContaineredTaskManagerParameters taskManagerParameters,
org.apache.hadoop.yarn.api.records.ContainerLaunchContext taskManagerLaunchContext,
int yarnHeartbeatIntervalMillis,
int maxFailedContainers,
int numInitialTaskManagers,
YarnResourceManagerCallbackHandler callbackHandler,
org.apache.hadoop.yarn.client.api.async.AMRMClientAsync<org.apache.hadoop.yarn.client.api.AMRMClient.ContainerRequest> resourceManagerClient,
org.apache.hadoop.yarn.client.api.NMClient nodeManagerClient) |
YarnTaskManager(TaskManagerConfiguration config,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment network,
int numberOfSlots,
LeaderRetrievalService leaderRetrievalService,
MetricRegistry metricRegistry) |
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.