Modifier and Type | Field and Description |
---|---|
protected HighAvailabilityServices |
ClusterClient.highAvailabilityServices
Service factory for high available
|
Constructor and Description |
---|
ClusterClient(Configuration flinkConfig,
HighAvailabilityServices highAvailabilityServices)
Creates a instance that submits the programs to the JobManager defined in the
configuration.
|
StandaloneClusterClient(Configuration config,
HighAvailabilityServices highAvailabilityServices) |
Modifier and Type | Method and Description |
---|---|
protected static HighAvailabilityServices |
MesosTaskManager.highAvailabilityServices() |
Constructor and Description |
---|
MesosTaskManager(TaskManagerConfiguration config,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment network,
int numberOfSlots,
HighAvailabilityServices highAvailabilityServices,
MetricRegistry metricRegistry) |
Modifier and Type | Method and Description |
---|---|
static JobListeningContext |
JobClient.attachToRunningJob(JobID jobID,
ActorGateway jobManagerGateWay,
Configuration configuration,
akka.actor.ActorSystem actorSystem,
HighAvailabilityServices highAvailabilityServices,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates)
Attaches to a running Job using the JobID.
|
static ClassLoader |
JobClient.retrieveClassLoader(JobID jobID,
ActorGateway jobManager,
Configuration config,
HighAvailabilityServices highAvailabilityServices)
Reconstructs the class loader by first requesting information about it at the JobManager
and then downloading missing jar files.
|
static JobListeningContext |
JobClient.submitJob(akka.actor.ActorSystem actorSystem,
Configuration config,
HighAvailabilityServices highAvailabilityServices,
JobGraph jobGraph,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates,
ClassLoader classLoader)
Submits a job to a Flink cluster (non-blocking) and returns a JobListeningContext which can be
passed to
awaitJobResult to get the result of the submission. |
static JobExecutionResult |
JobClient.submitJobAndWait(akka.actor.ActorSystem actorSystem,
Configuration config,
HighAvailabilityServices highAvailabilityServices,
JobGraph jobGraph,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates,
ClassLoader classLoader)
Sends a [[JobGraph]] to the JobClient actor specified by jobClient which submits it then to
the JobManager.
|
Constructor and Description |
---|
JobListeningContext(JobID jobID,
scala.concurrent.Future<Object> jobResultFuture,
akka.actor.ActorRef jobClientActor,
scala.concurrent.duration.FiniteDuration timeout,
akka.actor.ActorSystem actorSystem,
Configuration configuration,
HighAvailabilityServices highAvailabilityServices)
Constructor to use when the class loader is not available.
|
JobListeningContext(JobID jobID,
scala.concurrent.Future<Object> jobResultFuture,
akka.actor.ActorRef jobClientActor,
scala.concurrent.duration.FiniteDuration timeout,
ClassLoader classLoader,
HighAvailabilityServices highAvailabilityServices)
Constructor to use when the class loader is available.
|
Modifier and Type | Method and Description |
---|---|
static WebMonitor |
BootstrapTools.startWebMonitorIfConfigured(Configuration config,
HighAvailabilityServices highAvailabilityServices,
akka.actor.ActorSystem actorSystem,
akka.actor.ActorRef jobManager,
org.slf4j.Logger logger)
Starts the web frontend.
|
Modifier and Type | Method and Description |
---|---|
static HighAvailabilityServices |
HighAvailabilityServicesUtils.createAvailableOrEmbeddedServices(Configuration config,
Executor executor) |
static HighAvailabilityServices |
HighAvailabilityServicesUtils.createHighAvailabilityServices(Configuration configuration,
Executor executor,
HighAvailabilityServicesUtils.AddressResolution addressResolution) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractNonHaServices
Abstract base class for non high-availability services.
|
Modifier and Type | Class and Description |
---|---|
class |
EmbeddedHaServices
An implementation of the
HighAvailabilityServices for the non-high-availability case
where all participants (ResourceManager, JobManagers, TaskManagers) run in the same process. |
Modifier and Type | Class and Description |
---|---|
class |
StandaloneHaServices
An implementation of the
HighAvailabilityServices for the non-high-availability case. |
Modifier and Type | Class and Description |
---|---|
class |
ZooKeeperHaServices
An implementation of the
HighAvailabilityServices using Apache ZooKeeper. |
Modifier and Type | Method and Description |
---|---|
static scala.Tuple4<akka.actor.ActorRef,akka.actor.ActorRef,scala.Option<WebMonitor>,scala.Option<akka.actor.ActorRef>> |
JobManager.startJobManagerActors(akka.actor.ActorSystem jobManagerSystem,
Configuration configuration,
JobManagerMode executionMode,
String externalHostname,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass,
scala.Option<Class<? extends FlinkResourceManager<?>>> resourceManagerClass)
Starts the JobManager and all its components including the WebMonitor.
|
scala.Tuple4<akka.actor.ActorRef,akka.actor.ActorRef,scala.Option<WebMonitor>,scala.Option<akka.actor.ActorRef>> |
JobManager$.startJobManagerActors(akka.actor.ActorSystem jobManagerSystem,
Configuration configuration,
JobManagerMode executionMode,
String externalHostname,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass,
scala.Option<Class<? extends FlinkResourceManager<?>>> resourceManagerClass)
Starts the JobManager and all its components including the WebMonitor.
|
static scala.Tuple2<akka.actor.ActorRef,akka.actor.ActorRef> |
JobManager.startJobManagerActors(Configuration configuration,
akka.actor.ActorSystem actorSystem,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass)
Starts the JobManager and job archiver based on the given configuration, in
the given actor system.
|
scala.Tuple2<akka.actor.ActorRef,akka.actor.ActorRef> |
JobManager$.startJobManagerActors(Configuration configuration,
akka.actor.ActorSystem actorSystem,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass)
Starts the JobManager and job archiver based on the given configuration, in
the given actor system.
|
static scala.Tuple2<akka.actor.ActorRef,akka.actor.ActorRef> |
JobManager.startJobManagerActors(Configuration configuration,
akka.actor.ActorSystem actorSystem,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
scala.Option<String> jobManagerActorName,
scala.Option<String> archiveActorName,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass)
Starts the JobManager and job archiver based on the given configuration, in the
given actor system.
|
scala.Tuple2<akka.actor.ActorRef,akka.actor.ActorRef> |
JobManager$.startJobManagerActors(Configuration configuration,
akka.actor.ActorSystem actorSystem,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
scala.Option<String> jobManagerActorName,
scala.Option<String> archiveActorName,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass)
Starts the JobManager and job archiver based on the given configuration, in the
given actor system.
|
Modifier and Type | Method and Description |
---|---|
static JobManagerServices |
JobManagerServices.fromConfiguration(Configuration config,
HighAvailabilityServices haServices) |
Constructor and Description |
---|
JobManagerRunner(ResourceID resourceId,
JobGraph jobGraph,
Configuration configuration,
RpcService rpcService,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
JobManagerServices jobManagerServices,
MetricRegistry metricRegistry,
OnCompletionActions toNotifyOnComplete,
FatalErrorHandler errorHandler)
Exceptions that occur while creating the JobManager or JobManagerRunner are directly
thrown and not reported to the given
FatalErrorHandler . |
JobManagerRunner(ResourceID resourceId,
JobGraph jobGraph,
Configuration configuration,
RpcService rpcService,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
OnCompletionActions toNotifyOnComplete,
FatalErrorHandler errorHandler) |
JobManagerRunner(ResourceID resourceId,
JobGraph jobGraph,
Configuration configuration,
RpcService rpcService,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
OnCompletionActions toNotifyOnComplete,
FatalErrorHandler errorHandler) |
JobMaster(RpcService rpcService,
ResourceID resourceId,
JobGraph jobGraph,
Configuration configuration,
HighAvailabilityServices highAvailabilityService,
HeartbeatServices heartbeatServices,
ScheduledExecutorService executor,
BlobLibraryCacheManager libraryCacheManager,
RestartStrategyFactory restartStrategyFactory,
Time rpcAskTimeout,
JobManagerMetricGroup jobManagerMetricGroup,
OnCompletionActions jobCompletionActions,
FatalErrorHandler errorHandler,
ClassLoader userCodeLoader) |
Modifier and Type | Method and Description |
---|---|
HighAvailabilityServices |
FlinkMiniCluster.highAvailabilityServices() |
Modifier and Type | Method and Description |
---|---|
protected ResourceManagerRunner[] |
MiniCluster.startResourceManagers(Configuration configuration,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
int numResourceManagers,
RpcService[] resourceManagerRpcServices) |
protected TaskManagerRunner[] |
MiniCluster.startTaskManagers(Configuration configuration,
HighAvailabilityServices haServices,
MetricRegistry metricRegistry,
int numTaskManagers,
RpcService[] taskManagerRpcServices) |
Constructor and Description |
---|
FlinkMiniCluster(Configuration userConfiguration,
HighAvailabilityServices highAvailabilityServices,
boolean useSingleActorSystem) |
LocalFlinkMiniCluster(Configuration userConfiguration,
HighAvailabilityServices highAvailabilityServices,
boolean singleActorSystem) |
MiniClusterJobDispatcher(Configuration config,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
int numJobManagers,
RpcService[] rpcServices)
Starts a mini cluster job dispatcher.
|
MiniClusterJobDispatcher(Configuration config,
RpcService rpcService,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry)
Starts a mini cluster job dispatcher.
|
Constructor and Description |
---|
QueryableStateClient(Configuration config,
HighAvailabilityServices highAvailabilityServices)
Creates a client from the given configuration.
|
Modifier and Type | Method and Description |
---|---|
static ResourceManagerRuntimeServices |
ResourceManagerRuntimeServices.fromConfiguration(ResourceManagerRuntimeServicesConfiguration configuration,
HighAvailabilityServices highAvailabilityServices,
ScheduledExecutor scheduledExecutor) |
Constructor and Description |
---|
JobLeaderIdService(HighAvailabilityServices highAvailabilityServices,
ScheduledExecutor scheduledExecutor,
Time jobTimeout) |
ResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
ResourceManagerConfiguration resourceManagerConfiguration,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
FatalErrorHandler fatalErrorHandler) |
ResourceManagerRunner(ResourceID resourceId,
String resourceManagerEndpointId,
Configuration configuration,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry) |
StandaloneResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
ResourceManagerConfiguration resourceManagerConfiguration,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
FatalErrorHandler fatalErrorHandler) |
Modifier and Type | Method and Description |
---|---|
static RpcService |
TaskManagerRunner.createRpcService(Configuration configuration,
HighAvailabilityServices haServices)
Create a RPC service for the task manager.
|
void |
JobLeaderService.start(String initialOwnerAddress,
RpcService initialRpcService,
HighAvailabilityServices initialHighAvailabilityServices,
JobLeaderListener initialJobLeaderListener)
Start the job leader service with the given services.
|
Constructor and Description |
---|
TaskExecutor(RpcService rpcService,
TaskManagerConfiguration taskManagerConfiguration,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
TaskManagerMetricGroup taskManagerMetricGroup,
BroadcastVariableManager broadcastVariableManager,
FileCache fileCache,
TaskSlotTable taskSlotTable,
JobManagerTable jobManagerTable,
JobLeaderService jobLeaderService,
FatalErrorHandler fatalErrorHandler) |
TaskManagerRunner(Configuration configuration,
ResourceID resourceID,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry) |
TaskManagerRunner(Configuration configuration,
ResourceID resourceID,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
boolean localCommunicationOnly) |
Modifier and Type | Method and Description |
---|---|
protected HighAvailabilityServices |
TaskManager.highAvailabilityServices() |
Modifier and Type | Method and Description |
---|---|
akka.actor.Props |
TaskManager$.getTaskManagerProps(Class<? extends TaskManager> taskManagerClass,
TaskManagerConfiguration taskManagerConfig,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
HighAvailabilityServices highAvailabilityServices,
MetricRegistry metricsRegistry) |
static akka.actor.Props |
TaskManager.getTaskManagerProps(Class<? extends TaskManager> taskManagerClass,
TaskManagerConfiguration taskManagerConfig,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
HighAvailabilityServices highAvailabilityServices,
MetricRegistry metricsRegistry) |
void |
TaskManager$.runTaskManager(String taskManagerHostname,
ResourceID resourceID,
int actorSystemPort,
Configuration configuration,
HighAvailabilityServices highAvailabilityServices)
Starts and runs the TaskManager.
|
static void |
TaskManager.runTaskManager(String taskManagerHostname,
ResourceID resourceID,
int actorSystemPort,
Configuration configuration,
HighAvailabilityServices highAvailabilityServices)
Starts and runs the TaskManager.
|
void |
TaskManager$.runTaskManager(String taskManagerHostname,
ResourceID resourceID,
int actorSystemPort,
Configuration configuration,
HighAvailabilityServices highAvailabilityServices,
Class<? extends TaskManager> taskManagerClass)
Starts and runs the TaskManager.
|
static void |
TaskManager.runTaskManager(String taskManagerHostname,
ResourceID resourceID,
int actorSystemPort,
Configuration configuration,
HighAvailabilityServices highAvailabilityServices,
Class<? extends TaskManager> taskManagerClass)
Starts and runs the TaskManager.
|
scala.Tuple2<String,Object> |
TaskManager$.selectNetworkInterfaceAndPort(Configuration configuration,
HighAvailabilityServices highAvailabilityServices) |
static scala.Tuple2<String,Object> |
TaskManager.selectNetworkInterfaceAndPort(Configuration configuration,
HighAvailabilityServices highAvailabilityServices) |
akka.actor.ActorRef |
TaskManager$.startTaskManagerComponentsAndActor(Configuration configuration,
ResourceID resourceID,
akka.actor.ActorSystem actorSystem,
HighAvailabilityServices highAvailabilityServices,
String taskManagerHostname,
scala.Option<String> taskManagerActorName,
boolean localTaskManagerCommunication,
Class<? extends TaskManager> taskManagerClass)
Starts the task manager actor.
|
static akka.actor.ActorRef |
TaskManager.startTaskManagerComponentsAndActor(Configuration configuration,
ResourceID resourceID,
akka.actor.ActorSystem actorSystem,
HighAvailabilityServices highAvailabilityServices,
String taskManagerHostname,
scala.Option<String> taskManagerActorName,
boolean localTaskManagerCommunication,
Class<? extends TaskManager> taskManagerClass)
Starts the task manager actor.
|
Constructor and Description |
---|
TaskManager(TaskManagerConfiguration config,
ResourceID resourceID,
TaskManagerLocation location,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment network,
int numberOfSlots,
HighAvailabilityServices highAvailabilityServices,
MetricRegistry metricsRegistry) |
Modifier and Type | Method and Description |
---|---|
static WebMonitor |
WebMonitorUtils.startWebRuntimeMonitor(Configuration config,
HighAvailabilityServices highAvailabilityServices,
akka.actor.ActorSystem actorSystem)
Starts the web runtime monitor.
|
Modifier and Type | Method and Description |
---|---|
protected static HighAvailabilityServices |
YarnTaskManager.highAvailabilityServices() |
Constructor and Description |
---|
YarnResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
Configuration flinkConfig,
Map<String,String> env,
ResourceManagerConfiguration resourceManagerConfiguration,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
FatalErrorHandler fatalErrorHandler) |
YarnTaskManager(TaskManagerConfiguration config,
ResourceID resourceID,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment network,
int numberOfSlots,
HighAvailabilityServices highAvailabilityServices,
MetricRegistry metricRegistry) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractYarnNonHaServices
Abstract base class for the high availability services for Flink YARN applications that support
no master fail over.
|
class |
YarnHighAvailabilityServices
The basis of
HighAvailabilityServices for YARN setups. |
class |
YarnIntraNonHaMasterServices
These YarnHighAvailabilityServices are for the Application Master in setups where there is one
ResourceManager that is statically configured in the Flink configuration.
|
class |
YarnPreConfiguredMasterNonHaServices
These YarnHighAvailabilityServices are for use by the TaskManager in setups,
where there is one ResourceManager that is statically configured in the Flink configuration.
|
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.