public class MiniCluster extends Object implements JobExecutorService, AutoCloseableAsync
Modifier and Type | Class and Description |
---|---|
protected static class |
MiniCluster.CommonRpcServiceFactory
Factory which returns always the common
RpcService . |
protected class |
MiniCluster.DedicatedRpcServiceFactory
Factory which creates and registers new
RpcService . |
protected static interface |
MiniCluster.RpcServiceFactory
Internal factory for
RpcService . |
Constructor and Description |
---|
MiniCluster(MiniClusterConfiguration miniClusterConfiguration)
Creates a new Flink mini cluster based on the given configuration.
|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
close
public MiniCluster(MiniClusterConfiguration miniClusterConfiguration)
miniClusterConfiguration
- The configuration for the mini clusterpublic CompletableFuture<URI> getRestAddress()
public ClusterInformation getClusterInformation()
protected Executor getIOExecutor()
public boolean isRunning()
public void start() throws Exception
Exception
- This method passes on any exception that occurs during the startup of the
mini cluster.@VisibleForTesting protected Collection<? extends DispatcherResourceManagerComponent> createDispatcherResourceManagerComponents(Configuration configuration, MiniCluster.RpcServiceFactory rpcServiceFactory, HighAvailabilityServices haServices, BlobServer blobServer, HeartbeatServices heartbeatServices, MetricRegistry metricRegistry, MetricQueryServiceRetriever metricQueryServiceRetriever, FatalErrorHandler fatalErrorHandler) throws Exception
Exception
@VisibleForTesting protected HighAvailabilityServices createHighAvailabilityServices(Configuration configuration, Executor executor) throws Exception
Exception
public CompletableFuture<Void> closeAsync()
start()
method again.
This method shuts down all started services and components, even if an exception occurs in the process of shutting down some component.
closeAsync
in interface AutoCloseableAsync
@VisibleForTesting protected boolean useLocalCommunication()
@VisibleForTesting @Nonnull protected CompletableFuture<Void> terminateTaskExecutor(int index)
public CompletableFuture<Collection<JobStatusMessage>> listJobs()
public CompletableFuture<JobStatus> getJobStatus(JobID jobId)
public CompletableFuture<Acknowledge> cancelJob(JobID jobId)
public CompletableFuture<String> triggerSavepoint(JobID jobId, String targetDirectory, boolean cancelJob)
public CompletableFuture<String> stopWithSavepoint(JobID jobId, String targetDirectory, boolean terminate)
public CompletableFuture<Acknowledge> disposeSavepoint(String savepointPath)
public CompletableFuture<? extends AccessExecutionGraph> getExecutionGraph(JobID jobId)
public CompletableFuture<CoordinationResponse> deliverCoordinationRequestToCoordinator(JobID jobId, OperatorID operatorId, SerializedValue<CoordinationRequest> serializedRequest)
public void runDetached(JobGraph job) throws JobExecutionException, InterruptedException
job
- The Flink job to executeJobExecutionException
- Thrown if anything went amiss during initial job launch, or if
the job terminally failed.InterruptedException
public JobExecutionResult executeJobBlocking(JobGraph job) throws JobExecutionException, InterruptedException
executeJobBlocking
in interface JobExecutor
job
- The Flink job to executeJobExecutionException
- Thrown if anything went amiss during initial job launch, or if
the job terminally failed.InterruptedException
public CompletableFuture<JobSubmissionResult> submitJob(JobGraph jobGraph)
public CompletableFuture<JobResult> requestJobResult(JobID jobId)
public CompletableFuture<ClusterOverview> requestClusterOverview()
@VisibleForTesting protected CompletableFuture<DispatcherGateway> getDispatcherGatewayFuture()
protected MetricRegistryImpl createMetricRegistry(Configuration config)
config
- The configuration of the mini clusterprotected RpcService createRemoteRpcService(Configuration configuration, String bindAddress, int bindPort) throws Exception
configuration
- Flink configuration.bindAddress
- The address to bind the RPC service to.bindPort
- The port range to bind the RPC service to.Exception
protected RpcService createRemoteRpcService(Configuration configuration, String externalAddress, String externalPortRange, String bindAddress) throws Exception
configuration
- Flink configuration.externalAddress
- The external address to access the RPC service.externalPortRange
- The external port range to access the RPC service.bindAddress
- The address to bind the RPC service to.Exception
protected RpcService createLocalRpcService(Configuration configuration) throws Exception
configuration
- Flink configuration.Exception
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.