@Internal public class EmbeddedExecutor extends Object implements PipelineExecutor
executorsthat invoke directly methods of the
Dispatcherand do not go through the REST API.
|Constructor and Description|
|Modifier and Type||Method and Description|
public static final String NAME
public EmbeddedExecutor(Collection<JobID> submittedJobIds, DispatcherGateway dispatcherGateway, EmbeddedJobClientCreator jobClientCreator)
submittedJobIds- a list that is going to be filled with the job ids of the new jobs that will be submitted. This is essentially used to return the submitted job ids to the caller.
dispatcherGateway- the dispatcher of the cluster which is going to be used to submit jobs.
public CompletableFuture<JobClient> execute(Pipeline pipeline, Configuration configuration, ClassLoader userCodeClassloader) throws MalformedURLException
Pipelinebased on the provided configuration and returns a
JobClientwhich allows to interact with the job being executed, e.g. cancel it or take a savepoint.
ATTENTION: The caller is responsible for managing the lifecycle of the returned
JobClient. This means that e.g.
close() should be called explicitly at the
Configurationwith the required execution parameters
ClassLoaderto deserialize usercode
JobClientcorresponding to the pipeline.
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.