@Internal public class EmbeddedExecutorServiceLoader extends Object implements PipelineExecutorServiceLoader
PipelineExecutorServiceLoader
that always returns an EmbeddedExecutorFactory
.
This is useful when running the user's main on the cluster.Constructor and Description |
---|
EmbeddedExecutorServiceLoader(Collection<JobID> submittedJobIds,
DispatcherGateway dispatcherGateway,
ScheduledExecutor retryExecutor)
Creates an
EmbeddedExecutorServiceLoader . |
Modifier and Type | Method and Description |
---|---|
PipelineExecutorFactory |
getExecutorFactory(Configuration configuration)
Loads the
PipelineExecutorFactory which is compatible with the provided
configuration. |
Stream<String> |
getExecutorNames()
Loads and returns a stream of the names of all available executors.
|
public EmbeddedExecutorServiceLoader(Collection<JobID> submittedJobIds, DispatcherGateway dispatcherGateway, ScheduledExecutor retryExecutor)
EmbeddedExecutorServiceLoader
.submittedJobIds
- a list that is going to be filled by the EmbeddedExecutor
with
the job ids of the new jobs that will be submitted. This is essentially used to return
the submitted job ids to the caller.dispatcherGateway
- the dispatcher of the cluster which is going to be used to submit
jobs.public PipelineExecutorFactory getExecutorFactory(Configuration configuration)
PipelineExecutorServiceLoader
PipelineExecutorFactory
which is compatible with the provided
configuration. There can be at most one compatible factory among the available ones,
otherwise an exception will be thrown.getExecutorFactory
in interface PipelineExecutorServiceLoader
PipelineExecutorFactory
.public Stream<String> getExecutorNames()
PipelineExecutorServiceLoader
getExecutorNames
in interface PipelineExecutorServiceLoader
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.