public interface VertexParallelismAndInputInfosDecider
VertexParallelismAndInputInfosDecider
is responsible for deciding the parallelism and
JobVertexInputInfo
s of a job vertex, based on the information of the consumed blocking
results.Modifier and Type | Method and Description |
---|---|
int |
computeSourceParallelismUpperBound(JobVertexID jobVertexId,
int maxParallelism)
Compute source parallelism upper bound for the source vertex.
|
ParallelismAndInputInfos |
decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId,
List<BlockingResultInfo> consumedResults,
int vertexInitialParallelism,
int vertexMinParallelism,
int vertexMaxParallelism)
Decide the parallelism and
JobVertexInputInfo s for this job vertex. |
long |
getDataVolumePerTask()
Get the average size of data volume to expect each task instance to process.
|
ParallelismAndInputInfos decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId, List<BlockingResultInfo> consumedResults, int vertexInitialParallelism, int vertexMinParallelism, int vertexMaxParallelism)
JobVertexInputInfo
s for this job vertex.jobVertexId
- The job vertex idconsumedResults
- The information of consumed blocking resultsvertexInitialParallelism
- The initial parallelism of the job vertex. If it's a positive
number, it will be respected. If it's not set(equals to ExecutionConfig.PARALLELISM_DEFAULT
), a parallelism will be automatically decided for
the vertex.vertexMinParallelism
- The min parallelism of the job vertex.vertexMaxParallelism
- The max parallelism of the job vertex.int computeSourceParallelismUpperBound(JobVertexID jobVertexId, int maxParallelism)
jobVertexId
- The job vertex idmaxParallelism
- The max parallelism of the job vertex.long getDataVolumePerTask()
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.