Interface | Description |
---|---|
JobShuffleContext |
Job level shuffle context which can offer some job information like job ID and through it, the
shuffle plugin notify the job to stop tracking the lost result partitions.
|
NettyShuffleDescriptor.PartitionConnectionInfo |
Information for connection to partition producer for shuffle exchange.
|
ShuffleDescriptor |
Interface for shuffle deployment descriptor of result partition resource.
|
ShuffleEnvironment<P extends ResultPartitionWriter,G extends IndexedInputGate> |
Interface for the implementation of shuffle service local environment.
|
ShuffleMaster<T extends ShuffleDescriptor> |
Intermediate result partition registry to use in
JobMaster . |
ShuffleMasterContext |
Shuffle context used to create
ShuffleMaster . |
ShuffleServiceFactory<SD extends ShuffleDescriptor,P extends ResultPartitionWriter,G extends IndexedInputGate> |
Interface for shuffle service factory implementations.
|
Class | Description |
---|---|
JobShuffleContextImpl |
The default implementation of
JobShuffleContext . |
NettyShuffleDescriptor |
Default implementation of
ShuffleDescriptor for NettyShuffleMaster . |
NettyShuffleDescriptor.NetworkPartitionConnectionInfo |
Remote partition connection information with index to query partition.
|
NettyShuffleMaster |
Default
ShuffleMaster for netty and local file based shuffle implementation. |
NettyShuffleUtils |
Utils to calculate network memory requirement of a vertex from network configuration and details
of input and output.
|
PartitionDescriptor |
Partition descriptor for
ShuffleMaster to obtain ShuffleDescriptor . |
ProducerDescriptor |
Partition producer descriptor for
ShuffleMaster to obtain ShuffleDescriptor . |
ShuffleEnvironmentContext |
Local context used to create
ShuffleEnvironment . |
ShuffleIOOwnerContext |
Context of shuffle input/output owner used to create partitions or gates belonging to the owner.
|
ShuffleMasterContextImpl |
The default implementation of
ShuffleMasterContext . |
ShuffleServiceOptions |
Options to configure shuffle service.
|
ShuffleUtils |
Common utility methods for shuffle service.
|
TaskInputsOutputsDescriptor |
Describes inputs and outputs information of a task.
|
UnknownShuffleDescriptor |
Unknown
ShuffleDescriptor for which the producer has not been deployed yet. |
Enum | Description |
---|---|
NettyShuffleDescriptor.LocalExecutionPartitionConnectionInfo |
Local partition connection information.
|
ShuffleServiceLoader |
Utility to load the pluggable
ShuffleServiceFactory implementations. |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.