org.apache.flink.runtime.taskmanager

Class NettyShuffleEnvironmentConfiguration

java.lang.Object

org.apache.flink.runtime.taskmanager.NettyShuffleEnvironmentConfiguration

public class NettyShuffleEnvironmentConfiguration
extends Object

Configuration object for the network stack.

Constructor Summary

Constructors

Constructor and Description

NettyShuffleEnvironmentConfiguration(int numNetworkBuffers, int networkBufferSize, int partitionRequestInitialBackoff, int partitionRequestMaxBackoff, int networkBuffersPerChannel, int floatingNetworkBuffersPerGate, java.time.Duration requestSegmentsTimeout, boolean isNetworkDetailedMetrics, NettyConfig nettyConfig, String[] tempDirs, BoundedBlockingSubpartitionType blockingSubpartitionType, boolean forcePartitionReleaseOnConsumption, boolean blockingShuffleCompressionEnabled, String compressionCodec)

Method Summary

Modifier and Type	Method and Description
boolean	equals(Object obj)
int	floatingNetworkBuffersPerGate()
static NettyShuffleEnvironmentConfiguration	fromConfiguration(Configuration configuration, MemorySize networkMemorySize, boolean localTaskManagerCommunication, InetAddress taskManagerAddress) Utility method to extract network related parameters from the configuration and to sanity check them.
BoundedBlockingSubpartitionType	getBlockingSubpartitionType()
String	getCompressionCodec()
java.time.Duration	getRequestSegmentsTimeout()
String[]	getTempDirs()
int	hashCode()
boolean	isBlockingShuffleCompressionEnabled()
boolean	isForcePartitionReleaseOnConsumption()
boolean	isNetworkDetailedMetrics()
NettyConfig	nettyConfig()
int	networkBufferSize()
int	networkBuffersPerChannel()
int	numNetworkBuffers()
int	partitionRequestInitialBackoff()
int	partitionRequestMaxBackoff()
String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

NettyShuffleEnvironmentConfiguration

public NettyShuffleEnvironmentConfiguration(int numNetworkBuffers,
                                            int networkBufferSize,
                                            int partitionRequestInitialBackoff,
                                            int partitionRequestMaxBackoff,
                                            int networkBuffersPerChannel,
                                            int floatingNetworkBuffersPerGate,
                                            java.time.Duration requestSegmentsTimeout,
                                            boolean isNetworkDetailedMetrics,
                                            @Nullable
                                            NettyConfig nettyConfig,
                                            String[] tempDirs,
                                            BoundedBlockingSubpartitionType blockingSubpartitionType,
                                            boolean forcePartitionReleaseOnConsumption,
                                            boolean blockingShuffleCompressionEnabled,
                                            String compressionCodec)

Method Detail

numNetworkBuffers

public int numNetworkBuffers()

networkBufferSize

public int networkBufferSize()

partitionRequestInitialBackoff

public int partitionRequestInitialBackoff()

partitionRequestMaxBackoff

public int partitionRequestMaxBackoff()

networkBuffersPerChannel

public int networkBuffersPerChannel()

floatingNetworkBuffersPerGate

public int floatingNetworkBuffersPerGate()

getRequestSegmentsTimeout

public java.time.Duration getRequestSegmentsTimeout()

nettyConfig

public NettyConfig nettyConfig()

isNetworkDetailedMetrics

public boolean isNetworkDetailedMetrics()

getTempDirs

public String[] getTempDirs()

getBlockingSubpartitionType

public BoundedBlockingSubpartitionType getBlockingSubpartitionType()

isForcePartitionReleaseOnConsumption

public boolean isForcePartitionReleaseOnConsumption()

isBlockingShuffleCompressionEnabled

public boolean isBlockingShuffleCompressionEnabled()

getCompressionCodec

public String getCompressionCodec()

fromConfiguration

public static NettyShuffleEnvironmentConfiguration fromConfiguration(Configuration configuration,
                                                                     MemorySize networkMemorySize,
                                                                     boolean localTaskManagerCommunication,
                                                                     InetAddress taskManagerAddress)

Utility method to extract network related parameters from the configuration and to sanity check them.

Parameters:

configuration - configuration object

networkMemorySize - the size of memory reserved for shuffle environment

localTaskManagerCommunication - true, to skip initializing the network stack

taskManagerAddress - identifying the IP address under which the TaskManager will be accessible

Returns:

NettyShuffleEnvironmentConfiguration

hashCode

public int hashCode()

Overrides:

hashCode in class Object

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

toString

public String toString()

Overrides:

toString in class Object