Uses of Class
org.apache.flink.runtime.io.disk.iomanager.IOManager

Packages that use IOManager

Package	Description
org.apache.flink.runtime.execution
org.apache.flink.runtime.io.disk
org.apache.flink.runtime.io.disk.iomanager
org.apache.flink.runtime.iterative.io
org.apache.flink.runtime.operators
org.apache.flink.runtime.operators.hash
org.apache.flink.runtime.operators.resettable
org.apache.flink.runtime.operators.sort
org.apache.flink.runtime.taskexecutor
org.apache.flink.runtime.taskmanager
org.apache.flink.state.api.runtime
org.apache.flink.streaming.api.operators.sort
org.apache.flink.streaming.runtime.io
org.apache.flink.streaming.runtime.io.recovery
org.apache.flink.table.runtime.hashtable
org.apache.flink.table.runtime.io
org.apache.flink.table.runtime.operators.sort
org.apache.flink.table.runtime.util

Uses of IOManager in org.apache.flink.runtime.execution

Methods in org.apache.flink.runtime.execution that return IOManager

Modifier and Type	Method and Description
IOManager	Environment.getIOManager() Returns the current IOManager.

Uses of IOManager in org.apache.flink.runtime.io.disk

Constructors in org.apache.flink.runtime.io.disk with parameters of type IOManager

Constructor and Description
ChannelReaderInputViewIterator(IOManager ioAccess, FileIOChannel.ID channel, LinkedBlockingQueue<MemorySegment> returnQueue, List<MemorySegment> segments, List<MemorySegment> freeMemTarget, TypeSerializer<E> accessors, int numBlocks)
ChannelReaderInputViewIterator(IOManager ioAccess, FileIOChannel.ID channel, List<MemorySegment> segments, List<MemorySegment> freeMemTarget, TypeSerializer<E> accessors, int numBlocks)
SeekableFileChannelInputView(IOManager ioManager, FileIOChannel.ID channelId, MemoryManager memManager, List<MemorySegment> memory, int sizeOfLastBlock)
SpillingBuffer(IOManager ioManager, MemorySegmentSource memSource, int segmentSize)

Uses of IOManager in org.apache.flink.runtime.io.disk.iomanager

Subclasses of IOManager in org.apache.flink.runtime.io.disk.iomanager

Modifier and Type	Class and Description
class	IOManagerAsync A version of the IOManager that uses asynchronous I/O.

Uses of IOManager in org.apache.flink.runtime.iterative.io

Constructors in org.apache.flink.runtime.iterative.io with parameters of type IOManager

Constructor and Description
SerializedUpdateBuffer(List<MemorySegment> memSegments, int segmentSize, IOManager ioManager)

Uses of IOManager in org.apache.flink.runtime.operators

Methods in org.apache.flink.runtime.operators that return IOManager

Modifier and Type	Method and Description
IOManager	BatchTask.getIOManager()
IOManager	TaskContext.getIOManager()

Methods in org.apache.flink.runtime.operators with parameters of type IOManager

Modifier and Type	Method and Description
protected JoinTaskIterator<IT1,IT2,OT>	LeftOuterJoinDriver.getNonReusingOuterJoinIterator(DriverStrategy driverStrategy, MutableObjectIterator<IT1> in1, MutableObjectIterator<IT2> in2, TypeSerializer<IT1> serializer1, TypeComparator<IT1> comparator1, TypeSerializer<IT2> serializer2, TypeComparator<IT2> comparator2, TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
protected JoinTaskIterator<IT1,IT2,OT>	RightOuterJoinDriver.getNonReusingOuterJoinIterator(DriverStrategy driverStrategy, MutableObjectIterator<IT1> in1, MutableObjectIterator<IT2> in2, TypeSerializer<IT1> serializer1, TypeComparator<IT1> comparator1, TypeSerializer<IT2> serializer2, TypeComparator<IT2> comparator2, TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
protected JoinTaskIterator<IT1,IT2,OT>	FullOuterJoinDriver.getNonReusingOuterJoinIterator(DriverStrategy driverStrategy, MutableObjectIterator<IT1> in1, MutableObjectIterator<IT2> in2, TypeSerializer<IT1> serializer1, TypeComparator<IT1> comparator1, TypeSerializer<IT2> serializer2, TypeComparator<IT2> comparator2, TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
protected abstract JoinTaskIterator<IT1,IT2,OT>	AbstractOuterJoinDriver.getNonReusingOuterJoinIterator(DriverStrategy driverStrategy, MutableObjectIterator<IT1> in1, MutableObjectIterator<IT2> in2, TypeSerializer<IT1> serializer1, TypeComparator<IT1> comparator1, TypeSerializer<IT2> serializer2, TypeComparator<IT2> comparator2, TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
protected JoinTaskIterator<IT1,IT2,OT>	LeftOuterJoinDriver.getReusingOuterJoinIterator(DriverStrategy driverStrategy, MutableObjectIterator<IT1> in1, MutableObjectIterator<IT2> in2, TypeSerializer<IT1> serializer1, TypeComparator<IT1> comparator1, TypeSerializer<IT2> serializer2, TypeComparator<IT2> comparator2, TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
protected JoinTaskIterator<IT1,IT2,OT>	RightOuterJoinDriver.getReusingOuterJoinIterator(DriverStrategy driverStrategy, MutableObjectIterator<IT1> in1, MutableObjectIterator<IT2> in2, TypeSerializer<IT1> serializer1, TypeComparator<IT1> comparator1, TypeSerializer<IT2> serializer2, TypeComparator<IT2> comparator2, TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
protected JoinTaskIterator<IT1,IT2,OT>	FullOuterJoinDriver.getReusingOuterJoinIterator(DriverStrategy driverStrategy, MutableObjectIterator<IT1> in1, MutableObjectIterator<IT2> in2, TypeSerializer<IT1> serializer1, TypeComparator<IT1> comparator1, TypeSerializer<IT2> serializer2, TypeComparator<IT2> comparator2, TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
protected abstract JoinTaskIterator<IT1,IT2,OT>	AbstractOuterJoinDriver.getReusingOuterJoinIterator(DriverStrategy driverStrategy, MutableObjectIterator<IT1> in1, MutableObjectIterator<IT2> in2, TypeSerializer<IT1> serializer1, TypeComparator<IT1> comparator1, TypeSerializer<IT2> serializer2, TypeComparator<IT2> comparator2, TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)

Constructors in org.apache.flink.runtime.operators with parameters of type IOManager

Constructor and Description
TempBarrier(AbstractInvokable owner, MutableObjectIterator<T> input, TypeSerializerFactory<T> serializerFactory, MemoryManager memManager, IOManager ioManager, int numPages, List<MemorySegment> preAllocated)

Uses of IOManager in org.apache.flink.runtime.operators.hash

Fields in org.apache.flink.runtime.operators.hash declared as IOManager

Modifier and Type	Field and Description
protected IOManager	MutableHashTable.ioManager The I/O manager used to instantiate writers for the spilled partitions.

Methods in org.apache.flink.runtime.operators.hash with parameters of type IOManager

Modifier and Type	Method and Description
void	HashPartition.finalizeBuildPhase(IOManager ioAccess, FileIOChannel.Enumerator probeChannelEnumerator, LinkedBlockingQueue<MemorySegment> bufferReturnQueue)
<BT,PT> MutableHashTable<BT,PT>	ReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer, TypeComparator<BT> buildSideComparator, TypeSerializer<PT> probeSideSerializer, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean useBitmapFilters)
<BT,PT> MutableHashTable<BT,PT>	NonReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer, TypeComparator<BT> buildSideComparator, TypeSerializer<PT> probeSideSerializer, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean useBitmapFilters)
<BT,PT> MutableHashTable<BT,PT>	ReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer, TypeComparator<BT> buildSideComparator, TypeSerializer<PT> probeSideSerializer, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean useBitmapFilters)
<BT,PT> MutableHashTable<BT,PT>	HashJoinIteratorBase.getHashJoin(TypeSerializer<BT> buildSideSerializer, TypeComparator<BT> buildSideComparator, TypeSerializer<PT> probeSideSerializer, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean useBloomFilters)
<BT,PT> MutableHashTable<BT,PT>	NonReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer, TypeComparator<BT> buildSideComparator, TypeSerializer<PT> probeSideSerializer, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean useBitmapFilters)
void	HashPartition.prepareProbePhase(IOManager ioAccess, FileIOChannel.Enumerator probeChannelEnumerator, LinkedBlockingQueue<MemorySegment> bufferReturnQueue)
int	HashPartition.spillPartition(List<MemorySegment> target, IOManager ioAccess, FileIOChannel.ID targetChannel, LinkedBlockingQueue<MemorySegment> bufferReturnQueue) Spills this partition to disk and sets it up such that it continues spilling records that are added to it.

Constructors in org.apache.flink.runtime.operators.hash with parameters of type IOManager

Constructor and Description
MutableHashTable(TypeSerializer<BT> buildSideSerializer, TypeSerializer<PT> probeSideSerializer, TypeComparator<BT> buildSideComparator, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> comparator, List<MemorySegment> memorySegments, IOManager ioManager)
MutableHashTable(TypeSerializer<BT> buildSideSerializer, TypeSerializer<PT> probeSideSerializer, TypeComparator<BT> buildSideComparator, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> comparator, List<MemorySegment> memorySegments, IOManager ioManager, boolean useBloomFilters)
MutableHashTable(TypeSerializer<BT> buildSideSerializer, TypeSerializer<PT> probeSideSerializer, TypeComparator<BT> buildSideComparator, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> comparator, List<MemorySegment> memorySegments, IOManager ioManager, int avgRecordLen, boolean useBloomFilters)
NonReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput, MutableObjectIterator<V2> secondInput, TypeSerializer<V1> serializer1, TypeComparator<V1> comparator1, TypeSerializer<V2> serializer2, TypeComparator<V2> comparator2, TypePairComparator<V2,V1> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean probeSideOuterJoin, boolean buildSideOuterJoin, boolean useBitmapFilters)
NonReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput, MutableObjectIterator<V2> secondInput, TypeSerializer<V1> serializer1, TypeComparator<V1> comparator1, TypeSerializer<V2> serializer2, TypeComparator<V2> comparator2, TypePairComparator<V2,V1> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean probeSideOuterJoin, boolean buildSideOuterJoin, boolean useBitmapFilters)
NonReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput, MutableObjectIterator<V2> secondInput, TypeSerializer<V1> serializer1, TypeComparator<V1> comparator1, TypeSerializer<V2> serializer2, TypeComparator<V2> comparator2, TypePairComparator<V1,V2> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean probeSideOuterJoin, boolean buildSideOuterJoin, boolean useBitmapFilters)
NonReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput, MutableObjectIterator<V2> secondInput, TypeSerializer<V1> serializer1, TypeComparator<V1> comparator1, TypeSerializer<V2> serializer2, TypeComparator<V2> comparator2, TypePairComparator<V1,V2> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean probeSideOuterJoin, boolean buildSideOuterJoin, boolean useBitmapFilters)
ReOpenableMutableHashTable(TypeSerializer<BT> buildSideSerializer, TypeSerializer<PT> probeSideSerializer, TypeComparator<BT> buildSideComparator, TypeComparator<PT> probeSideComparator, TypePairComparator<PT,BT> comparator, List<MemorySegment> memorySegments, IOManager ioManager, boolean useBitmapFilters)
ReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput, MutableObjectIterator<V2> secondInput, TypeSerializer<V1> serializer1, TypeComparator<V1> comparator1, TypeSerializer<V2> serializer2, TypeComparator<V2> comparator2, TypePairComparator<V2,V1> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean probeSideOuterJoin, boolean buildSideOuterJoin, boolean useBitmapFilters)
ReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput, MutableObjectIterator<V2> secondInput, TypeSerializer<V1> serializer1, TypeComparator<V1> comparator1, TypeSerializer<V2> serializer2, TypeComparator<V2> comparator2, TypePairComparator<V2,V1> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean probeSideOuterJoin, boolean buildSideOuterJoin, boolean useBitmapFilters)
ReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput, MutableObjectIterator<V2> secondInput, TypeSerializer<V1> serializer1, TypeComparator<V1> comparator1, TypeSerializer<V2> serializer2, TypeComparator<V2> comparator2, TypePairComparator<V1,V2> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean probeSideOuterJoin, boolean buildSideOuterJoin, boolean useBitmapFilters)
ReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput, MutableObjectIterator<V2> secondInput, TypeSerializer<V1> serializer1, TypeComparator<V1> comparator1, TypeSerializer<V2> serializer2, TypeComparator<V2> comparator2, TypePairComparator<V1,V2> pairComparator, MemoryManager memManager, IOManager ioManager, AbstractInvokable ownerTask, double memoryFraction, boolean probeSideOuterJoin, boolean buildSideOuterJoin, boolean useBitmapFilters)

Uses of IOManager in org.apache.flink.runtime.operators.resettable

Constructors in org.apache.flink.runtime.operators.resettable with parameters of type IOManager

Constructor and Description
SpillingResettableIterator(Iterator<T> input, TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, int numPages, AbstractInvokable parentTask)
SpillingResettableIterator(Iterator<T> input, TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, List<MemorySegment> memory)
SpillingResettableMutableObjectIterator(MutableObjectIterator<T> input, TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, int numPages, AbstractInvokable parentTask)
SpillingResettableMutableObjectIterator(MutableObjectIterator<T> input, TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, List<MemorySegment> memory)

Uses of IOManager in org.apache.flink.runtime.operators.sort

Methods in org.apache.flink.runtime.operators.sort with parameters of type IOManager

Modifier and Type	Method and Description
ExternalSorterBuilder<T>	ExternalSorterBuilder.enableSpilling(IOManager ioManager)
ExternalSorterBuilder<T>	ExternalSorterBuilder.enableSpilling(IOManager ioManager, double startSpillingFraction)

Constructors in org.apache.flink.runtime.operators.sort with parameters of type IOManager

Constructor and Description
AbstractMergeInnerJoinIterator(MutableObjectIterator<T1> input1, MutableObjectIterator<T2> input2, TypeSerializer<T1> serializer1, TypeComparator<T1> comparator1, TypeSerializer<T2> serializer2, TypeComparator<T2> comparator2, TypePairComparator<T1,T2> pairComparator, MemoryManager memoryManager, IOManager ioManager, int numMemoryPages, AbstractInvokable parentTask)
AbstractMergeIterator(MutableObjectIterator<T1> input1, MutableObjectIterator<T2> input2, TypeSerializer<T1> serializer1, TypeComparator<T1> comparator1, TypeSerializer<T2> serializer2, TypeComparator<T2> comparator2, TypePairComparator<T1,T2> pairComparator, MemoryManager memoryManager, IOManager ioManager, int numMemoryPages, AbstractInvokable parentTask)
AbstractMergeOuterJoinIterator(OuterJoinOperatorBase.OuterJoinType outerJoinType, MutableObjectIterator<T1> input1, MutableObjectIterator<T2> input2, TypeSerializer<T1> serializer1, TypeComparator<T1> comparator1, TypeSerializer<T2> serializer2, TypeComparator<T2> comparator2, TypePairComparator<T1,T2> pairComparator, MemoryManager memoryManager, IOManager ioManager, int numMemoryPages, AbstractInvokable parentTask)
LargeRecordHandler(TypeSerializer<T> serializer, TypeComparator<T> comparator, IOManager ioManager, MemoryManager memManager, List<MemorySegment> memory, TaskInvokable memoryOwner, int maxFilehandles, ExecutionConfig executionConfig)
NonReusingMergeInnerJoinIterator(MutableObjectIterator<T1> input1, MutableObjectIterator<T2> input2, TypeSerializer<T1> serializer1, TypeComparator<T1> comparator1, TypeSerializer<T2> serializer2, TypeComparator<T2> comparator2, TypePairComparator<T1,T2> pairComparator, MemoryManager memoryManager, IOManager ioManager, int numMemoryPages, AbstractInvokable parentTask)
NonReusingMergeOuterJoinIterator(OuterJoinOperatorBase.OuterJoinType outerJoinType, MutableObjectIterator<T1> input1, MutableObjectIterator<T2> input2, TypeSerializer<T1> serializer1, TypeComparator<T1> comparator1, TypeSerializer<T2> serializer2, TypeComparator<T2> comparator2, TypePairComparator<T1,T2> pairComparator, MemoryManager memoryManager, IOManager ioManager, int numMemoryPages, AbstractInvokable parentTask)
ReusingMergeInnerJoinIterator(MutableObjectIterator<T1> input1, MutableObjectIterator<T2> input2, TypeSerializer<T1> serializer1, TypeComparator<T1> comparator1, TypeSerializer<T2> serializer2, TypeComparator<T2> comparator2, TypePairComparator<T1,T2> pairComparator, MemoryManager memoryManager, IOManager ioManager, int numMemoryPages, AbstractInvokable parentTask)
ReusingMergeOuterJoinIterator(OuterJoinOperatorBase.OuterJoinType outerJoinType, MutableObjectIterator<T1> input1, MutableObjectIterator<T2> input2, TypeSerializer<T1> serializer1, TypeComparator<T1> comparator1, TypeSerializer<T2> serializer2, TypeComparator<T2> comparator2, TypePairComparator<T1,T2> pairComparator, MemoryManager memoryManager, IOManager ioManager, int numMemoryPages, AbstractInvokable parentTask)

Uses of IOManager in org.apache.flink.runtime.taskexecutor

Methods in org.apache.flink.runtime.taskexecutor that return IOManager

Modifier and Type	Method and Description
IOManager	TaskManagerServices.getIOManager()

Uses of IOManager in org.apache.flink.runtime.taskmanager

Methods in org.apache.flink.runtime.taskmanager that return IOManager

Modifier and Type	Method and Description
IOManager	RuntimeEnvironment.getIOManager()

Constructors in org.apache.flink.runtime.taskmanager with parameters of type IOManager

Constructor and Description
RuntimeEnvironment(JobID jobId, JobVertexID jobVertexId, ExecutionAttemptID executionId, ExecutionConfig executionConfig, TaskInfo taskInfo, Configuration jobConfiguration, Configuration taskConfiguration, UserCodeClassLoader userCodeClassLoader, MemoryManager memManager, IOManager ioManager, BroadcastVariableManager bcVarManager, TaskStateManager taskStateManager, GlobalAggregateManager aggregateManager, AccumulatorRegistry accumulatorRegistry, TaskKvStateRegistry kvStateRegistry, InputSplitProvider splitProvider, Map<String,Future<Path>> distCacheEntries, ResultPartitionWriter[] writers, IndexedInputGate[] inputGates, TaskEventDispatcher taskEventDispatcher, CheckpointResponder checkpointResponder, TaskOperatorEventGateway operatorEventGateway, TaskManagerRuntimeInfo taskManagerInfo, TaskMetricGroup metrics, Task containingTask, ExternalResourceInfoProvider externalResourceInfoProvider)
Task(JobInformation jobInformation, TaskInformation taskInformation, ExecutionAttemptID executionAttemptID, AllocationID slotAllocationId, int subtaskIndex, int attemptNumber, List<ResultPartitionDeploymentDescriptor> resultPartitionDeploymentDescriptors, List<InputGateDeploymentDescriptor> inputGateDeploymentDescriptors, MemoryManager memManager, IOManager ioManager, ShuffleEnvironment<?,?> shuffleEnvironment, KvStateService kvStateService, BroadcastVariableManager bcVarManager, TaskEventDispatcher taskEventDispatcher, ExternalResourceInfoProvider externalResourceInfoProvider, TaskStateManager taskStateManager, TaskManagerActions taskManagerActions, InputSplitProvider inputSplitProvider, CheckpointResponder checkpointResponder, TaskOperatorEventGateway operatorCoordinatorEventGateway, GlobalAggregateManager aggregateManager, LibraryCacheManager.ClassLoaderHandle classLoaderHandle, FileCache fileCache, TaskManagerRuntimeInfo taskManagerConfig, TaskMetricGroup metricGroup, ResultPartitionConsumableNotifier resultPartitionConsumableNotifier, PartitionProducerStateChecker partitionProducerStateChecker, Executor executor) IMPORTANT: This constructor may not start any work that would need to be undone in the case of a failing task deployment.

Uses of IOManager in org.apache.flink.state.api.runtime

Methods in org.apache.flink.state.api.runtime that return IOManager

Modifier and Type	Method and Description
IOManager	SavepointEnvironment.getIOManager()

Uses of IOManager in org.apache.flink.streaming.api.operators.sort

Methods in org.apache.flink.streaming.api.operators.sort with parameters of type IOManager

Modifier and Type

Method and Description

static <K> MultiInputSortingDataInput.SelectableSortingInputs

MultiInputSortingDataInput.wrapInputs(TaskInvokable containingTask, StreamTaskInput<Object>[] sortingInputs, KeySelector<Object,K>[] keySelectors, TypeSerializer<Object>[] inputSerializers, TypeSerializer<K> keySerializer, StreamTaskInput<Object>[] passThroughInputs, MemoryManager memoryManager, IOManager ioManager, boolean objectReuse, double managedMemoryFraction, Configuration jobConfiguration, ExecutionConfig executionConfig)

Constructors in org.apache.flink.streaming.api.operators.sort with parameters of type IOManager

Constructor and Description
SortingDataInput(StreamTaskInput<T> wrappedInput, TypeSerializer<T> typeSerializer, TypeSerializer<K> keySerializer, KeySelector<T,K> keySelector, MemoryManager memoryManager, IOManager ioManager, boolean objectReuse, double managedMemoryFraction, Configuration jobConfiguration, TaskInvokable containingTask, ExecutionConfig executionConfig)

Uses of IOManager in org.apache.flink.streaming.runtime.io

Methods in org.apache.flink.streaming.runtime.io with parameters of type IOManager

Modifier and Type	Method and Description
static <T> StreamTaskInput<T>	StreamTaskNetworkInputFactory.create(CheckpointedInputGate checkpointedInputGate, TypeSerializer<T> inputSerializer, IOManager ioManager, StatusWatermarkValve statusWatermarkValve, int inputIndex, InflightDataRescalingDescriptor rescalingDescriptorinflightDataRescalingDescriptor, java.util.function.Function<Integer,StreamPartitioner<?>> gatePartitioners, TaskInfo taskInfo) Factory method for StreamTaskNetworkInput or RescalingStreamTaskNetworkInput depending on InflightDataRescalingDescriptor.
static <IN1,IN2> StreamMultipleInputProcessor	StreamTwoInputProcessorFactory.create(TaskInvokable ownerTask, CheckpointedInputGate[] checkpointedInputGates, IOManager ioManager, MemoryManager memoryManager, TaskIOMetricGroup taskIOMetricGroup, TwoInputStreamOperator<IN1,IN2,?> streamOperator, WatermarkGauge input1WatermarkGauge, WatermarkGauge input2WatermarkGauge, OperatorChain<?,?> operatorChain, StreamConfig streamConfig, Configuration taskManagerConfig, Configuration jobConfig, ExecutionConfig executionConfig, ClassLoader userClassloader, Counter numRecordsIn, InflightDataRescalingDescriptor inflightDataRescalingDescriptor, java.util.function.Function<Integer,StreamPartitioner<?>> gatePartitioners, TaskInfo taskInfo)
static StreamMultipleInputProcessor	StreamMultipleInputProcessorFactory.create(TaskInvokable ownerTask, CheckpointedInputGate[] checkpointedInputGates, StreamConfig.InputConfig[] configuredInputs, IOManager ioManager, MemoryManager memoryManager, TaskIOMetricGroup ioMetricGroup, Counter mainOperatorRecordsIn, MultipleInputStreamOperator<?> mainOperator, WatermarkGauge[] inputWatermarkGauges, StreamConfig streamConfig, Configuration taskManagerConfig, Configuration jobConfig, ExecutionConfig executionConfig, ClassLoader userClassloader, OperatorChain<?,?> operatorChain, InflightDataRescalingDescriptor inflightDataRescalingDescriptor, java.util.function.Function<Integer,StreamPartitioner<?>> gatePartitioners, TaskInfo taskInfo)

Constructors in org.apache.flink.streaming.runtime.io with parameters of type IOManager

Constructor and Description
StreamTaskNetworkInput(CheckpointedInputGate checkpointedInputGate, TypeSerializer<T> inputSerializer, IOManager ioManager, StatusWatermarkValve statusWatermarkValve, int inputIndex)

Uses of IOManager in org.apache.flink.streaming.runtime.io.recovery

Constructors in org.apache.flink.streaming.runtime.io.recovery with parameters of type IOManager

Constructor and Description
RescalingStreamTaskNetworkInput(CheckpointedInputGate checkpointedInputGate, TypeSerializer<T> inputSerializer, IOManager ioManager, StatusWatermarkValve statusWatermarkValve, int inputIndex, InflightDataRescalingDescriptor inflightDataRescalingDescriptor, java.util.function.Function<Integer,StreamPartitioner<?>> gatePartitioners, TaskInfo taskInfo)

Uses of IOManager in org.apache.flink.table.runtime.hashtable

Fields in org.apache.flink.table.runtime.hashtable declared as IOManager

Modifier and Type	Field and Description
protected IOManager	BaseHybridHashTable.ioManager The I/O manager used to instantiate writers for the spilled partitions.

Constructors in org.apache.flink.table.runtime.hashtable with parameters of type IOManager

Constructor and Description
BaseHybridHashTable(Configuration conf, Object owner, MemoryManager memManager, long reservedMemorySize, IOManager ioManager, int avgRecordLen, long buildRowCount, boolean tryDistinctBuildRow)
BinaryHashTable(Configuration conf, Object owner, AbstractRowDataSerializer buildSideSerializer, AbstractRowDataSerializer probeSideSerializer, Projection<RowData,BinaryRowData> buildSideProjection, Projection<RowData,BinaryRowData> probeSideProjection, MemoryManager memManager, long reservedMemorySize, IOManager ioManager, int avgRecordLen, long buildRowCount, boolean useBloomFilters, HashJoinType type, JoinCondition condFunc, boolean reverseJoin, boolean[] filterNulls, boolean tryDistinctBuildRow)
LongHybridHashTable(Configuration conf, Object owner, BinaryRowDataSerializer buildSideSerializer, BinaryRowDataSerializer probeSideSerializer, MemoryManager memManager, long reservedMemorySize, IOManager ioManager, int avgRecordLen, long buildRowCount)

Uses of IOManager in org.apache.flink.table.runtime.io

Constructors in org.apache.flink.table.runtime.io with parameters of type IOManager

Constructor and Description
CompressedBlockChannelReader(IOManager ioManager, FileIOChannel.ID channel, LinkedBlockingQueue<MemorySegment> blockQueue, BlockCompressionFactory codecFactory, int preferBlockSize, int segmentSize)
CompressedBlockChannelWriter(IOManager ioManager, FileIOChannel.ID channel, LinkedBlockingQueue<MemorySegment> blockQueue, BlockCompressionFactory codecFactory, int preferBlockSize, int segmentSize)
CompressedHeaderlessChannelReaderInputView(FileIOChannel.ID id, IOManager ioManager, BlockCompressionFactory compressionCodecFactory, int compressionBlockSize, int numBlocks)

Uses of IOManager in org.apache.flink.table.runtime.operators.sort

Fields in org.apache.flink.table.runtime.operators.sort declared as IOManager

Modifier and Type	Field and Description
protected IOManager	AbstractBinaryExternalMerger.ioManager

Constructors in org.apache.flink.table.runtime.operators.sort with parameters of type IOManager

Constructor and Description
AbstractBinaryExternalMerger(IOManager ioManager, int pageSize, int maxFanIn, SpillChannelManager channelManager, boolean compressionEnable, BlockCompressionFactory compressionCodecFactory, int compressionBlockSize)
BinaryExternalMerger(IOManager ioManager, int pageSize, int maxFanIn, SpillChannelManager channelManager, BinaryRowDataSerializer serializer, RecordComparator comparator, boolean compressionEnable, BlockCompressionFactory compressionCodecFactory, int compressionBlockSize)
BinaryExternalSorter(Object owner, MemoryManager memoryManager, long reservedMemorySize, IOManager ioManager, AbstractRowDataSerializer<RowData> inputSerializer, BinaryRowDataSerializer serializer, NormalizedKeyComputer normalizedKeyComputer, RecordComparator comparator, Configuration conf)
BinaryExternalSorter(Object owner, MemoryManager memoryManager, long reservedMemorySize, IOManager ioManager, AbstractRowDataSerializer<RowData> inputSerializer, BinaryRowDataSerializer serializer, NormalizedKeyComputer normalizedKeyComputer, RecordComparator comparator, Configuration conf, float startSpillingFraction)
BinaryKVExternalMerger(IOManager ioManager, int pageSize, int maxFanIn, SpillChannelManager channelManager, BinaryRowDataSerializer keySerializer, BinaryRowDataSerializer valueSerializer, RecordComparator comparator, boolean compressionEnable, BlockCompressionFactory compressionCodecFactory, int compressionBlockSize)
BufferedKVExternalSorter(IOManager ioManager, BinaryRowDataSerializer keySerializer, BinaryRowDataSerializer valueSerializer, NormalizedKeyComputer nKeyComputer, RecordComparator comparator, int pageSize, Configuration conf)

Uses of IOManager in org.apache.flink.table.runtime.util

Methods in org.apache.flink.table.runtime.util with parameters of type IOManager

Modifier and Type	Method and Description
static BlockChannelReader<MemorySegment>	FileChannelUtil.createBlockChannelReader(IOManager ioManager, FileIOChannel.ID channel, LinkedBlockingQueue<MemorySegment> bufferReturnQueue, boolean compressionEnable, BlockCompressionFactory compressionCodecFactory, int compressionBlockSize, int segmentSize)
static BlockChannelWriter<MemorySegment>	FileChannelUtil.createBlockChannelWriter(IOManager ioManager, FileIOChannel.ID channel, LinkedBlockingQueue<MemorySegment> bufferReturnQueue, boolean compressionEnable, BlockCompressionFactory compressionCodecFactory, int compressionBlockSize, int segmentSize)
static AbstractChannelReaderInputView	FileChannelUtil.createInputView(IOManager ioManager, ChannelWithMeta channel, List<FileIOChannel> channels, boolean compressionEnable, BlockCompressionFactory compressionCodecFactory, int compressionBlockSize, int segmentSize)
static AbstractChannelWriterOutputView	FileChannelUtil.createOutputView(IOManager ioManager, FileIOChannel.ID channel, boolean compressionEnable, BlockCompressionFactory compressionCodecFactory, int compressionBlockSize, int segmentSize)

Constructors in org.apache.flink.table.runtime.util with parameters of type IOManager

Constructor and Description
ResettableExternalBuffer(IOManager ioManager, LazyMemorySegmentPool pool, AbstractRowDataSerializer serializer, boolean isRowAllInFixedPart)