Package | Description |
---|---|
org.apache.flink.runtime.execution | |
org.apache.flink.runtime.io.network | |
org.apache.flink.runtime.io.network.api.reader | |
org.apache.flink.runtime.io.network.metrics | |
org.apache.flink.runtime.io.network.partition.consumer | |
org.apache.flink.runtime.shuffle | |
org.apache.flink.runtime.taskmanager | |
org.apache.flink.state.api.runtime | |
org.apache.flink.streaming.runtime.io | |
org.apache.flink.streaming.runtime.tasks |
This package contains classes that realize streaming tasks.
|
Modifier and Type | Method and Description |
---|---|
InputGate[] |
Environment.getAllInputGates() |
InputGate |
Environment.getInputGate(int index) |
Modifier and Type | Method and Description |
---|---|
Optional<InputGate> |
NettyShuffleEnvironment.getInputGate(InputGateID id) |
Modifier and Type | Method and Description |
---|---|
void |
NettyShuffleEnvironment.registerLegacyNetworkMetrics(MetricGroup metricGroup,
ResultPartitionWriter[] producedPartitions,
InputGate[] inputGates)
Deprecated.
should be removed in future
|
Modifier and Type | Field and Description |
---|---|
protected InputGate |
AbstractReader.inputGate
The input gate to read from.
|
Constructor and Description |
---|
AbstractReader(InputGate inputGate) |
MutableRecordReader(InputGate inputGate,
String[] tmpDirectories)
Creates a new MutableRecordReader that de-serializes records from the given input gate and
can spill partial records to disk, if they grow large.
|
RecordReader(InputGate inputGate,
Class<T> recordType,
String[] tmpDirectories)
Creates a new RecordReader that de-serializes records from the given input gate and
can spill partial records to disk, if they grow large.
|
Modifier and Type | Method and Description |
---|---|
static void |
NettyShuffleMetricFactory.registerLegacyNetworkMetrics(boolean isDetailedMetrics,
boolean isCreditBased,
MetricGroup metricGroup,
ResultPartitionWriter[] producedPartitions,
InputGate[] inputGates)
Deprecated.
should be removed in future
|
Modifier and Type | Class and Description |
---|---|
class |
SingleInputGate
An input gate consumes one or more partitions of a single produced intermediate result.
|
class |
UnionInputGate
Input gate wrapper to union the input from multiple input gates.
|
Constructor and Description |
---|
UnionInputGate(InputGate... inputGates) |
Modifier and Type | Interface and Description |
---|---|
interface |
ShuffleEnvironment<P extends ResultPartitionWriter,G extends InputGate>
Interface for the implementation of shuffle service local environment.
|
interface |
ShuffleServiceFactory<SD extends ShuffleDescriptor,P extends ResultPartitionWriter,G extends InputGate>
Interface for shuffle service factory implementations.
|
Modifier and Type | Class and Description |
---|---|
class |
InputGateWithMetrics
This class wraps
InputGate provided by shuffle service and it is mainly
used for increasing general input metrics from TaskIOMetricGroup . |
Modifier and Type | Method and Description |
---|---|
InputGate[] |
RuntimeEnvironment.getAllInputGates() |
InputGate |
RuntimeEnvironment.getInputGate(int index) |
Modifier and Type | Method and Description |
---|---|
static void |
Task.setupPartitionsAndGates(ResultPartitionWriter[] producedPartitions,
InputGate[] inputGates) |
Constructor and Description |
---|
InputGateWithMetrics(InputGate inputGate,
Counter numBytesIn) |
RuntimeEnvironment(JobID jobId,
JobVertexID jobVertexId,
ExecutionAttemptID executionId,
ExecutionConfig executionConfig,
TaskInfo taskInfo,
Configuration jobConfiguration,
Configuration taskConfiguration,
ClassLoader userCodeClassLoader,
MemoryManager memManager,
IOManager ioManager,
BroadcastVariableManager bcVarManager,
TaskStateManager taskStateManager,
GlobalAggregateManager aggregateManager,
AccumulatorRegistry accumulatorRegistry,
TaskKvStateRegistry kvStateRegistry,
InputSplitProvider splitProvider,
Map<String,Future<Path>> distCacheEntries,
ResultPartitionWriter[] writers,
InputGate[] inputGates,
TaskEventDispatcher taskEventDispatcher,
CheckpointResponder checkpointResponder,
TaskManagerRuntimeInfo taskManagerInfo,
TaskMetricGroup metrics,
Task containingTask) |
Modifier and Type | Method and Description |
---|---|
InputGate[] |
SavepointEnvironment.getAllInputGates() |
InputGate |
SavepointEnvironment.getInputGate(int index) |
Modifier and Type | Method and Description |
---|---|
static InputGate |
InputGateUtil.createInputGate(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2) |
static InputGate |
InputGateUtil.createInputGate(InputGate[] inputGates) |
Modifier and Type | Method and Description |
---|---|
static CheckpointedInputGate |
InputProcessorUtil.createCheckpointedInputGate(AbstractInvokable toNotifyOnCheckpoint,
CheckpointingMode checkpointMode,
IOManager ioManager,
InputGate inputGate,
Configuration taskManagerConfig,
String taskName) |
static CheckpointedInputGate[] |
InputProcessorUtil.createCheckpointedInputGatePair(AbstractInvokable toNotifyOnCheckpoint,
CheckpointingMode checkpointMode,
IOManager ioManager,
InputGate inputGate1,
InputGate inputGate2,
Configuration taskManagerConfig,
String taskName) |
static InputGate |
InputGateUtil.createInputGate(InputGate[] inputGates) |
Modifier and Type | Method and Description |
---|---|
static InputGate |
InputGateUtil.createInputGate(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2) |
static InputGate |
InputGateUtil.createInputGate(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2) |
Constructor and Description |
---|
CheckpointedInputGate(InputGate inputGate,
BufferStorage bufferStorage,
CheckpointBarrierHandler barrierHandler) |
CheckpointedInputGate(InputGate inputGate,
BufferStorage bufferStorage,
CheckpointBarrierHandler barrierHandler,
int channelIndexOffset)
Creates a new checkpoint stream aligner.
|
CheckpointedInputGate(InputGate inputGate,
BufferStorage bufferStorage,
String taskName,
AbstractInvokable toNotifyOnCheckpoint) |
StreamOneInputProcessor(InputGate[] inputGates,
TypeSerializer<IN> inputSerializer,
StreamTask<?,?> checkpointedTask,
CheckpointingMode checkpointMode,
Object lock,
IOManager ioManager,
Configuration taskManagerConfig,
StreamStatusMaintainer streamStatusMaintainer,
OneInputStreamOperator<IN,?> streamOperator,
TaskIOMetricGroup metrics,
WatermarkGauge watermarkGauge,
String taskName,
OperatorChain<?,?> operatorChain) |
Constructor and Description |
---|
StreamTwoInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputSerializer1,
TypeSerializer<IN2> inputSerializer2,
TwoInputStreamTask<IN1,IN2,?> checkpointedTask,
CheckpointingMode checkpointMode,
Object lock,
IOManager ioManager,
Configuration taskManagerConfig,
StreamStatusMaintainer streamStatusMaintainer,
TwoInputStreamOperator<IN1,IN2,?> streamOperator,
TaskIOMetricGroup metrics,
WatermarkGauge input1WatermarkGauge,
WatermarkGauge input2WatermarkGauge,
String taskName,
OperatorChain<?,?> operatorChain) |
StreamTwoInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputSerializer1,
TypeSerializer<IN2> inputSerializer2,
TwoInputStreamTask<IN1,IN2,?> checkpointedTask,
CheckpointingMode checkpointMode,
Object lock,
IOManager ioManager,
Configuration taskManagerConfig,
StreamStatusMaintainer streamStatusMaintainer,
TwoInputStreamOperator<IN1,IN2,?> streamOperator,
TaskIOMetricGroup metrics,
WatermarkGauge input1WatermarkGauge,
WatermarkGauge input2WatermarkGauge,
String taskName,
OperatorChain<?,?> operatorChain) |
StreamTwoInputSelectableProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputSerializer1,
TypeSerializer<IN2> inputSerializer2,
StreamTask<?,?> streamTask,
CheckpointingMode checkpointingMode,
Object lock,
IOManager ioManager,
Configuration taskManagerConfig,
StreamStatusMaintainer streamStatusMaintainer,
TwoInputStreamOperator<IN1,IN2,?> streamOperator,
WatermarkGauge input1WatermarkGauge,
WatermarkGauge input2WatermarkGauge,
String taskName,
OperatorChain<?,?> operatorChain) |
StreamTwoInputSelectableProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputSerializer1,
TypeSerializer<IN2> inputSerializer2,
StreamTask<?,?> streamTask,
CheckpointingMode checkpointingMode,
Object lock,
IOManager ioManager,
Configuration taskManagerConfig,
StreamStatusMaintainer streamStatusMaintainer,
TwoInputStreamOperator<IN1,IN2,?> streamOperator,
WatermarkGauge input1WatermarkGauge,
WatermarkGauge input2WatermarkGauge,
String taskName,
OperatorChain<?,?> operatorChain) |
Modifier and Type | Method and Description |
---|---|
protected void |
TwoInputStreamTask.createInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputDeserializer1,
TypeSerializer<IN2> inputDeserializer2) |
protected void |
TwoInputStreamTask.createInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputDeserializer1,
TypeSerializer<IN2> inputDeserializer2) |
protected void |
TwoInputSelectableStreamTask.createInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputDeserializer1,
TypeSerializer<IN2> inputDeserializer2) |
protected void |
TwoInputSelectableStreamTask.createInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputDeserializer1,
TypeSerializer<IN2> inputDeserializer2) |
protected abstract void |
AbstractTwoInputStreamTask.createInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputDeserializer1,
TypeSerializer<IN2> inputDeserializer2) |
protected abstract void |
AbstractTwoInputStreamTask.createInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputDeserializer1,
TypeSerializer<IN2> inputDeserializer2) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.