org.apache.flink.streaming.api.transformations

Class TwoInputTransformation<IN1,IN2,OUT>

java.lang.Object

org.apache.flink.api.dag.Transformation<T>

org.apache.flink.streaming.api.transformations.PhysicalTransformation<OUT>

org.apache.flink.streaming.api.transformations.TwoInputTransformation<IN1,IN2,OUT>

Type Parameters:

IN1 - The type of the elements in the first input Transformation

IN2 - The type of the elements in the second input Transformation

OUT - The type of the elements that result from this TwoInputTransformation

@Internal
public class TwoInputTransformation<IN1,IN2,OUT>
extends PhysicalTransformation<OUT>

This Transformation represents the application of a TwoInputStreamOperator to two input Transformations. The result is again only one stream.

Field Summary

Fields inherited from class org.apache.flink.api.dag.Transformation

bufferTimeout, description, id, name, outputType, typeUsed, UPPER_BOUND_MAX_PARALLELISM

Constructor Summary

Constructors

Constructor and Description
TwoInputTransformation(Transformation<IN1> input1, Transformation<IN2> input2, String name, StreamOperatorFactory<OUT> operatorFactory, TypeInformation<OUT> outputType, int parallelism)
TwoInputTransformation(Transformation<IN1> input1, Transformation<IN2> input2, String name, StreamOperatorFactory<OUT> operatorFactory, TypeInformation<OUT> outputType, int parallelism, boolean parallelismConfigured) Creates a new TwoInputTransformation from the given inputs and operator.
TwoInputTransformation(Transformation<IN1> input1, Transformation<IN2> input2, String name, TwoInputStreamOperator<IN1,IN2,OUT> operator, TypeInformation<OUT> outputType, int parallelism) Creates a new TwoInputTransformation from the given inputs and operator.
TwoInputTransformation(Transformation<IN1> input1, Transformation<IN2> input2, String name, TwoInputStreamOperator<IN1,IN2,OUT> operator, TypeInformation<OUT> outputType, int parallelism, boolean parallelismConfigured)

Method Summary

Modifier and Type	Method and Description
Transformation<IN1>	getInput1() Returns the first input Transformation of this TwoInputTransformation.
Transformation<IN2>	getInput2() Returns the second input Transformation of this TwoInputTransformation.
List<Transformation<?>>	getInputs() Returns the transformations that are the immediate predecessors of the current transformation in the transformation graph.
TypeInformation<IN1>	getInputType1() Returns the TypeInformation for the elements from the first input.
TypeInformation<IN2>	getInputType2() Returns the TypeInformation for the elements from the second input.
TwoInputStreamOperator<IN1,IN2,OUT>	getOperator()
StreamOperatorFactory<OUT>	getOperatorFactory() Returns the StreamOperatorFactory of this Transformation.
KeySelector<IN1,?>	getStateKeySelector1() Returns the KeySelector that must be used for partitioning keyed state in this Operation for the first input.
KeySelector<IN2,?>	getStateKeySelector2() Returns the KeySelector that must be used for partitioning keyed state in this Operation for the second input.
TypeInformation<?>	getStateKeyType()
protected List<Transformation<?>>	getTransitivePredecessorsInternal() Returns all transitive predecessor Transformations of this Transformation.
boolean	isInternalSorterSupported()
boolean	isOutputOnlyAfterEndOfStream()
void	setChainingStrategy(ChainingStrategy strategy) Sets the chaining strategy of this Transformation.
void	setStateKeySelectors(KeySelector<IN1,?> stateKeySelector1, KeySelector<IN2,?> stateKeySelector2) Sets the KeySelectors that must be used for partitioning keyed state of this transformation.
void	setStateKeyType(TypeInformation<?> stateKeyType)

Methods inherited from class org.apache.flink.streaming.api.transformations.PhysicalTransformation

isSupportsConcurrentExecutionAttempts, setSupportsConcurrentExecutionAttempts

Methods inherited from class org.apache.flink.api.dag.Transformation

declareManagedMemoryUseCaseAtOperatorScope, declareManagedMemoryUseCaseAtSlotScope, equals, getBufferTimeout, getCoLocationGroupKey, getDescription, getId, getManagedMemoryOperatorScopeUseCaseWeights, getManagedMemorySlotScopeUseCases, getMaxParallelism, getMinResources, getName, getNewNodeId, getOutputType, getParallelism, getPreferredResources, getSlotSharingGroup, getTransitivePredecessors, getUid, getUserProvidedNodeHash, hashCode, isParallelismConfigured, setBufferTimeout, setCoLocationGroupKey, setDescription, setMaxParallelism, setName, setOutputType, setParallelism, setParallelism, setResources, setSlotSharingGroup, setSlotSharingGroup, setUid, setUidHash, toString, updateManagedMemoryStateBackendUseCase

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

TwoInputTransformation

public TwoInputTransformation(Transformation<IN1> input1,
                              Transformation<IN2> input2,
                              String name,
                              TwoInputStreamOperator<IN1,IN2,OUT> operator,
                              TypeInformation<OUT> outputType,
                              int parallelism)

Creates a new TwoInputTransformation from the given inputs and operator.

Parameters:

input1 - The first input Transformation

input2 - The second input Transformation

name - The name of the Transformation, this will be shown in Visualizations and the Log

operator - The TwoInputStreamOperator

outputType - The type of the elements produced by this Transformation

parallelism - The parallelism of this Transformation

TwoInputTransformation

public TwoInputTransformation(Transformation<IN1> input1,
                              Transformation<IN2> input2,
                              String name,
                              TwoInputStreamOperator<IN1,IN2,OUT> operator,
                              TypeInformation<OUT> outputType,
                              int parallelism,
                              boolean parallelismConfigured)

TwoInputTransformation

public TwoInputTransformation(Transformation<IN1> input1,
                              Transformation<IN2> input2,
                              String name,
                              StreamOperatorFactory<OUT> operatorFactory,
                              TypeInformation<OUT> outputType,
                              int parallelism)

TwoInputTransformation

public TwoInputTransformation(Transformation<IN1> input1,
                              Transformation<IN2> input2,
                              String name,
                              StreamOperatorFactory<OUT> operatorFactory,
                              TypeInformation<OUT> outputType,
                              int parallelism,
                              boolean parallelismConfigured)

Creates a new TwoInputTransformation from the given inputs and operator.

Parameters:

input1 - The first input Transformation

input2 - The second input Transformation

name - The name of the Transformation, this will be shown in Visualizations and the Log

operatorFactory - The TwoInputStreamOperator factory

outputType - The type of the elements produced by this Transformation

parallelism - The parallelism of this Transformation

parallelismConfigured - If true, the parallelism of the transformation is explicitly set and should be respected. Otherwise the parallelism can be changed at runtime.

Method Detail

getInput1

public Transformation<IN1> getInput1()

Returns the first input Transformation of this TwoInputTransformation.

getInput2

public Transformation<IN2> getInput2()

Returns the second input Transformation of this TwoInputTransformation.

getInputs

public List<Transformation<?>> getInputs()

Description copied from class: Transformation

Returns the transformations that are the immediate predecessors of the current transformation in the transformation graph.

Specified by:

getInputs in class Transformation<OUT>

getInputType1

public TypeInformation<IN1> getInputType1()

Returns the TypeInformation for the elements from the first input.

getInputType2

public TypeInformation<IN2> getInputType2()

Returns the TypeInformation for the elements from the second input.

getOperator

@VisibleForTesting
public TwoInputStreamOperator<IN1,IN2,OUT> getOperator()

getOperatorFactory

public StreamOperatorFactory<OUT> getOperatorFactory()

Returns the StreamOperatorFactory of this Transformation.

setStateKeySelectors

public void setStateKeySelectors(KeySelector<IN1,?> stateKeySelector1,
                                 KeySelector<IN2,?> stateKeySelector2)

Sets the KeySelectors that must be used for partitioning keyed state of this transformation.

Parameters:

stateKeySelector1 - The KeySelector to set for the first input

stateKeySelector2 - The KeySelector to set for the first input

getStateKeySelector1

public KeySelector<IN1,?> getStateKeySelector1()

Returns the KeySelector that must be used for partitioning keyed state in this Operation for the first input.

See Also:

setStateKeySelectors(org.apache.flink.api.java.functions.KeySelector<IN1, ?>, org.apache.flink.api.java.functions.KeySelector<IN2, ?>)

getStateKeySelector2

public KeySelector<IN2,?> getStateKeySelector2()

Returns the KeySelector that must be used for partitioning keyed state in this Operation for the second input.

See Also:

setStateKeySelectors(org.apache.flink.api.java.functions.KeySelector<IN1, ?>, org.apache.flink.api.java.functions.KeySelector<IN2, ?>)

setStateKeyType

public void setStateKeyType(TypeInformation<?> stateKeyType)

getStateKeyType

public TypeInformation<?> getStateKeyType()

getTransitivePredecessorsInternal

protected List<Transformation<?>> getTransitivePredecessorsInternal()

Description copied from class: Transformation

Returns all transitive predecessor Transformations of this Transformation. This is, for example, used when determining whether a feedback edge of an iteration actually has the iteration head as a predecessor.

Specified by:

getTransitivePredecessorsInternal in class Transformation<OUT>

Returns:

The list of transitive predecessors.

setChainingStrategy

public final void setChainingStrategy(ChainingStrategy strategy)

Description copied from class: PhysicalTransformation

Sets the chaining strategy of this Transformation.

Specified by:

setChainingStrategy in class PhysicalTransformation<OUT>

isOutputOnlyAfterEndOfStream

public boolean isOutputOnlyAfterEndOfStream()

isInternalSorterSupported

public boolean isInternalSorterSupported()