org.apache.flink.api.java.operators

Class UnionOperator<T>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.TwoInputOperator<T,T,T,UnionOperator<T>>

org.apache.flink.api.java.operators.UnionOperator<T>

Type Parameters:

T - The type of the two input data sets and the result data set

@Public
public class UnionOperator<T>
extends TwoInputOperator<T,T,T,UnionOperator<T>>

Java API operator for union of two data sets.

Field Summary

Fields inherited from class org.apache.flink.api.java.operators.Operator

minResources, name, parallelism, preferredResources

Fields inherited from class org.apache.flink.api.java.DataSet

context

Constructor Summary

Constructors

Constructor and Description
UnionOperator(DataSet<T> input1, DataSet<T> input2, String unionLocationName) Create an operator that produces the union of the two given data sets.

Method Summary

Modifier and Type	Method and Description
UnionOperator<T>	setParallelism(int parallelism) Sets the parallelism for this operator.
protected Union<T>	translateToDataFlow(Operator<T> input1, Operator<T> input2) Returns the BinaryNodeTranslation of the Union.

Methods inherited from class org.apache.flink.api.java.operators.TwoInputOperator

getInput1, getInput1Type, getInput2, getInput2Type

Methods inherited from class org.apache.flink.api.java.operators.Operator

getMinResources, getName, getParallelism, getPreferredResources, getResultType, name

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sortPartition, sortPartition, sortPartition, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UnionOperator

public UnionOperator(DataSet<T> input1,
                     DataSet<T> input2,
                     String unionLocationName)

Create an operator that produces the union of the two given data sets.

Parameters:

input1 - The first data set to be unioned.

input2 - The second data set to be unioned.

Method Detail

translateToDataFlow

protected Union<T> translateToDataFlow(Operator<T> input1,
                                       Operator<T> input2)

Returns the BinaryNodeTranslation of the Union.

Specified by:

translateToDataFlow in class TwoInputOperator<T,T,T,UnionOperator<T>>

Parameters:

input1 - The first input of the union, as a common API operator.

input2 - The second input of the union, as a common API operator.

Returns:

The common API union operator.

setParallelism

public UnionOperator<T> setParallelism(int parallelism)

Description copied from class: Operator

Sets the parallelism for this operator. The parallelism must be 1 or more.

Overrides:

setParallelism in class Operator<T,UnionOperator<T>>

Parameters:

parallelism - The parallelism for this operator. A value equal to ExecutionConfig.PARALLELISM_DEFAULT will use the system default.

Returns:

The operator with set parallelism.