org.apache.flink.api.java.operators

Class Operator<OUT,O extends Operator<OUT,O>>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

Type Parameters:

OUT - The type of the data set produced by this operator.

O - The type of the operator, so that we can return it.

Direct Known Subclasses:

DataSource, SingleInputOperator, TwoInputOperator

@Public
public abstract class Operator<OUT,O extends Operator<OUT,O>>
extends DataSet<OUT>

Base class of all operators in the Java API.

Field Summary

Fields

Modifier and Type	Field and Description
protected ResourceSpec	minResources
protected String	name
protected int	parallelism
protected ResourceSpec	preferredResources

Fields inherited from class org.apache.flink.api.java.DataSet

context

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	Operator(ExecutionEnvironment context, TypeInformation<OUT> resultType)

Method Summary

Modifier and Type	Method and Description
ResourceSpec	getMinResources() Returns the minimum resource of this operator.
String	getName() Returns the name of the operator.
int	getParallelism() Returns the parallelism of this operator.
ResourceSpec	getPreferredResources() Returns the preferred resource of this operator.
TypeInformation<OUT>	getResultType() Returns the type of the result of this operator.
O	name(String newName) Sets the name of this operator.
O	setParallelism(int parallelism) Sets the parallelism for this operator.

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sortPartition, sortPartition, sortPartition, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

name

protected String name

parallelism

protected int parallelism

minResources

protected ResourceSpec minResources

preferredResources

protected ResourceSpec preferredResources

Constructor Detail

Operator

protected Operator(ExecutionEnvironment context,
                   TypeInformation<OUT> resultType)

Method Detail

getResultType

public TypeInformation<OUT> getResultType()

Returns the type of the result of this operator.

Returns:

The result type of the operator.

getName

public String getName()

Returns the name of the operator. If no name has been set, it returns the name of the operation, or the name of the class implementing the function of this operator.

Returns:

The name of the operator.

getParallelism

public int getParallelism()

Returns the parallelism of this operator.

Returns:

The parallelism of this operator.

getMinResources

public ResourceSpec getMinResources()

Returns the minimum resource of this operator. If no minimum resource has been set, it returns the default empty resource.

Returns:

The minimum resource of this operator.

getPreferredResources

public ResourceSpec getPreferredResources()

Returns the preferred resource of this operator. If no preferred resource has been set, it returns the default empty resource.

Returns:

The preferred resource of this operator.

name

public O name(String newName)

Sets the name of this operator. This overrides the default name, which is either a generated description of the operation (such as for example "Aggregate(1:SUM, 2:MIN)") or the name the user-defined function or input/output format executed by the operator.

Parameters:

newName - The name for this operator.

Returns:

The operator with a new name.

setParallelism

public O setParallelism(int parallelism)

Sets the parallelism for this operator. The parallelism must be 1 or more.

Parameters:

parallelism - The parallelism for this operator. A value equal to ExecutionConfig.PARALLELISM_DEFAULT will use the system default.

Returns:

The operator with set parallelism.