T
- The type of the data set made distinct by the operator.@Public public class DistinctOperator<T> extends SingleInputOperator<T,T,DistinctOperator<T>>
Modifier and Type | Class and Description |
---|---|
static class |
DistinctOperator.DistinctFunction<T> |
name, parallelism
Constructor and Description |
---|
DistinctOperator(DataSet<T> input,
Keys<T> keys,
String distinctLocationName) |
Modifier and Type | Method and Description |
---|---|
DistinctOperator<T> |
setCombineHint(ReduceOperatorBase.CombineHint strategy)
Sets the strategy to use for the combine phase of the reduce.
|
protected SingleInputOperator<?,T,?> |
translateToDataFlow(Operator<T> input)
Translates this operation to a data flow operator of the common data flow API.
|
getInput, getInputType
getName, getParallelism, getResultType, name, setParallelism
aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sortPartition, sortPartition, sortPartition, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText
protected SingleInputOperator<?,T,?> translateToDataFlow(Operator<T> input)
SingleInputOperator
translateToDataFlow
in class SingleInputOperator<T,T,DistinctOperator<T>>
input
- The data flow operator that produces this operation's input data.@PublicEvolving public DistinctOperator<T> setCombineHint(ReduceOperatorBase.CombineHint strategy)
ReduceOperatorBase.CombineHint.OPTIMIZER_CHOOSES
)strategy
- The hint to use.Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.