public class PartitionSortedDataSet<T> extends DataSet<T>
DataSet.sortPartition
. This can be used to append additional sort fields to the
one sort-partition operator.
Constructor and Description |
---|
PartitionSortedDataSet(SortPartitionOperator<T> set,
scala.reflect.ClassTag<T> evidence$1) |
Modifier and Type | Method and Description |
---|---|
<K> DataSet<T> |
sortPartition(scala.Function1<T,K> fun,
Order order,
TypeInformation<K> evidence$2)
Locally sorts the partitions of the DataSet on the extracted key in the specified order.
|
DataSet<T> |
sortPartition(int field,
Order order)
Appends the given field and order to the sort-partition operator.
|
DataSet<T> |
sortPartition(String field,
Order order)
Appends the given field and order to the sort-partition operator.
|
aggregate, aggregate, clean, coGroup, collect, combineGroup, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, filter, filter, first, flatMap, flatMap, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getParallelism, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, iterateDelta, iterateDelta, iterateDelta, iterateWithTermination, javaSet, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, map, mapPartition, mapPartition, mapPartition, max, max, maxBy, min, min, minBy, name, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, rebalance, reduce, reduce, reduceGroup, reduceGroup, reduceGroup, registerAggregator, rightOuterJoin, rightOuterJoin, setParallelism, sum, sum, union, withBroadcastSet, withForwardedFields, withForwardedFieldsFirst, withForwardedFieldsSecond, withParameters, write, writeAsCsv, writeAsText
public PartitionSortedDataSet(SortPartitionOperator<T> set, scala.reflect.ClassTag<T> evidence$1)
public DataSet<T> sortPartition(int field, Order order)
sortPartition
in class DataSet<T>
public DataSet<T> sortPartition(String field, Order order)
sortPartition
in class DataSet<T>
public <K> DataSet<T> sortPartition(scala.Function1<T,K> fun, Order order, TypeInformation<K> evidence$2)
DataSet
Note that no additional sort keys can be appended to a KeySelector sort keys. To sort the partitions by multiple values using KeySelector, the KeySelector must return a tuple consisting of the values.
sortPartition
in class DataSet<T>
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.