Modifier and Type | Method and Description |
---|---|
Partitioner<T> |
GenericDataSourceBase.SplitDataProperties.getSplitPartitioner() |
Modifier and Type | Method and Description |
---|---|
abstract <E> void |
Keys.validateCustomPartitioner(Partitioner<E> partitioner,
TypeInformation<E> typeInfo) |
<E> void |
Keys.SelectorFunctionKeys.validateCustomPartitioner(Partitioner<E> partitioner,
TypeInformation<E> typeInfo) |
<E> void |
Keys.ExpressionKeys.validateCustomPartitioner(Partitioner<E> partitioner,
TypeInformation<E> typeInfo) |
Modifier and Type | Method and Description |
---|---|
Partitioner<?> |
ReduceOperatorBase.getCustomPartitioner() |
Partitioner<?> |
PartitionOperatorBase.getCustomPartitioner() |
Partitioner<?> |
JoinOperatorBase.getCustomPartitioner() |
Partitioner<?> |
GroupReduceOperatorBase.getCustomPartitioner() |
Partitioner<?> |
CoGroupOperatorBase.getCustomPartitioner() |
Modifier and Type | Method and Description |
---|---|
void |
ReduceOperatorBase.setCustomPartitioner(Partitioner<?> customPartitioner) |
void |
PartitionOperatorBase.setCustomPartitioner(Partitioner<?> customPartitioner) |
void |
JoinOperatorBase.setCustomPartitioner(Partitioner<?> partitioner) |
void |
GroupReduceOperatorBase.setCustomPartitioner(Partitioner<?> customPartitioner) |
void |
CoGroupOperatorBase.setCustomPartitioner(Partitioner<?> customPartitioner) |
Modifier and Type | Method and Description |
---|---|
<K> PartitionOperator<T> |
DataSet.partitionCustom(Partitioner<K> partitioner,
int field)
Partitions a tuple DataSet on the specified key fields using a custom partitioner.
|
<K extends Comparable<K>> |
DataSet.partitionCustom(Partitioner<K> partitioner,
KeySelector<T,K> keyExtractor)
Partitions a DataSet on the key returned by the selector, using a custom partitioner.
|
<K> PartitionOperator<T> |
DataSet.partitionCustom(Partitioner<K> partitioner,
String field)
Partitions a POJO DataSet on the specified key fields using a custom partitioner.
|
Modifier and Type | Class and Description |
---|---|
class |
IdPartitioner |
Modifier and Type | Class and Description |
---|---|
static class |
SplitDataProperties.SourcePartitionerMarker<T>
A custom partitioner to mark compatible split partitionings.
|
Modifier and Type | Method and Description |
---|---|
Partitioner<T> |
SplitDataProperties.getSplitPartitioner() |
Modifier and Type | Field and Description |
---|---|
protected Partitioner<?> |
Grouping.customPartitioner |
Modifier and Type | Method and Description |
---|---|
Partitioner<?> |
PartitionOperator.getCustomPartitioner()
Gets the custom partitioner from this partitioning.
|
Partitioner<?> |
Grouping.getCustomPartitioner()
Gets the custom partitioner to be used for this grouping, or
null , if
none was defined. |
Partitioner<?> |
JoinOperator.getPartitioner()
Gets the custom partitioner used by this join, or
null , if none is set. |
Partitioner<?> |
CoGroupOperator.getPartitioner()
Gets the custom partitioner used by this join, or
null , if none is set. |
Partitioner<?> |
CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate.CoGroupOperatorWithoutFunction.getPartitioner()
Gets the custom partitioner used by this join, or
null , if none is set. |
Modifier and Type | Method and Description |
---|---|
UnsortedGrouping<T> |
UnsortedGrouping.withPartitioner(Partitioner<?> partitioner)
Uses a custom partitioner for the grouping.
|
SortedGrouping<T> |
SortedGrouping.withPartitioner(Partitioner<?> partitioner)
Uses a custom partitioner for the grouping.
|
JoinOperator<I1,I2,OUT> |
JoinOperator.withPartitioner(Partitioner<?> partitioner)
Sets a custom partitioner for this join.
|
CoGroupOperator<I1,I2,OUT> |
CoGroupOperator.withPartitioner(Partitioner<?> partitioner)
Sets a custom partitioner for the CoGroup operation.
|
CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate.CoGroupOperatorWithoutFunction |
CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate.CoGroupOperatorWithoutFunction.withPartitioner(Partitioner<?> partitioner)
Sets a custom partitioner for the CoGroup operation.
|
Constructor and Description |
---|
CoGroupOperator(DataSet<I1> input1,
DataSet<I2> input2,
Keys<I1> keys1,
Keys<I2> keys2,
CoGroupFunction<I1,I2,OUT> function,
TypeInformation<OUT> returnType,
List<org.apache.commons.lang3.tuple.Pair<Integer,Order>> groupSortKeyOrderFirst,
List<org.apache.commons.lang3.tuple.Pair<Integer,Order>> groupSortKeyOrderSecond,
Partitioner<?> customPartitioner,
String defaultName) |
CoGroupOperator(DataSet<I1> input1,
DataSet<I2> input2,
Keys<I1> keys1,
Keys<I2> keys2,
CoGroupFunction<I1,I2,OUT> function,
TypeInformation<OUT> returnType,
Partitioner<?> customPartitioner,
String defaultName) |
PartitionOperator(DataSet<T> input,
Keys<T> pKeys,
Partitioner<?> customPartitioner,
String partitionLocationName) |
PartitionOperator(DataSet<T> input,
Keys<T> pKeys,
Partitioner<P> customPartitioner,
TypeInformation<P> partitionerTypeInfo,
String partitionLocationName) |
Modifier and Type | Method and Description |
---|---|
static <T> TypeInformation<T> |
TypeExtractor.getPartitionerTypes(Partitioner<T> partitioner) |
static <T> TypeInformation<T> |
TypeExtractor.getPartitionerTypes(Partitioner<T> partitioner,
String functionName,
boolean allowMissing) |
Modifier and Type | Method and Description |
---|---|
<K> Partitioner<K> |
GroupedDataSet.getCustomPartitioner()
Gets the custom partitioner to be used for this grouping, or null, if
none was defined.
|
<K> Partitioner<K> |
JoinDataSet.getPartitioner()
Gets the custom partitioner used by this join, or null, if none is set.
|
<K> Partitioner<K> |
CoGroupDataSet.getPartitioner()
Gets the custom partitioner used by this join, or null, if none is set.
|
Modifier and Type | Method and Description |
---|---|
static <K> DataSet<T> |
CrossDataSet.partitionCustom(Partitioner<K> partitioner,
scala.Function1<T,K> fun,
TypeInformation<K> evidence$39) |
<K> DataSet<T> |
DataSet.partitionCustom(Partitioner<K> partitioner,
scala.Function1<T,K> fun,
TypeInformation<K> evidence$39)
Partitions a DataSet on the key returned by the selector, using a custom partitioner.
|
static <K> DataSet<T> |
CrossDataSet.partitionCustom(Partitioner<K> partitioner,
int field,
TypeInformation<K> evidence$37) |
<K> DataSet<T> |
DataSet.partitionCustom(Partitioner<K> partitioner,
int field,
TypeInformation<K> evidence$37)
Partitions a tuple DataSet on the specified key fields using a custom partitioner.
|
static <K> DataSet<T> |
CrossDataSet.partitionCustom(Partitioner<K> partitioner,
String field,
TypeInformation<K> evidence$38) |
<K> DataSet<T> |
DataSet.partitionCustom(Partitioner<K> partitioner,
String field,
TypeInformation<K> evidence$38)
Partitions a POJO DataSet on the specified key fields using a custom partitioner.
|
<K> GroupedDataSet<T> |
GroupedDataSet.withPartitioner(Partitioner<K> partitioner,
TypeInformation<K> evidence$3)
Sets a custom partitioner for the grouping.
|
<K> JoinDataSet<L,R> |
JoinDataSet.withPartitioner(Partitioner<K> partitioner,
TypeInformation<K> evidence$9) |
<K> CoGroupDataSet<L,R> |
CoGroupDataSet.withPartitioner(Partitioner<K> partitioner,
TypeInformation<K> evidence$7) |
<K> JoinFunctionAssigner<L,R> |
JoinFunctionAssigner.withPartitioner(Partitioner<K> part,
TypeInformation<K> evidence$19) |
Modifier and Type | Class and Description |
---|---|
static class |
FlinkMLTools.ModuloKeyPartitioner$
Distributes the elements by taking the modulo of their keys and assigning it to this channel
|
Modifier and Type | Method and Description |
---|---|
static <T> DataSet<Block<T>> |
FlinkMLTools.block(DataSet<T> input,
int numBlocks,
scala.Option<Partitioner<Object>> partitionerOption,
TypeInformation<T> evidence$31,
scala.reflect.ClassTag<T> evidence$32)
Groups the DataSet input into numBlocks blocks.
|
<T> DataSet<Block<T>> |
FlinkMLTools$.block(DataSet<T> input,
int numBlocks,
scala.Option<Partitioner<Object>> partitionerOption,
TypeInformation<T> evidence$31,
scala.reflect.ClassTag<T> evidence$32)
Groups the DataSet input into numBlocks blocks.
|
Modifier and Type | Class and Description |
---|---|
static class |
ALS.BlockIDPartitioner |
Modifier and Type | Method and Description |
---|---|
static DataSet<scala.Tuple2<Object,double[][]>> |
ALS.updateFactors(int numUserBlocks,
DataSet<scala.Tuple2<Object,double[][]>> items,
DataSet<scala.Tuple2<Object,ALS.OutBlockInformation>> itemOut,
DataSet<scala.Tuple2<Object,ALS.InBlockInformation>> userIn,
int factors,
double lambda,
Partitioner<Object> blockIDPartitioner)
Calculates a single half step of the ALS optimization.
|
DataSet<scala.Tuple2<Object,double[][]>> |
ALS$.updateFactors(int numUserBlocks,
DataSet<scala.Tuple2<Object,double[][]>> items,
DataSet<scala.Tuple2<Object,ALS.OutBlockInformation>> itemOut,
DataSet<scala.Tuple2<Object,ALS.InBlockInformation>> userIn,
int factors,
double lambda,
Partitioner<Object> blockIDPartitioner)
Calculates a single half step of the ALS optimization.
|
Constructor and Description |
---|
PartitionDescriptor(PartitionOperatorBase.PartitionMethod pMethod,
FieldSet pKeys,
Ordering ordering,
Partitioner<?> customPartitioner,
DataDistribution distribution) |
Modifier and Type | Method and Description |
---|---|
Partitioner<?> |
RequestedGlobalProperties.getCustomPartitioner()
Gets the custom partitioner associated with these properties.
|
Partitioner<?> |
GlobalProperties.getCustomPartitioner() |
Modifier and Type | Method and Description |
---|---|
void |
GlobalProperties.setCustomPartitioned(FieldList partitionedFields,
Partitioner<?> partitioner) |
void |
RequestedGlobalProperties.setCustomPartitioned(FieldSet partitionedFields,
Partitioner<?> partitioner)
Sets these properties to request a custom partitioning with the given
Partitioner instance. |
Modifier and Type | Method and Description |
---|---|
void |
CoGroupDescriptor.setCustomPartitioner(Partitioner<?> customPartitioner) |
void |
AbstractJoinDescriptor.setCustomPartitioner(Partitioner<?> partitioner) |
Constructor and Description |
---|
GroupReduceProperties(FieldSet groupKeys,
Ordering additionalOrderKeys,
Partitioner<?> customPartitioner) |
GroupReduceProperties(FieldSet keys,
Partitioner<?> customPartitioner) |
GroupReduceWithCombineProperties(FieldSet groupKeys,
Ordering additionalOrderKeys,
Partitioner<?> customPartitioner) |
GroupReduceWithCombineProperties(FieldSet groupKeys,
Partitioner<?> customPartitioner) |
ReduceProperties(FieldSet keys,
Partitioner<?> customPartitioner,
DriverStrategy combinerStrategy) |
Modifier and Type | Method and Description |
---|---|
Partitioner<?> |
Channel.getPartitioner() |
Modifier and Type | Method and Description |
---|---|
void |
Channel.setShipStrategy(ShipStrategyType strategy,
FieldList keys,
boolean[] sortDirection,
Partitioner<?> partitioner,
DataExchangeMode dataExchangeMode) |
void |
Channel.setShipStrategy(ShipStrategyType strategy,
FieldList keys,
Partitioner<?> partitioner,
DataExchangeMode dataExchangeMode) |
Constructor and Description |
---|
OutputEmitter(ShipStrategyType strategy,
int indexInSubtaskGroup,
TypeComparator<T> comparator,
Partitioner<?> partitioner,
DataDistribution distribution) |
Modifier and Type | Method and Description |
---|---|
Partitioner<?> |
TaskConfig.getOutputPartitioner(int outputNum,
ClassLoader cl) |
Modifier and Type | Method and Description |
---|---|
void |
TaskConfig.setOutputPartitioner(Partitioner<?> partitioner,
int outputNum) |
Modifier and Type | Method and Description |
---|---|
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
int field)
Partitions a tuple DataStream on the specified key fields using a custom partitioner.
|
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
KeySelector<T,K> keySelector)
Partitions a DataStream on the key returned by the selector, using a custom partitioner.
|
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
String field)
Partitions a POJO DataStream on the specified key fields using a custom partitioner.
|
Modifier and Type | Method and Description |
---|---|
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
scala.Function1<T,K> fun,
TypeInformation<K> evidence$5)
Partitions a DataStream on the key returned by the selector, using a custom partitioner.
|
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
int field,
TypeInformation<K> evidence$3)
Partitions a tuple DataStream on the specified key fields using a custom partitioner.
|
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
String field,
TypeInformation<K> evidence$4)
Partitions a POJO DataStream on the specified key fields using a custom partitioner.
|
Constructor and Description |
---|
CustomPartitionerWrapper(Partitioner<K> partitioner,
KeySelector<T,K> keySelector) |
Modifier and Type | Method and Description |
---|---|
static <X,K> KeySelector<X,K> |
KeySelectorUtil.getSelectorForOneKey(Keys<X> keys,
Partitioner<K> partitioner,
TypeInformation<X> typeInfo,
ExecutionConfig executionConfig) |
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.