Modifier and Type | Class and Description |
---|---|
class |
RichMapPartitionFunction<I,O>
Rich variant of the
MapPartitionFunction . |
Modifier and Type | Class and Description |
---|---|
class |
MapPartitionOperatorBase<IN,OUT,FT extends MapPartitionFunction<IN,OUT>> |
Modifier and Type | Method and Description |
---|---|
<R> MapPartitionOperator<T,R> |
DataSet.mapPartition(MapPartitionFunction<T,R> mapPartition)
Applies a Map-style operation to the entire partition of the data.
|
Modifier and Type | Class and Description |
---|---|
class |
SampleInPartition<T>
SampleInPartition wraps the sample logic on the partition side (the first phase of distributed
sample algorithm).
|
class |
SampleWithFraction<T>
A map partition function wrapper for sampling algorithms with fraction, the sample algorithm
takes the partition iterator as input.
|
Modifier and Type | Field and Description |
---|---|
protected MapPartitionFunction<IN,OUT> |
MapPartitionOperator.function |
Modifier and Type | Method and Description |
---|---|
protected MapPartitionFunction<IN,OUT> |
MapPartitionOperator.getFunction() |
Modifier and Type | Method and Description |
---|---|
protected MapPartitionOperatorBase<IN,OUT,MapPartitionFunction<IN,OUT>> |
MapPartitionOperator.translateToDataFlow(Operator<IN> input) |
Constructor and Description |
---|
MapPartitionOperator(DataSet<IN> input,
TypeInformation<OUT> resultType,
MapPartitionFunction<IN,OUT> function,
String defaultName) |
Modifier and Type | Method and Description |
---|---|
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getMapPartitionReturnTypes(MapPartitionFunction<IN,OUT> mapPartitionInterface,
TypeInformation<IN> inType) |
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getMapPartitionReturnTypes(MapPartitionFunction<IN,OUT> mapPartitionInterface,
TypeInformation<IN> inType,
String functionName,
boolean allowMissing) |
Modifier and Type | Class and Description |
---|---|
class |
PythonMapPartition<IN,OUT>
Multi-purpose class, usable by all operations using a python script with one input source and possibly differing
in-/output types.
|
Modifier and Type | Method and Description |
---|---|
Class<MapPartitionFunction<IT,OT>> |
MapPartitionDriver.getStubType() |
Modifier and Type | Method and Description |
---|---|
void |
MapPartitionDriver.setup(TaskContext<MapPartitionFunction<IT,OT>,OT> context) |
Modifier and Type | Class and Description |
---|---|
class |
AssignRangeIndex<IN>
This mapPartition function require a DataSet with RangeBoundaries as broadcast input, it
generate Tuple2 which includes range index and record itself as output.
|
class |
RangeBoundaryBuilder<T>
Build RangeBoundaries with input records.
|
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.