@Internal public static final class AggregateOperator.AggregatingUdf<T extends Tuple> extends RichGroupReduceFunction<T,T> implements GroupCombineFunction<T,T>
Constructor and Description |
---|
AggregatingUdf(AggregationFunction<Object>[] aggFunctions,
int[] fieldPositions) |
Modifier and Type | Method and Description |
---|---|
void |
combine(Iterable<T> records,
Collector<T> out)
The combine method, called (potentially multiple timed) with subgroups of elements.
|
void |
open(Configuration parameters)
Initialization method for the function.
|
void |
reduce(Iterable<T> records,
Collector<T> out)
The reduce method.
|
close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
public AggregatingUdf(AggregationFunction<Object>[] aggFunctions, int[] fieldPositions)
public void open(Configuration parameters) throws Exception
RichFunction
The configuration object passed to the function can be used for configuration and initialization. The configuration contains all parameters that were configured on the function in the program composition.
public class MyMapper extends FilterFunction<String> {
private String searchString;
public void open(Configuration parameters) {
this.searchString = parameters.getString("foo");
}
public boolean filter(String value) {
return value.equals(searchString);
}
}
By default, this method does nothing.
open
in interface RichFunction
open
in class AbstractRichFunction
parameters
- The configuration containing the parameters attached to the contract.Exception
- Implementations may forward exceptions, which are caught by the runtime. When the
runtime catches an exception, it aborts the task and lets the fail-over logic
decide whether to retry the task execution.Configuration
public void reduce(Iterable<T> records, Collector<T> out)
GroupReduceFunction
public void combine(Iterable<T> records, Collector<T> out)
GroupCombineFunction
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.