public class DataSetSlideWindowAggReduceGroupFunction extends RichGroupReduceFunction<Row,Row> implements Compiler<GeneratedAggregations>, Logging
GroupReduceOperator
.
It is used for sliding on batch for both time and count-windows.
param: genAggregations Code-generated GeneratedAggregations
param: keysAndAggregatesArity The total arity of keys and aggregates
param: finalRowWindowStartPos relative window-start position to last field of output row
param: finalRowWindowEndPos relative window-end position to last field of output row
param: windowSize size of the window, used to determine window-end for output row
Constructor and Description |
---|
DataSetSlideWindowAggReduceGroupFunction(GeneratedAggregationsFunction genAggregations,
int keysAndAggregatesArity,
scala.Option<Object> finalRowWindowStartPos,
scala.Option<Object> finalRowWindowEndPos,
long windowSize) |
Modifier and Type | Method and Description |
---|---|
protected Row |
accumulators() |
protected GeneratedAggregations |
function() |
void |
open(Configuration config)
Initialization method for the function.
|
void |
reduce(Iterable<Row> records,
Collector<Row> out)
The reduce method.
|
protected int |
windowStartPos() |
close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
public DataSetSlideWindowAggReduceGroupFunction(GeneratedAggregationsFunction genAggregations, int keysAndAggregatesArity, scala.Option<Object> finalRowWindowStartPos, scala.Option<Object> finalRowWindowEndPos, long windowSize)
protected int windowStartPos()
protected Row accumulators()
protected GeneratedAggregations function()
public void open(Configuration config)
RichFunction
The configuration object passed to the function can be used for configuration and initialization. The configuration contains all parameters that were configured on the function in the program composition.
public class MyMapper extends FilterFunction<String> {
private String searchString;
public void open(Configuration parameters) {
this.searchString = parameters.getString("foo");
}
public boolean filter(String value) {
return value.equals(searchString);
}
}
By default, this method does nothing.
open
in interface RichFunction
open
in class AbstractRichFunction
config
- The configuration containing the parameters attached to the contract.Configuration
public void reduce(Iterable<Row> records, Collector<Row> out)
GroupReduceFunction
reduce
in interface GroupReduceFunction<Row,Row>
reduce
in class RichGroupReduceFunction<Row,Row>
records
- All records that belong to the given input key.out
- The collector to hand results to.Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.