public class DataSetTumbleTimeWindowAggReduceGroupFunction extends RichGroupReduceFunction<Row,Row> implements Compiler<GeneratedAggregations>, Logging
GroupReduceOperator
. It is used for tumbling time-window
on batch.
param: genAggregations Code-generated GeneratedAggregations
param: windowSize Tumbling time window size
param: windowStartPos The relative window-start field position to the last field of output row
param: windowEndPos The relative window-end field position to the last field of output row
param: keysAndAggregatesArity The total arity of keys and aggregates
Constructor and Description |
---|
DataSetTumbleTimeWindowAggReduceGroupFunction(GeneratedAggregationsFunction genAggregations,
long windowSize,
scala.Option<Object> windowStartPos,
scala.Option<Object> windowEndPos,
int keysAndAggregatesArity) |
Modifier and Type | Method and Description |
---|---|
protected Row |
accumulators() |
protected Row |
aggregateBuffer() |
protected GeneratedAggregations |
function() |
void |
open(Configuration config)
Initialization method for the function.
|
void |
reduce(Iterable<Row> records,
Collector<Row> out)
The reduce method.
|
close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
public DataSetTumbleTimeWindowAggReduceGroupFunction(GeneratedAggregationsFunction genAggregations, long windowSize, scala.Option<Object> windowStartPos, scala.Option<Object> windowEndPos, int keysAndAggregatesArity)
protected Row aggregateBuffer()
protected Row accumulators()
protected GeneratedAggregations function()
public void open(Configuration config)
RichFunction
The configuration object passed to the function can be used for configuration and initialization. The configuration contains all parameters that were configured on the function in the program composition.
public class MyMapper extends FilterFunction<String> {
private String searchString;
public void open(Configuration parameters) {
this.searchString = parameters.getString("foo");
}
public boolean filter(String value) {
return value.equals(searchString);
}
}
By default, this method does nothing.
open
in interface RichFunction
open
in class AbstractRichFunction
config
- The configuration containing the parameters attached to the contract.Configuration
public void reduce(Iterable<Row> records, Collector<Row> out)
GroupReduceFunction
reduce
in interface GroupReduceFunction<Row,Row>
reduce
in class RichGroupReduceFunction<Row,Row>
records
- All records that belong to the given input key.out
- The collector to hand results to.Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.