@Internal public class OperatorSubtaskStateReducer extends RichGroupReduceFunction<TaggedOperatorSubtaskState,OperatorState>
OperatorSubtaskState
's for a particular operator into a
single OperatorState
.Constructor and Description |
---|
OperatorSubtaskStateReducer(OperatorID operatorID,
int maxParallelism) |
Modifier and Type | Method and Description |
---|---|
void |
open(Configuration parameters)
Initialization method for the function.
|
void |
reduce(Iterable<TaggedOperatorSubtaskState> values,
Collector<OperatorState> out)
The reduce method.
|
close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
public OperatorSubtaskStateReducer(OperatorID operatorID, int maxParallelism)
public void open(Configuration parameters) throws Exception
RichFunction
The configuration object passed to the function can be used for configuration and initialization. The configuration contains all parameters that were configured on the function in the program composition.
public class MyFilter extends RichFilterFunction<String> {
private String searchString;
public void open(Configuration parameters) {
this.searchString = parameters.getString("foo");
}
public boolean filter(String value) {
return value.equals(searchString);
}
}
By default, this method does nothing.
open
in interface RichFunction
open
in class AbstractRichFunction
parameters
- The configuration containing the parameters attached to the contract.Exception
- Implementations may forward exceptions, which are caught by the runtime.
When the runtime catches an exception, it aborts the task and lets the fail-over logic
decide whether to retry the task execution.Configuration
public void reduce(Iterable<TaggedOperatorSubtaskState> values, Collector<OperatorState> out)
GroupReduceFunction
reduce
in interface GroupReduceFunction<TaggedOperatorSubtaskState,OperatorState>
reduce
in class RichGroupReduceFunction<TaggedOperatorSubtaskState,OperatorState>
values
- All records that belong to the given input key.out
- The collector to hand results to.Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.