public class AppendOnlyTopNFunction extends AbstractTopNFunction
KeyedProcessFunction.Context, KeyedProcessFunction.OnTimerContext
hitCount, inputRowType, keyContext, outputRankNumber, rankEnd, requestCount, sortKeyComparator, sortKeySelector
stateCleaningEnabled
Constructor and Description |
---|
AppendOnlyTopNFunction(long minRetentionTime,
long maxRetentionTime,
BaseRowTypeInfo inputRowType,
GeneratedRecordComparator sortKeyGeneratedRecordComparator,
BaseRowKeySelector sortKeySelector,
RankType rankType,
RankRange rankRange,
boolean generateRetraction,
boolean outputRankNumber,
long cacheSize) |
Modifier and Type | Method and Description |
---|---|
void |
onTimer(long timestamp,
KeyedProcessFunction.OnTimerContext ctx,
Collector<BaseRow> out)
Called when a timer set using
TimerService fires. |
void |
open(Configuration parameters)
Initialization method for the function.
|
void |
processElement(BaseRow input,
KeyedProcessFunction.Context context,
Collector<BaseRow> out)
Process one element from the input stream.
|
checkSortKeyInBufferRange, collect, collect, delete, delete, getDefaultTopNSize, hasOffset, initRankEnd, isInRankEnd, isInRankRange, registerMetric, retract, setKeyContext
cleanupState, initCleanupTimeState, isProcessingTimeTimer, needToCleanupState, registerProcessingCleanupTimer
close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
registerProcessingCleanupTimer
public AppendOnlyTopNFunction(long minRetentionTime, long maxRetentionTime, BaseRowTypeInfo inputRowType, GeneratedRecordComparator sortKeyGeneratedRecordComparator, BaseRowKeySelector sortKeySelector, RankType rankType, RankRange rankRange, boolean generateRetraction, boolean outputRankNumber, long cacheSize)
public void open(Configuration parameters) throws Exception
RichFunction
The configuration object passed to the function can be used for configuration and initialization. The configuration contains all parameters that were configured on the function in the program composition.
public class MyFilter extends RichFilterFunction<String> {
private String searchString;
public void open(Configuration parameters) {
this.searchString = parameters.getString("foo");
}
public boolean filter(String value) {
return value.equals(searchString);
}
}
By default, this method does nothing.
open
in interface RichFunction
open
in class AbstractTopNFunction
parameters
- The configuration containing the parameters attached to the contract.Exception
- Implementations may forward exceptions, which are caught by the runtime. When the
runtime catches an exception, it aborts the task and lets the fail-over logic
decide whether to retry the task execution.Configuration
public void processElement(BaseRow input, KeyedProcessFunction.Context context, Collector<BaseRow> out) throws Exception
KeyedProcessFunction
This function can output zero or more elements using the Collector
parameter
and also update internal state or set timers using the KeyedProcessFunction.Context
parameter.
processElement
in class KeyedProcessFunction<BaseRow,BaseRow,BaseRow>
input
- The input value.context
- A KeyedProcessFunction.Context
that allows querying the timestamp of the element and getting
a TimerService
for registering timers and querying the time. The
context is only valid during the invocation of this method, do not store it.out
- The collector for returning result values.Exception
- This method may throw exceptions. Throwing an exception will cause the operation
to fail and may trigger recovery.public void onTimer(long timestamp, KeyedProcessFunction.OnTimerContext ctx, Collector<BaseRow> out) throws Exception
KeyedProcessFunction
TimerService
fires.onTimer
in class KeyedProcessFunction<BaseRow,BaseRow,BaseRow>
timestamp
- The timestamp of the firing timer.ctx
- An KeyedProcessFunction.OnTimerContext
that allows querying the timestamp, the TimeDomain
, and the key
of the firing timer and getting a TimerService
for registering timers and querying the time.
The context is only valid during the invocation of this method, do not store it.out
- The collector for returning result values.Exception
- This method may throw exceptions. Throwing an exception will cause the operation
to fail and may trigger recovery.Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.