public class RowTimeMiniBatchDeduplicateFunction extends MapBundleFunction<K,V,IN,OUT>
Modifier and Type | Field and Description |
---|---|
protected long |
minRetentionTime |
protected ValueState<T> |
state |
protected TypeInformation<T> |
stateType |
ctx
Constructor and Description |
---|
RowTimeMiniBatchDeduplicateFunction(InternalTypeInfo<RowData> typeInfo,
TypeSerializer<RowData> serializer,
long minRetentionTime,
int rowtimeIndex,
boolean generateUpdateBefore,
boolean generateInsert,
boolean keepLastRow) |
Modifier and Type | Method and Description |
---|---|
List<RowData> |
addInput(List<RowData> value,
RowData input)
Adds the given input to the given value, returning the new bundle value.
|
void |
finishBundle(Map<RowData,List<RowData>> buffer,
Collector<RowData> out)
Called when a bundle is finished.
|
void |
open(ExecutionContext ctx) |
close
protected final TypeInformation<T> stateType
protected final long minRetentionTime
protected ValueState<T> state
public RowTimeMiniBatchDeduplicateFunction(InternalTypeInfo<RowData> typeInfo, TypeSerializer<RowData> serializer, long minRetentionTime, int rowtimeIndex, boolean generateUpdateBefore, boolean generateInsert, boolean keepLastRow)
public List<RowData> addInput(@Nullable List<RowData> value, RowData input) throws Exception
MapBundleFunction
public void finishBundle(Map<RowData,List<RowData>> buffer, Collector<RowData> out) throws Exception
MapBundleFunction
finishBundle
in class MapBundleFunction<RowData,List<RowData>,RowData,RowData>
Exception
public void open(ExecutionContext ctx) throws Exception
open
in class MapBundleFunction<K,V,IN,OUT>
Exception
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.