Package org.apache.flink.table.runtime.operators.deduplicate

Class RowTimeMiniBatchDeduplicateFunction

java.lang.Object

org.apache.flink.table.runtime.operators.bundle.MapBundleFunction<K,V,IN,OUT>

org.apache.flink.table.runtime.operators.deduplicate.RowTimeMiniBatchDeduplicateFunction

All Implemented Interfaces:

Serializable, Function

public class RowTimeMiniBatchDeduplicateFunction
extends MapBundleFunction<K,V,IN,OUT>

This function is used to get the first or last row for every key partition in miniBatch mode.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
protected long	minRetentionTime
protected ValueState<T>	state
protected TypeInformation<T>	stateType

Fields inherited from class org.apache.flink.table.runtime.operators.bundle.MapBundleFunction

ctx

Constructor Summary

Constructors

Constructor	Description
RowTimeMiniBatchDeduplicateFunction(InternalTypeInfo<RowData> typeInfo, TypeSerializer<RowData> serializer, long minRetentionTime, int rowtimeIndex, boolean generateUpdateBefore, boolean generateInsert, boolean keepLastRow)

Method Summary

Modifier and Type	Method	Description
List<RowData>	addInput(List<RowData> value, RowData input)	Adds the given input to the given value, returning the new bundle value.
void	finishBundle(Map<RowData,List<RowData>> buffer, Collector<RowData> out)	Called when a bundle is finished.
void	open(ExecutionContext ctx)

Methods inherited from class org.apache.flink.table.runtime.operators.bundle.MapBundleFunction

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

stateType

protected final TypeInformation<T> stateType

minRetentionTime

protected final long minRetentionTime

state

protected ValueState<T> state

Constructor Detail

RowTimeMiniBatchDeduplicateFunction

public RowTimeMiniBatchDeduplicateFunction(InternalTypeInfo<RowData> typeInfo,
                                           TypeSerializer<RowData> serializer,
                                           long minRetentionTime,
                                           int rowtimeIndex,
                                           boolean generateUpdateBefore,
                                           boolean generateInsert,
                                           boolean keepLastRow)

Method Detail

addInput

public List<RowData> addInput(@Nullable
                              List<RowData> value,
                              RowData input)
                       throws Exception

Description copied from class: MapBundleFunction

Adds the given input to the given value, returning the new bundle value.

Specified by:

addInput in class MapBundleFunction<RowData,List<RowData>,RowData,RowData>

Parameters:

value - the existing bundle value, maybe null

input - the given input, not null

Throws:

Exception

finishBundle

public void finishBundle(Map<RowData,List<RowData>> buffer,
                         Collector<RowData> out)
                  throws Exception

Description copied from class: MapBundleFunction

Called when a bundle is finished. Transform a bundle to zero, one, or more output elements.

Specified by:

finishBundle in class MapBundleFunction<RowData,List<RowData>,RowData,RowData>

Throws:

Exception

open

public void open(ExecutionContext ctx)
          throws Exception

Overrides:

open in class MapBundleFunction<K,V,IN,OUT>

Throws:

Exception