org.apache.flink.table.runtime.operators.deduplicate

Class RowTimeMiniBatchLatestChangeDeduplicateFunction

java.lang.Object

org.apache.flink.table.runtime.operators.bundle.MapBundleFunction<K,V,IN,OUT>

org.apache.flink.table.runtime.operators.deduplicate.RowTimeMiniBatchLatestChangeDeduplicateFunction

All Implemented Interfaces:

Serializable, Function

public class RowTimeMiniBatchLatestChangeDeduplicateFunction
extends MapBundleFunction<K,V,IN,OUT>

This function is used to get the first or last row for every key partition in miniBatch mode. But only send latest change log to downstream.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected long	minRetentionTime
protected ValueState<T>	state
protected TypeInformation<T>	stateType

Fields inherited from class org.apache.flink.table.runtime.operators.bundle.MapBundleFunction

ctx

Constructor Summary

Constructors

Constructor and Description
RowTimeMiniBatchLatestChangeDeduplicateFunction(InternalTypeInfo<RowData> typeInfo, TypeSerializer<RowData> serializer, long minRetentionTime, int rowtimeIndex, boolean generateUpdateBefore, boolean generateInsert, boolean keepLastRow)

Method Summary

Modifier and Type	Method and Description
RowData	addInput(RowData value, RowData input) Adds the given input to the given value, returning the new bundle value.
void	finishBundle(Map<RowData,RowData> buffer, Collector<RowData> out) Called when a bundle is finished.
void	open(ExecutionContext ctx)

Methods inherited from class org.apache.flink.table.runtime.operators.bundle.MapBundleFunction

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

stateType

protected final TypeInformation<T> stateType

minRetentionTime

protected final long minRetentionTime

state

protected ValueState<T> state

Constructor Detail

RowTimeMiniBatchLatestChangeDeduplicateFunction

public RowTimeMiniBatchLatestChangeDeduplicateFunction(InternalTypeInfo<RowData> typeInfo,
                                                       TypeSerializer<RowData> serializer,
                                                       long minRetentionTime,
                                                       int rowtimeIndex,
                                                       boolean generateUpdateBefore,
                                                       boolean generateInsert,
                                                       boolean keepLastRow)

Method Detail

addInput

public RowData addInput(@Nullable
                        RowData value,
                        RowData input)
                 throws Exception

Description copied from class: MapBundleFunction

Adds the given input to the given value, returning the new bundle value.

Specified by:

addInput in class MapBundleFunction<RowData,RowData,RowData,RowData>

Parameters:

value - the existing bundle value, maybe null

input - the given input, not null

Throws:

Exception

finishBundle

public void finishBundle(Map<RowData,RowData> buffer,
                         Collector<RowData> out)
                  throws Exception

Description copied from class: MapBundleFunction

Called when a bundle is finished. Transform a bundle to zero, one, or more output elements.

Specified by:

finishBundle in class MapBundleFunction<RowData,RowData,RowData,RowData>

Throws:

Exception

open

public void open(ExecutionContext ctx)
          throws Exception

Overrides:

open in class MapBundleFunction<K,V,IN,OUT>

Throws:

Exception