Package org.apache.flink.streaming.api.functions.timestamps

Class BoundedOutOfOrdernessTimestampExtractor<T>

java.lang.Object

org.apache.flink.streaming.api.functions.timestamps.BoundedOutOfOrdernessTimestampExtractor<T>

All Implemented Interfaces:

Serializable, TimestampAssigner<T>, TimestampAssignerSupplier<T>, WatermarkGeneratorSupplier<T>, WatermarkStrategy<T>, WatermarkStrategyWithPeriodicWatermarks<T>

public abstract class BoundedOutOfOrdernessTimestampExtractor<T>
extends Object
implements WatermarkStrategyWithPeriodicWatermarks<T>

This is a WatermarkStrategyWithPeriodicWatermarks used to emit Watermarks that lag behind the element with the maximum timestamp (in event time) seen so far by a fixed amount of time, t_late. This can help reduce the number of elements that are ignored due to lateness when computing the final result for a given window, in the case where we know that elements arrive no later than t_late units of time after the watermark that signals that the system event-time has advanced past their (event-time) timestamp.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.api.common.eventtime.TimestampAssignerSupplier

TimestampAssignerSupplier.Context, TimestampAssignerSupplier.SupplierFromSerializableTimestampAssigner<T>

Nested classes/interfaces inherited from interface org.apache.flink.api.common.eventtime.WatermarkGeneratorSupplier

WatermarkGeneratorSupplier.Context

Field Summary

Fields inherited from interface org.apache.flink.api.common.eventtime.TimestampAssigner

NO_TIMESTAMP

Constructor Summary

Constructors

Constructor	Description
BoundedOutOfOrdernessTimestampExtractor(Duration maxOutOfOrderness)

Method Summary

Modifier and Type	Method	Description
abstract long	extractTimestamp(T element)	Extracts the timestamp from the given element.
long	extractTimestamp(T element, long previousElementTimestamp)	Assigns a timestamp to an element, in milliseconds since the Epoch.
Watermark	getCurrentWatermark()	Returns the current watermark.
long	getMaxOutOfOrdernessInMillis()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.eventtime.WatermarkStrategy

getAlignmentParameters, withIdleness, withTimestampAssigner, withTimestampAssigner, withWatermarkAlignment, withWatermarkAlignment

Methods inherited from interface org.apache.flink.streaming.runtime.operators.util.WatermarkStrategyWithPeriodicWatermarks

createTimestampAssigner, createWatermarkGenerator

Constructor Detail

BoundedOutOfOrdernessTimestampExtractor

public BoundedOutOfOrdernessTimestampExtractor(Duration maxOutOfOrderness)

Method Detail

getMaxOutOfOrdernessInMillis

public long getMaxOutOfOrdernessInMillis()

extractTimestamp

public abstract long extractTimestamp(T element)

Extracts the timestamp from the given element.

Parameters:

element - The element that the timestamp is extracted from.

Returns:

The new timestamp.

getCurrentWatermark

public final Watermark getCurrentWatermark()

Description copied from interface: WatermarkStrategyWithPeriodicWatermarks

Returns the current watermark. This method is periodically called by the system to retrieve the current watermark. The method may return null to indicate that no new Watermark is available.

The returned watermark will be emitted only if it is non-null and its timestamp is larger than that of the previously emitted watermark (to preserve the contract of ascending watermarks). If the current watermark is still identical to the previous one, no progress in event time has happened since the previous call to this method. If a null value is returned, or the timestamp of the returned watermark is smaller than that of the last emitted one, then no new watermark will be generated.

The interval in which this method is called and Watermarks are generated depends on ExecutionConfig.getAutoWatermarkInterval().

Specified by:

getCurrentWatermark in interface WatermarkStrategyWithPeriodicWatermarks<T>

Returns:

Null, if no watermark should be emitted, or the next watermark to emit.

See Also:

Watermark, ExecutionConfig.getAutoWatermarkInterval()

extractTimestamp

public final long extractTimestamp(T element,
                                   long previousElementTimestamp)

Description copied from interface: TimestampAssigner

Assigns a timestamp to an element, in milliseconds since the Epoch. This is independent of any particular time zone or calendar.

The method is passed the previously assigned timestamp of the element. That previous timestamp may have been assigned from a previous assigner. If the element did not carry a timestamp before, this value is TimestampAssigner.NO_TIMESTAMP (= Long.MIN_VALUE: -9223372036854775808L).

Specified by:

extractTimestamp in interface TimestampAssigner<T>

Parameters:

element - The element that the timestamp will be assigned to.

previousElementTimestamp - The current internal timestamp of the element, or a negative value, if no timestamp has been assigned yet.

Returns:

The new timestamp.