org.apache.flink.streaming.api.functions.source

Class MultipleIdsMessageAcknowledgingSourceBase<Type,UId,SessionId>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichSourceFunction<Type>

org.apache.flink.streaming.api.functions.source.MessageAcknowledgingSourceBase<Type,UId>

org.apache.flink.streaming.api.functions.source.MultipleIdsMessageAcknowledgingSourceBase<Type,UId,SessionId>

Type Parameters:

Type - The type of the messages created by the source.

UId - The type of the unique IDs which are consistent across sessions.

SessionId - The type of the IDs that are used for acknowledging elements (ids valid during session).

All Implemented Interfaces:

Serializable, Function, RichFunction, CheckpointListener, CheckpointedFunction, SourceFunction<Type>

Deprecated.

This class is based on the SourceFunction API, which is due to be removed. Use the new Source API instead.

@Deprecated
 @PublicEvolving
public abstract class MultipleIdsMessageAcknowledgingSourceBase<Type,UId,SessionId>
extends MessageAcknowledgingSourceBase<Type,UId>

Abstract base class for data sources that receive elements from a message queue and acknowledge them back by IDs. In contrast to MessageAcknowledgingSourceBase, this source handles two types of ids:

1. Session ids
2. Unique message ids

Session ids are used to acknowledge messages in a session. When a checkpoint is restored, unacknowledged messages are redelivered. Duplicates are detected using the unique message ids which are checkpointed.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

SourceFunction.SourceContext<T>

Field Summary

Fields

Modifier and Type	Field and Description
protected List<SessionId>	sessionIds Deprecated.
protected Deque<Tuple2<Long,List<SessionId>>>	sessionIdsPerSnapshot Deprecated.

Fields inherited from class org.apache.flink.streaming.api.functions.source.MessageAcknowledgingSourceBase

pendingCheckpoints

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	MultipleIdsMessageAcknowledgingSourceBase(Class<UId> idClass) Deprecated. Creates a new MessageAcknowledgingSourceBase for IDs of the given type.
protected	MultipleIdsMessageAcknowledgingSourceBase(TypeInformation<UId> idTypeInfo) Deprecated. Creates a new MessageAcknowledgingSourceBase for IDs of the given type.

Method Summary

Modifier and Type	Method and Description
protected void	acknowledgeIDs(long checkpointId, Set<UId> uniqueIds) Deprecated. Acknowledges the session ids.
protected abstract void	acknowledgeSessionIDs(List<SessionId> sessionIds) Deprecated. Acknowledges the session ids.
void	close() Deprecated. Tear-down method for the user code.
void	open(Configuration parameters) Deprecated. This method is deprecated since Flink 1.19. The users are recommended to implement open(OpenContext openContext) and override open(Configuration parameters) with an empty body instead. 1. If you implement open(OpenContext openContext), the open(OpenContext openContext) will be invoked and the open(Configuration parameters) won't be invoked. 2. If you don't implement open(OpenContext openContext), the open(Configuration parameters) will be invoked in the default implementation of the open(OpenContext openContext).
void	snapshotState(FunctionSnapshotContext context) Deprecated. This method is called when a snapshot for a checkpoint is requested.

Methods inherited from class org.apache.flink.streaming.api.functions.source.MessageAcknowledgingSourceBase

addId, initializeState, notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

cancel, run

Methods inherited from interface org.apache.flink.api.common.functions.RichFunction

open

Field Detail

sessionIdsPerSnapshot

protected transient Deque<Tuple2<Long,List<SessionId>>> sessionIdsPerSnapshot

Deprecated.

sessionIds

protected transient List<SessionId> sessionIds

Deprecated.

Constructor Detail

MultipleIdsMessageAcknowledgingSourceBase

protected MultipleIdsMessageAcknowledgingSourceBase(Class<UId> idClass)

Deprecated.

Creates a new MessageAcknowledgingSourceBase for IDs of the given type.

Parameters:

idClass - The class of the message ID type, used to create a serializer for the message IDs.

MultipleIdsMessageAcknowledgingSourceBase

protected MultipleIdsMessageAcknowledgingSourceBase(TypeInformation<UId> idTypeInfo)

Deprecated.

Creates a new MessageAcknowledgingSourceBase for IDs of the given type.

Parameters:

idTypeInfo - The type information of the message ID type, used to create a serializer for the message IDs.

Method Detail

open

@Deprecated
public void open(Configuration parameters)
                      throws Exception

Deprecated. This method is deprecated since Flink 1.19. The users are recommended to implement open(OpenContext openContext) and override open(Configuration parameters) with an empty body instead. 1. If you implement open(OpenContext openContext), the open(OpenContext openContext) will be invoked and the open(Configuration parameters) won't be invoked. 2. If you don't implement open(OpenContext openContext), the open(Configuration parameters) will be invoked in the default implementation of the open(OpenContext openContext).

Initialization method for the MultipleIdsMessageAcknowledgingSourceBase.

Specified by:

open in interface RichFunction

Overrides:

open in class AbstractRichFunction

Parameters:

parameters - The configuration containing the parameters attached to the contract.

Throws:

Exception - if an error happens.

See Also:

FLIP-344: Remove parameter in RichFunction#open

close

public void close()
           throws Exception

Deprecated.

Description copied from interface: RichFunction

Tear-down method for the user code. It is called after the last call to the main working methods (e.g. map or join). For functions that are part of an iteration, this method will be invoked after each iteration superstep.

This method can be used for clean up work.

Specified by:

close in interface RichFunction

Overrides:

close in class MessageAcknowledgingSourceBase<Type,UId>

Throws:

Exception - Implementations may forward exceptions, which are caught by the runtime. When the runtime catches an exception, it aborts the task and lets the fail-over logic decide whether to retry the task execution.

acknowledgeIDs

protected final void acknowledgeIDs(long checkpointId,
                                    Set<UId> uniqueIds)

Deprecated.

Acknowledges the session ids.

Specified by:

acknowledgeIDs in class MessageAcknowledgingSourceBase<Type,UId>

Parameters:

checkpointId - The id of the current checkout to acknowledge ids for.

uniqueIds - The checkpointed unique ids which are ignored here. They only serve as a means of de-duplicating messages when the acknowledgment after a checkpoint fails.

acknowledgeSessionIDs

protected abstract void acknowledgeSessionIDs(List<SessionId> sessionIds)

Deprecated.

Acknowledges the session ids.

Parameters:

sessionIds - The message ids for this session.

snapshotState

public void snapshotState(FunctionSnapshotContext context)
                   throws Exception

Deprecated.

Description copied from interface: CheckpointedFunction

This method is called when a snapshot for a checkpoint is requested. This acts as a hook to the function to ensure that all state is exposed by means previously offered through FunctionInitializationContext when the Function was initialized, or offered now by FunctionSnapshotContext itself.

Specified by:

snapshotState in interface CheckpointedFunction

Overrides:

snapshotState in class MessageAcknowledgingSourceBase<Type,UId>

Parameters:

context - the context for drawing a snapshot of the operator

Throws:

Exception - Thrown, if state could not be created ot restored.