org.apache.flink.streaming.api.operators

Class StreamTaskStateInitializerImpl

java.lang.Object

org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl

All Implemented Interfaces:

StreamTaskStateInitializer

public class StreamTaskStateInitializerImpl
extends Object
implements StreamTaskStateInitializer

This class is the main implementation of a StreamTaskStateInitializer. This class obtains the state to create StreamOperatorStateContext objects for stream operators from the TaskStateManager of the task that runs the stream task and hence the operator.

This implementation operates on top a TaskStateManager, from which it receives everything required to restore state in the backends from checkpoints or savepoints.

Constructor Summary

Constructors

Constructor and Description
StreamTaskStateInitializerImpl(Environment environment, StateBackend stateBackend)
StreamTaskStateInitializerImpl(Environment environment, StateBackend stateBackend, TtlTimeProvider ttlTimeProvider)

Method Summary

Modifier and Type	Method and Description
protected <K> InternalTimeServiceManager<K>	internalTimeServiceManager(AbstractKeyedStateBackend<K> keyedStatedBackend, KeyContext keyContext, ProcessingTimeService processingTimeService, Iterable<KeyGroupStatePartitionStreamProvider> rawKeyedStates)
protected <K> AbstractKeyedStateBackend<K>	keyedStatedBackend(TypeSerializer<K> keySerializer, String operatorIdentifierText, PrioritizedOperatorSubtaskState prioritizedOperatorSubtaskStates, CloseableRegistry backendCloseableRegistry, MetricGroup metricGroup)
protected OperatorStateBackend	operatorStateBackend(String operatorIdentifierText, PrioritizedOperatorSubtaskState prioritizedOperatorSubtaskStates, CloseableRegistry backendCloseableRegistry)
protected CloseableIterable<KeyGroupStatePartitionStreamProvider>	rawKeyedStateInputs(Iterator<StateObjectCollection<KeyedStateHandle>> restoreStateAlternatives)
protected CloseableIterable<StatePartitionStreamProvider>	rawOperatorStateInputs(Iterator<StateObjectCollection<OperatorStateHandle>> restoreStateAlternatives)
StreamOperatorStateContext	streamOperatorStateContext(OperatorID operatorID, String operatorClassName, ProcessingTimeService processingTimeService, KeyContext keyContext, TypeSerializer<?> keySerializer, CloseableRegistry streamTaskCloseableRegistry, MetricGroup metricGroup, boolean isUsingCustomRawKeyedState) Returns the StreamOperatorStateContext for an AbstractStreamOperator that runs in the stream task that owns this manager.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamTaskStateInitializerImpl

public StreamTaskStateInitializerImpl(Environment environment,
                                      StateBackend stateBackend)

StreamTaskStateInitializerImpl

@VisibleForTesting
public StreamTaskStateInitializerImpl(Environment environment,
                                                         StateBackend stateBackend,
                                                         TtlTimeProvider ttlTimeProvider)

Method Detail

streamOperatorStateContext

public StreamOperatorStateContext streamOperatorStateContext(@Nonnull
                                                             OperatorID operatorID,
                                                             @Nonnull
                                                             String operatorClassName,
                                                             @Nonnull
                                                             ProcessingTimeService processingTimeService,
                                                             @Nonnull
                                                             KeyContext keyContext,
                                                             @Nullable
                                                             TypeSerializer<?> keySerializer,
                                                             @Nonnull
                                                             CloseableRegistry streamTaskCloseableRegistry,
                                                             @Nonnull
                                                             MetricGroup metricGroup,
                                                             boolean isUsingCustomRawKeyedState)
                                                      throws Exception

Description copied from interface: StreamTaskStateInitializer

Returns the StreamOperatorStateContext for an AbstractStreamOperator that runs in the stream task that owns this manager.

Specified by:

streamOperatorStateContext in interface StreamTaskStateInitializer

Parameters:

operatorID - the id of the operator for which the context is created. Cannot be null.

operatorClassName - the classname of the operator instance for which the context is created. Cannot be null.

keyContext - the key context of the operator instance for which the context is created Cannot be null.

keySerializer - the key-serializer for the operator. Can be null.

streamTaskCloseableRegistry - the closeable registry to which created closeable objects will be registered.

metricGroup - the parent metric group for all statebackend metrics

isUsingCustomRawKeyedState - flag indicating whether or not the AbstractStreamOperator is writing custom raw keyed state.

Returns:

a context from which the given operator can initialize everything related to state.

Throws:

Exception - when something went wrong while creating the context.

internalTimeServiceManager

protected <K> InternalTimeServiceManager<K> internalTimeServiceManager(AbstractKeyedStateBackend<K> keyedStatedBackend,
                                                                       KeyContext keyContext,
                                                                       ProcessingTimeService processingTimeService,
                                                                       Iterable<KeyGroupStatePartitionStreamProvider> rawKeyedStates)
                                                                throws Exception

Throws:

Exception

operatorStateBackend

protected OperatorStateBackend operatorStateBackend(String operatorIdentifierText,
                                                    PrioritizedOperatorSubtaskState prioritizedOperatorSubtaskStates,
                                                    CloseableRegistry backendCloseableRegistry)
                                             throws Exception

Throws:

Exception

keyedStatedBackend

protected <K> AbstractKeyedStateBackend<K> keyedStatedBackend(TypeSerializer<K> keySerializer,
                                                              String operatorIdentifierText,
                                                              PrioritizedOperatorSubtaskState prioritizedOperatorSubtaskStates,
                                                              CloseableRegistry backendCloseableRegistry,
                                                              MetricGroup metricGroup)
                                                       throws Exception

Throws:

Exception

rawOperatorStateInputs

protected CloseableIterable<StatePartitionStreamProvider> rawOperatorStateInputs(Iterator<StateObjectCollection<OperatorStateHandle>> restoreStateAlternatives)

rawKeyedStateInputs

protected CloseableIterable<KeyGroupStatePartitionStreamProvider> rawKeyedStateInputs(Iterator<StateObjectCollection<KeyedStateHandle>> restoreStateAlternatives)