@PublicEvolving public class HashMapStateBackend extends AbstractStateBackend implements ConfigurableStateBackend
CheckpointStorage.
Working state is kept on the TaskManager heap. If a TaskManager executes multiple tasks concurrently (if the TaskManager has multiple slots, or if slot-sharing is used) then the aggregate state of all tasks needs to fit into that TaskManager's memory.
As for all state backends, this backend can either be configured within the application (by creating the backend with the respective constructor parameters and setting it on the execution environment) or by specifying it in the Flink configuration.
If the state backend was specified in the application, it may pick up additional configuration
parameters from the Flink configuration. For example, if the backend if configured in the
application without a default savepoint directory, it will pick up a default savepoint directory
specified in the Flink configuration of the running job/cluster. That behavior is implemented via
the configure(ReadableConfig, ClassLoader) method.
latencyTrackingConfigBuilder| Constructor and Description |
|---|
HashMapStateBackend()
Creates a new state backend.
|
| Modifier and Type | Method and Description |
|---|---|
HashMapStateBackend |
configure(ReadableConfig config,
ClassLoader classLoader)
Creates a variant of the state backend that applies additional configuration parameters.
|
<K> AbstractKeyedStateBackend<K> |
createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry)
Creates a new
CheckpointableKeyedStateBackend that is responsible for holding
keyed state and checkpointing it. |
OperatorStateBackend |
createOperatorStateBackend(Environment env,
String operatorIdentifier,
Collection<OperatorStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry)
Creates a new
OperatorStateBackend that can be used for storing operator state. |
boolean |
supportsNoClaimRestoreMode()
Tells if a state backend supports the
RestoreMode.NO_CLAIM mode. |
boolean |
supportsSavepointFormat(SavepointFormatType formatType) |
getCompressionDecoratorclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitcreateKeyedStateBackend, getName, useManagedMemorypublic HashMapStateBackend configure(ReadableConfig config, ClassLoader classLoader) throws IllegalConfigurationException
ConfigurableStateBackendSettings that were directly done on the original state backend object in the application program typically have precedence over setting picked up from the configuration.
If no configuration is applied, or if the method directly applies configuration values to the (mutable) state backend object, this method may return the original state backend object. Otherwise it typically returns a modified copy.
configure in interface ConfigurableStateBackendconfig - The configuration to pick the values from.classLoader - The class loader that should be used to load the state backend.IllegalConfigurationException - Thrown if the configuration contained invalid entries.public boolean supportsNoClaimRestoreMode()
StateBackendRestoreMode.NO_CLAIM mode.
If a state backend supports NO_CLAIM mode, it should create an independent
snapshot when it receives CheckpointType.FULL_CHECKPOINT in Snapshotable.snapshot(long, long, CheckpointStreamFactory, CheckpointOptions).
supportsNoClaimRestoreMode in interface StateBackendRestoreMode.NO_CLAIM mode.public boolean supportsSavepointFormat(SavepointFormatType formatType)
supportsSavepointFormat in interface StateBackendpublic <K> AbstractKeyedStateBackend<K> createKeyedStateBackend(Environment env, JobID jobID, String operatorIdentifier, TypeSerializer<K> keySerializer, int numberOfKeyGroups, KeyGroupRange keyGroupRange, TaskKvStateRegistry kvStateRegistry, TtlTimeProvider ttlTimeProvider, MetricGroup metricGroup, @Nonnull Collection<KeyedStateHandle> stateHandles, CloseableRegistry cancelStreamRegistry) throws IOException
StateBackendCheckpointableKeyedStateBackend that is responsible for holding
keyed state and checkpointing it.
Keyed State is state where each value is bound to a key.
createKeyedStateBackend in interface StateBackendcreateKeyedStateBackend in class AbstractStateBackendK - The type of the keys by which the state is organized.env - The environment of the task.jobID - The ID of the job that the task belongs to.operatorIdentifier - The identifier text of the operator.keySerializer - The key-serializer for the operator.numberOfKeyGroups - The number of key-groups aka max parallelism.keyGroupRange - Range of key-groups for which the to-be-created backend is responsible.kvStateRegistry - KvStateRegistry helper for this task.ttlTimeProvider - Provider for TTL logic to judge about state expiration.metricGroup - The parent metric group for all state backend metrics.stateHandles - The state handles for restore.cancelStreamRegistry - The registry to which created closeable objects will be
registered during restore.IOExceptionpublic OperatorStateBackend createOperatorStateBackend(Environment env, String operatorIdentifier, @Nonnull Collection<OperatorStateHandle> stateHandles, CloseableRegistry cancelStreamRegistry) throws BackendBuildingException
StateBackendOperatorStateBackend that can be used for storing operator state.
Operator state is state that is associated with parallel operator (or function) instances, rather than with keys.
createOperatorStateBackend in interface StateBackendcreateOperatorStateBackend in class AbstractStateBackendenv - The runtime environment of the executing task.operatorIdentifier - The identifier of the operator whose state should be stored.stateHandles - The state handles for restore.cancelStreamRegistry - The registry to register streams to close if task canceled.BackendBuildingExceptionCopyright © 2014–2024 The Apache Software Foundation. All rights reserved.