Modifier and Type | Method and Description |
---|---|
CloseableIterator<StateChange> |
StateChangeFormat.read(StreamStateHandle handle,
long offset) |
Modifier and Type | Method and Description |
---|---|
Map<StateHandleID,StreamStateHandle> |
RocksDBStateUploader.uploadFilesToCheckpointFs(Map<StateHandleID,Path> files,
CheckpointStreamFactory checkpointStreamFactory,
CheckpointedStateScope stateScope,
CloseableRegistry closeableRegistry,
CloseableRegistry tmpResourcesRegistry)
Upload all the files to checkpoint fileSystem using specified number of threads.
|
Modifier and Type | Method and Description |
---|---|
SortedMap<Long,Map<StateHandleID,StreamStateHandle>> |
RocksDBRestoreResult.getRestoredSstFiles() |
Constructor and Description |
---|
RocksDBRestoreResult(org.rocksdb.RocksDB db,
org.rocksdb.ColumnFamilyHandle defaultColumnFamilyHandle,
RocksDBNativeMetricMonitor nativeMetricMonitor,
long lastCompletedCheckpointId,
UUID backendUID,
SortedMap<Long,Map<StateHandleID,StreamStateHandle>> restoredSstFiles) |
Constructor and Description |
---|
RocksIncrementalSnapshotStrategy(org.rocksdb.RocksDB db,
ResourceGuard rocksDBResourceGuard,
TypeSerializer<K> keySerializer,
LinkedHashMap<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation,
KeyGroupRange keyGroupRange,
int keyGroupPrefixBytes,
LocalRecoveryConfig localRecoveryConfig,
CloseableRegistry cancelStreamRegistry,
File instanceBasePath,
UUID backendUID,
SortedMap<Long,Map<StateHandleID,StreamStateHandle>> uploadedStateHandles,
RocksDBStateUploader rocksDBStateUploader,
long lastCompletedCheckpointId) |
Modifier and Type | Method and Description |
---|---|
StreamStateHandle |
CompletedCheckpoint.getMetadataHandle() |
Modifier and Type | Method and Description |
---|---|
static StreamStateHandle |
MetadataV3Serializer.deserializeStreamStateHandle(DataInputStream dis) |
Modifier and Type | Method and Description |
---|---|
static void |
MetadataV3Serializer.serializeStreamStateHandle(StreamStateHandle stateHandle,
DataOutputStream dos) |
Modifier and Type | Class and Description |
---|---|
class |
NonClosingCheckpointOutputStream<T extends StreamStateHandle>
Abstract class to implement custom checkpoint output streams which should not be closable for
user code.
|
Modifier and Type | Interface and Description |
---|---|
interface |
OperatorStateHandle
Interface of a state handle for operator state.
|
Modifier and Type | Class and Description |
---|---|
class |
KeyGroupsSavepointStateHandle
A
KeyGroupsStateHandle that describes a savepoint in the unified format. |
class |
KeyGroupsStateHandle
A handle to the partitioned stream operator state after it has been checkpointed.
|
class |
OperatorStreamStateHandle
State handle for partitionable operator state.
|
class |
PlaceholderStreamStateHandle
A placeholder state handle for shared state that will replaced by an original that was created in
a previous checkpoint.
|
class |
RetrievableStreamStateHandle<T extends Serializable>
Wrapper around a
StreamStateHandle to make the referenced state object retrievable trough
a simple get call. |
Modifier and Type | Method and Description |
---|---|
abstract StreamStateHandle |
CheckpointStateOutputStream.closeAndGetHandle()
Closes the stream and gets a state handle that can create an input stream producing the data
written to this stream.
|
StreamStateHandle |
DuplicatingCheckpointOutputStream.closeAndGetHandle() |
StreamStateHandle |
DuplicatingCheckpointOutputStream.closeAndGetPrimaryHandle()
Returns the state handle from the
DuplicatingCheckpointOutputStream.primaryOutputStream . |
StreamStateHandle |
DuplicatingCheckpointOutputStream.closeAndGetSecondaryHandle()
Returns the state handle from the
DuplicatingCheckpointOutputStream.secondaryOutputStream . |
StreamStateHandle |
AbstractChannelStateHandle.getDelegate() |
StreamStateHandle |
OperatorStateHandle.getDelegateStateHandle()
Returns the underlying stream state handle that points to the state data.
|
StreamStateHandle |
KeyGroupsStateHandle.getDelegateStateHandle() |
StreamStateHandle |
OperatorStreamStateHandle.getDelegateStateHandle() |
StreamStateHandle |
CompletedCheckpointStorageLocation.getMetadataHandle()
Gets the state handle to the checkpoint's metadata.
|
StreamStateHandle |
IncrementalLocalKeyedStateHandle.getMetaDataState() |
StreamStateHandle |
IncrementalRemoteKeyedStateHandle.getMetaStateHandle() |
StreamStateHandle |
SharedStateRegistry.registerReference(SharedStateRegistryKey registrationKey,
StreamStateHandle state,
long checkpointID)
Register a reference to the given shared state in the registry.
|
StreamStateHandle |
SharedStateRegistryImpl.registerReference(SharedStateRegistryKey registrationKey,
StreamStateHandle state,
long checkpointID) |
Modifier and Type | Method and Description |
---|---|
SnapshotResult<StreamStateHandle> |
CheckpointStreamWithResultProvider.closeAndFinalizeCheckpointStreamResult()
Closes the stream ans returns a snapshot result with the stream handle(s).
|
SnapshotResult<StreamStateHandle> |
CheckpointStreamWithResultProvider.PrimaryStreamOnly.closeAndFinalizeCheckpointStreamResult() |
SnapshotResult<StreamStateHandle> |
CheckpointStreamWithResultProvider.PrimaryAndSecondaryStream.closeAndFinalizeCheckpointStreamResult() |
static Set<StreamStateHandle> |
AbstractChannelStateHandle.collectUniqueDelegates(Collection<? extends AbstractChannelStateHandle<?>>... collections) |
List<StreamStateHandle> |
CheckpointStateToolset.duplicate(List<StreamStateHandle> stateHandle)
Duplicates
StreamStateHandles into the path embedded inside of the
class. |
List<StreamStateHandle> |
NotDuplicatingCheckpointStateToolset.duplicate(List<StreamStateHandle> stateHandle) |
List<StreamStateHandle> |
CheckpointStreamFactory.duplicate(List<StreamStateHandle> stateHandles,
CheckpointedStateScope scope)
Duplicates
StreamStateHandle into the path corresponding to * the given CheckpointedStateScope . |
Map<StateHandleID,StreamStateHandle> |
IncrementalRemoteKeyedStateHandle.getPrivateState() |
Map<StateHandleID,StreamStateHandle> |
IncrementalRemoteKeyedStateHandle.getSharedState() |
Map<StateHandleID,StreamStateHandle> |
IncrementalRemoteKeyedStateHandle.getSharedStateHandles() |
Map<StateHandleID,StreamStateHandle> |
IncrementalLocalKeyedStateHandle.getSharedStateHandles() |
Map<StateHandleID,StreamStateHandle> |
IncrementalKeyedStateHandle.getSharedStateHandles()
Returns a set of ids of all registered shared states in the backend at the time this was
created.
|
Modifier and Type | Method and Description |
---|---|
boolean |
CheckpointStateToolset.canFastDuplicate(StreamStateHandle stateHandle)
Tells if we can duplicate the given
StreamStateHandle . |
boolean |
NotDuplicatingCheckpointStateToolset.canFastDuplicate(StreamStateHandle stateHandle) |
boolean |
CheckpointStreamFactory.canFastDuplicate(StreamStateHandle stateHandle,
CheckpointedStateScope scope)
Tells if we can duplicate the given
StreamStateHandle into the path corresponding to
the given CheckpointedStateScope . |
KeyedStateHandle |
CheckpointStreamWithResultProvider.KeyedStateHandleFactory.create(KeyGroupRangeOffsets keyGroupRangeOffsets,
StreamStateHandle streamStateHandle) |
StreamStateHandle |
SharedStateRegistry.registerReference(SharedStateRegistryKey registrationKey,
StreamStateHandle state,
long checkpointID)
Register a reference to the given shared state in the registry.
|
StreamStateHandle |
SharedStateRegistryImpl.registerReference(SharedStateRegistryKey registrationKey,
StreamStateHandle state,
long checkpointID) |
static KeyGroupsStateHandle |
KeyGroupsStateHandle.restore(KeyGroupRangeOffsets groupRangeOffsets,
StreamStateHandle streamStateHandle,
StateHandleID stateHandleId) |
static IncrementalRemoteKeyedStateHandle |
IncrementalRemoteKeyedStateHandle.restore(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle,
long persistedSizeOfThisCheckpoint,
StateHandleID stateHandleId) |
Modifier and Type | Method and Description |
---|---|
List<StreamStateHandle> |
CheckpointStateToolset.duplicate(List<StreamStateHandle> stateHandle)
Duplicates
StreamStateHandles into the path embedded inside of the
class. |
List<StreamStateHandle> |
NotDuplicatingCheckpointStateToolset.duplicate(List<StreamStateHandle> stateHandle) |
List<StreamStateHandle> |
CheckpointStreamFactory.duplicate(List<StreamStateHandle> stateHandles,
CheckpointedStateScope scope)
Duplicates
StreamStateHandle into the path corresponding to * the given CheckpointedStateScope . |
static IncrementalRemoteKeyedStateHandle |
IncrementalRemoteKeyedStateHandle.restore(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle,
long persistedSizeOfThisCheckpoint,
StateHandleID stateHandleId) |
static IncrementalRemoteKeyedStateHandle |
IncrementalRemoteKeyedStateHandle.restore(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle,
long persistedSizeOfThisCheckpoint,
StateHandleID stateHandleId) |
static SnapshotResult<KeyedStateHandle> |
CheckpointStreamWithResultProvider.toKeyedStateHandleSnapshotResult(SnapshotResult<StreamStateHandle> snapshotResult,
KeyGroupRangeOffsets keyGroupRangeOffsets,
CheckpointStreamWithResultProvider.KeyedStateHandleFactory stateHandleFactory)
Helper method that takes a
SnapshotResult and a KeyGroupRangeOffsets and creates a SnapshotResult by combining the
key groups offsets with all the present stream state handles. |
Constructor and Description |
---|
IncrementalLocalKeyedStateHandle(UUID backendIdentifier,
long checkpointId,
DirectoryStateHandle directoryStateHandle,
KeyGroupRange keyGroupRange,
StreamStateHandle metaDataState,
Map<StateHandleID,StreamStateHandle> sharedStateHandleIDs) |
IncrementalRemoteKeyedStateHandle(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle) |
IncrementalRemoteKeyedStateHandle(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle) |
IncrementalRemoteKeyedStateHandle(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle,
long persistedSizeOfThisCheckpoint) |
IncrementalRemoteKeyedStateHandle(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle,
long persistedSizeOfThisCheckpoint) |
IncrementalRemoteKeyedStateHandle(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle,
long persistedSizeOfThisCheckpoint,
StateHandleID stateHandleId) |
IncrementalRemoteKeyedStateHandle(UUID backendIdentifier,
KeyGroupRange keyGroupRange,
long checkpointId,
Map<StateHandleID,StreamStateHandle> sharedState,
Map<StateHandleID,StreamStateHandle> privateState,
StreamStateHandle metaStateHandle,
long persistedSizeOfThisCheckpoint,
StateHandleID stateHandleId) |
Modifier and Type | Method and Description |
---|---|
List<Tuple2<StreamStateHandle,Long>> |
ChangelogStateHandleStreamImpl.getHandlesAndOffsets() |
Modifier and Type | Method and Description |
---|---|
CloseableIterator<StateChange> |
StateChangelogHandleStreamHandleReader.StateChangeIterator.read(StreamStateHandle handle,
long offset) |
Modifier and Type | Method and Description |
---|---|
static ChangelogStateHandleStreamImpl |
ChangelogStateHandleStreamImpl.restore(List<Tuple2<StreamStateHandle,Long>> handlesAndOffsets,
KeyGroupRange keyGroupRange,
long size,
long incrementalSize,
StateHandleID stateHandleID) |
Constructor and Description |
---|
ChangelogStateHandleStreamImpl(List<Tuple2<StreamStateHandle,Long>> handlesAndOffsets,
KeyGroupRange keyGroupRange,
long size,
long incrementalSize) |
Modifier and Type | Class and Description |
---|---|
class |
FileStateHandle
StreamStateHandle for state that was written to a file stream. |
class |
RelativeFileStateHandle
A
StreamStateHandle for state that was written to a file stream. |
Modifier and Type | Method and Description |
---|---|
StreamStateHandle |
FsCheckpointStreamFactory.FsCheckpointStateOutputStream.closeAndGetHandle() |
Modifier and Type | Method and Description |
---|---|
List<StreamStateHandle> |
FsCheckpointStateToolset.duplicate(List<StreamStateHandle> stateHandles) |
List<StreamStateHandle> |
FsCheckpointStreamFactory.duplicate(List<StreamStateHandle> stateHandles,
CheckpointedStateScope scope) |
Modifier and Type | Method and Description |
---|---|
boolean |
FsCheckpointStateToolset.canFastDuplicate(StreamStateHandle stateHandle) |
boolean |
FsCheckpointStreamFactory.canFastDuplicate(StreamStateHandle stateHandle,
CheckpointedStateScope scope) |
Modifier and Type | Method and Description |
---|---|
List<StreamStateHandle> |
FsCheckpointStateToolset.duplicate(List<StreamStateHandle> stateHandles) |
List<StreamStateHandle> |
FsCheckpointStreamFactory.duplicate(List<StreamStateHandle> stateHandles,
CheckpointedStateScope scope) |
Modifier and Type | Class and Description |
---|---|
class |
ByteStreamStateHandle
A state handle that contains stream state in a byte array.
|
Modifier and Type | Method and Description |
---|---|
StreamStateHandle |
MemCheckpointStreamFactory.MemoryCheckpointOutputStream.closeAndGetHandle() |
Modifier and Type | Method and Description |
---|---|
List<StreamStateHandle> |
MemCheckpointStreamFactory.duplicate(List<StreamStateHandle> stateHandles,
CheckpointedStateScope scope) |
Modifier and Type | Method and Description |
---|---|
boolean |
MemCheckpointStreamFactory.canFastDuplicate(StreamStateHandle stateHandle,
CheckpointedStateScope scope) |
Modifier and Type | Method and Description |
---|---|
List<StreamStateHandle> |
MemCheckpointStreamFactory.duplicate(List<StreamStateHandle> stateHandles,
CheckpointedStateScope scope) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.