org.apache.flink.contrib.streaming.state

Class RocksDBStateUploader

java.lang.Object

org.apache.flink.contrib.streaming.state.RocksDBStateUploader

All Implemented Interfaces:

Closeable, AutoCloseable

public class RocksDBStateUploader
extends Object

Help class for uploading RocksDB state files.

Field Summary

Fields

Modifier and Type	Field and Description
protected ExecutorService	executorService

Constructor Summary

Constructors

Constructor and Description
RocksDBStateUploader(int numberOfSnapshottingThreads)

Method Summary

Modifier and Type	Method and Description
void	close()
List<IncrementalKeyedStateHandle.HandleAndLocalPath>	uploadFilesToCheckpointFs(List<Path> files, CheckpointStreamFactory checkpointStreamFactory, CheckpointedStateScope stateScope, CloseableRegistry closeableRegistry, CloseableRegistry tmpResourcesRegistry) Upload all the files to checkpoint fileSystem using specified number of threads.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

executorService

protected final ExecutorService executorService

Constructor Detail

RocksDBStateUploader

public RocksDBStateUploader(int numberOfSnapshottingThreads)

Method Detail

uploadFilesToCheckpointFs

public List<IncrementalKeyedStateHandle.HandleAndLocalPath> uploadFilesToCheckpointFs(@Nonnull
                                                                                      List<Path> files,
                                                                                      CheckpointStreamFactory checkpointStreamFactory,
                                                                                      CheckpointedStateScope stateScope,
                                                                                      CloseableRegistry closeableRegistry,
                                                                                      CloseableRegistry tmpResourcesRegistry)
                                                                               throws Exception

Upload all the files to checkpoint fileSystem using specified number of threads.

Parameters:

files - The files will be uploaded to checkpoint filesystem.

checkpointStreamFactory - The checkpoint streamFactory used to create outputstream.

stateScope -

Throws:

Exception - Thrown if can not upload all the files.

close

public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable