org.apache.flink.changelog.fs

Class StateChangeFsUploader

java.lang.Object

org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

org.apache.flink.changelog.fs.StateChangeFsUploader

All Implemented Interfaces:

AutoCloseable, StateChangeUploader

public class StateChangeFsUploader
extends AbstractStateChangeFsUploader

A synchronous StateChangeUploadScheduler implementation that uploads the changes using FileSystem.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.changelog.fs.StateChangeUploader

StateChangeUploader.UploadTasksResult

Field Summary

Fields

Modifier and Type	Field and Description
static String	PATH_SUB_DIR

Fields inherited from class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

bufferSize, compression, metrics

Constructor Summary

Constructors

Constructor and Description
StateChangeFsUploader(JobID jobID, Path basePath, FileSystem fileSystem, boolean compression, int bufferSize, ChangelogStorageMetricGroup metrics, TaskChangelogRegistry changelogRegistry)
StateChangeFsUploader(JobID jobID, Path basePath, FileSystem fileSystem, boolean compression, int bufferSize, ChangelogStorageMetricGroup metrics, TaskChangelogRegistry changelogRegistry, java.util.function.BiFunction<Path,Long,StreamStateHandle> handleFactory)

Method Summary

Modifier and Type	Method and Description
void	close()
Path	getBasePath()
org.apache.flink.changelog.fs.OutputStreamWithPos	prepareStream()

Methods inherited from class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

generateFileName, upload

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PATH_SUB_DIR

@VisibleForTesting
public static final String PATH_SUB_DIR

See Also:

Constant Field Values

Constructor Detail

StateChangeFsUploader

@VisibleForTesting
public StateChangeFsUploader(JobID jobID,
                                                Path basePath,
                                                FileSystem fileSystem,
                                                boolean compression,
                                                int bufferSize,
                                                ChangelogStorageMetricGroup metrics,
                                                TaskChangelogRegistry changelogRegistry)

StateChangeFsUploader

public StateChangeFsUploader(JobID jobID,
                             Path basePath,
                             FileSystem fileSystem,
                             boolean compression,
                             int bufferSize,
                             ChangelogStorageMetricGroup metrics,
                             TaskChangelogRegistry changelogRegistry,
                             java.util.function.BiFunction<Path,Long,StreamStateHandle> handleFactory)

Method Detail

getBasePath

@VisibleForTesting
public Path getBasePath()

prepareStream

public org.apache.flink.changelog.fs.OutputStreamWithPos prepareStream()
                                                                throws IOException

Throws:

IOException

close

public void close()