This documentation is for an out-of-date version of Apache Flink. We recommend you use the latest stable version.

State Backends #

Flink provides different state backends that specify how and where state is stored.

State can be located on Java’s heap or off-heap. Depending on your state backend, Flink can also manage the state for the application, meaning Flink deals with the memory management (possibly spilling to disk if necessary) to allow applications to hold very large state. By default, the configuration file flink-conf.yaml determines the state backend for all Flink jobs.

However, the default state backend can be overridden on a per-job basis, as shown below.

For more information about the available state backends, their advantages, limitations, and configuration parameters see the corresponding section in Deployment & Operations.

Java

StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
env.setStateBackend(...);

Scala

val env = StreamExecutionEnvironment.getExecutionEnvironment()
env.setStateBackend(...)

Python

env = StreamExecutionEnvironment.get_execution_environment()
env.set_state_backend(...)