@PublicEvolving public class CoreOptions extends Object
Modifier and Type | Field and Description |
---|---|
static ConfigOption<String> |
ALLOWED_FALLBACK_FILESYSTEMS |
static ConfigOption<List<String>> |
ALWAYS_PARENT_FIRST_LOADER_PATTERNS
The namespace patterns for classes that are loaded with a preference from the parent
classloader, meaning the application class path, rather than any user code jar file.
|
static ConfigOption<List<String>> |
ALWAYS_PARENT_FIRST_LOADER_PATTERNS_ADDITIONAL |
static ConfigOption<Boolean> |
CHECK_LEAKED_CLASSLOADER |
static ConfigOption<String> |
CLASSLOADER_RESOLVE_ORDER
Defines the class resolution strategy when loading classes from user code, meaning whether to
first check the user code jar (
"child-first" ) or the application classpath ("parent-first" ) |
static ConfigOption<String> |
DEFAULT_FILESYSTEM_SCHEME
The default filesystem scheme, used for paths that do not declare a scheme explicitly.
|
static ConfigOption<Integer> |
DEFAULT_PARALLELISM |
static ConfigOption<Boolean> |
FAIL_ON_USER_CLASS_LOADING_METASPACE_OOM |
static ConfigOption<Boolean> |
FILESYSTEM_OUTPUT_ALWAYS_CREATE_DIRECTORY
Specifies whether the file systems should always create a directory for the output, even with
a parallelism of one.
|
static ConfigOption<Boolean> |
FILESYTEM_DEFAULT_OVERRIDE
Specifies whether file output writers should overwrite existing files by default.
|
static ConfigOption<String> |
FLINK_CLI_JVM_OPTIONS |
static ConfigOption<String> |
FLINK_HADOOP_CONF_DIR
This options is here only for documentation generation, it is only evaluated in the shell
scripts.
|
static ConfigOption<String> |
FLINK_HBASE_CONF_DIR
This options is here only for documentation generation, it is only evaluated in the shell
scripts.
|
static ConfigOption<String> |
FLINK_HS_JVM_OPTIONS |
static ConfigOption<String> |
FLINK_JM_JVM_OPTIONS |
static ConfigOption<String> |
FLINK_JVM_OPTIONS |
static ConfigOption<String> |
FLINK_LOG_DIR
This options is here only for documentation generation, it is only evaluated in the shell
scripts.
|
static ConfigOption<Integer> |
FLINK_LOG_MAX
This options is here only for documentation generation, it is only evaluated in the shell
scripts.
|
static ConfigOption<String> |
FLINK_PID_DIR
The config parameter defining the directory for Flink PID file.
|
static ConfigOption<String> |
FLINK_SSH_OPTIONS
This options is here only for documentation generation, it is only evaluated in the shell
scripts.
|
static ConfigOption<String> |
FLINK_TM_JVM_OPTIONS |
static ConfigOption<String> |
FLINK_YARN_CONF_DIR
This options is here only for documentation generation, it is only evaluated in the shell
scripts.
|
static String[] |
PARENT_FIRST_LOGGING_PATTERNS |
static ConfigOption<List<String>> |
PLUGIN_ALWAYS_PARENT_FIRST_LOADER_PATTERNS
Plugin-specific option of
ALWAYS_PARENT_FIRST_LOADER_PATTERNS . |
static ConfigOption<List<String>> |
PLUGIN_ALWAYS_PARENT_FIRST_LOADER_PATTERNS_ADDITIONAL |
static ConfigOption<String> |
TMP_DIRS
The config parameter defining the directories for temporary files, separated by ",", "|", or
the system's
File.pathSeparator . |
Constructor and Description |
---|
CoreOptions() |
Modifier and Type | Method and Description |
---|---|
static ConfigOption<Integer> |
fileSystemConnectionLimit(String scheme)
The total number of input plus output connections that a file system for the given scheme may
open.
|
static ConfigOption<Integer> |
fileSystemConnectionLimitIn(String scheme)
The total number of input connections that a file system for the given scheme may open.
|
static ConfigOption<Integer> |
fileSystemConnectionLimitOut(String scheme)
The total number of output connections that a file system for the given scheme may open.
|
static ConfigOption<Long> |
fileSystemConnectionLimitStreamInactivityTimeout(String scheme)
If any connection limit is configured, this option can be optionally set to define after
which time (in milliseconds) inactive streams are reclaimed.
|
static ConfigOption<Long> |
fileSystemConnectionLimitTimeout(String scheme)
If any connection limit is configured, this option can be optionally set to define after
which time (in milliseconds) stream opening fails with a timeout exception, if no stream
connection becomes available.
|
static String[] |
getParentFirstLoaderPatterns(ReadableConfig config) |
static String[] |
getPluginParentFirstLoaderPatterns(Configuration config) |
static String[] |
mergeListsToArray(List<String> base,
List<String> append) |
public static final ConfigOption<String> CLASSLOADER_RESOLVE_ORDER
"child-first"
) or the application classpath ("parent-first"
)
The default settings indicate to load classes first from the user code jar, which means that user code jars can include and load different dependencies than Flink uses (transitively).
Exceptions to the rules are defined via ALWAYS_PARENT_FIRST_LOADER_PATTERNS
.
public static final ConfigOption<List<String>> ALWAYS_PARENT_FIRST_LOADER_PATTERNS
CLASSLOADER_RESOLVE_ORDER
is set to "child-first"
.
It is important that all classes whose objects move between Flink's runtime and any user code (including Flink connectors that run as part of the user code) are covered by these patterns here. Otherwise it is be possible that the Flink runtime and the user code load two different copies of a class through the different class loaders. That leads to errors like "X cannot be cast to X" exceptions, where both class names are equal, or "X cannot be assigned to Y", where X should be a subclass of Y.
The following classes are loaded parent-first, to avoid any duplication:
public static final ConfigOption<List<String>> ALWAYS_PARENT_FIRST_LOADER_PATTERNS_ADDITIONAL
public static final ConfigOption<Boolean> FAIL_ON_USER_CLASS_LOADING_METASPACE_OOM
public static final ConfigOption<Boolean> CHECK_LEAKED_CLASSLOADER
public static final ConfigOption<List<String>> PLUGIN_ALWAYS_PARENT_FIRST_LOADER_PATTERNS
ALWAYS_PARENT_FIRST_LOADER_PATTERNS
. Plugins use this
parent first list instead of the global version.public static final ConfigOption<List<String>> PLUGIN_ALWAYS_PARENT_FIRST_LOADER_PATTERNS_ADDITIONAL
public static final ConfigOption<String> FLINK_JVM_OPTIONS
public static final ConfigOption<String> FLINK_JM_JVM_OPTIONS
public static final ConfigOption<String> FLINK_TM_JVM_OPTIONS
public static final ConfigOption<String> FLINK_HS_JVM_OPTIONS
public static final ConfigOption<String> FLINK_CLI_JVM_OPTIONS
public static final ConfigOption<String> FLINK_LOG_DIR
public static final ConfigOption<String> FLINK_PID_DIR
bin/config.sh#KEY_ENV_PID_DIR
and bin/config.sh#DEFAULT_ENV_PID_DIR
public static final ConfigOption<Integer> FLINK_LOG_MAX
public static final ConfigOption<String> FLINK_SSH_OPTIONS
public static final ConfigOption<String> FLINK_HADOOP_CONF_DIR
public static final ConfigOption<String> FLINK_YARN_CONF_DIR
public static final ConfigOption<String> FLINK_HBASE_CONF_DIR
public static final ConfigOption<String> TMP_DIRS
File.pathSeparator
.public static final ConfigOption<Integer> DEFAULT_PARALLELISM
public static final ConfigOption<String> DEFAULT_FILESYSTEM_SCHEME
public static final ConfigOption<String> ALLOWED_FALLBACK_FILESYSTEMS
public static final ConfigOption<Boolean> FILESYTEM_DEFAULT_OVERRIDE
public static final ConfigOption<Boolean> FILESYSTEM_OUTPUT_ALWAYS_CREATE_DIRECTORY
public static String[] getParentFirstLoaderPatterns(ReadableConfig config)
public static String[] getPluginParentFirstLoaderPatterns(Configuration config)
@Internal public static String[] mergeListsToArray(List<String> base, List<String> append)
public static ConfigOption<Integer> fileSystemConnectionLimit(String scheme)
public static ConfigOption<Integer> fileSystemConnectionLimitIn(String scheme)
public static ConfigOption<Integer> fileSystemConnectionLimitOut(String scheme)
public static ConfigOption<Long> fileSystemConnectionLimitTimeout(String scheme)
public static ConfigOption<Long> fileSystemConnectionLimitStreamInactivityTimeout(String scheme)
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.