@PublicEvolving public class PythonOptions extends Object
Modifier and Type | Field and Description |
---|---|
static ConfigOption<Integer> |
MAP_STATE_ITERATE_RESPONSE_BATCH_SIZE
The maximum number of entries sent to Python UDF worker per request when iterating a Python
MapState.
|
static ConfigOption<Integer> |
MAP_STATE_READ_CACHE_SIZE
The maximum number of cached items which read from Java side in a Python MapState.
|
static ConfigOption<Integer> |
MAP_STATE_WRITE_CACHE_SIZE
The maximum number of write requests cached in a Python MapState.
|
static ConfigOption<Integer> |
MAX_ARROW_BATCH_SIZE
The maximum number of elements to include in an arrow batch.
|
static ConfigOption<Integer> |
MAX_BUNDLE_SIZE
The maximum number of elements to include in a bundle.
|
static ConfigOption<Long> |
MAX_BUNDLE_TIME_MILLS
The maximum time to wait before finalising a bundle (in milliseconds).
|
static ConfigOption<String> |
PYTHON_ARCHIVES |
static ConfigOption<Map<String,String>> |
PYTHON_ARCHIVES_DISTRIBUTED_CACHE_INFO |
static ConfigOption<String> |
PYTHON_CLIENT_EXECUTABLE |
static ConfigOption<String> |
PYTHON_EXECUTABLE |
static ConfigOption<String> |
PYTHON_EXECUTION_MODE
Specify the python runtime execution mode.
|
static ConfigOption<String> |
PYTHON_FILES |
static ConfigOption<Map<String,String>> |
PYTHON_FILES_DISTRIBUTED_CACHE_INFO |
static ConfigOption<Map<String,String>> |
PYTHON_JOB_OPTIONS |
static ConfigOption<String> |
PYTHON_LOOPBACK_SERVER_ADDRESS |
static ConfigOption<Boolean> |
PYTHON_METRIC_ENABLED
The configuration to enable or disable metric for Python execution.
|
static ConfigOption<Boolean> |
PYTHON_OPERATOR_CHAINING_ENABLED
The configuration to enable or disable python operator chaining.
|
static ConfigOption<String> |
PYTHON_PATH
The configuration allows user to define python path for client and workers.
|
static ConfigOption<Boolean> |
PYTHON_PROFILE_ENABLED
The configuration to enable or disable profile for Python execution.
|
static ConfigOption<String> |
PYTHON_REQUIREMENTS |
static ConfigOption<Map<String,String>> |
PYTHON_REQUIREMENTS_FILE_DISTRIBUTED_CACHE_INFO |
static ConfigOption<Boolean> |
PYTHON_SYSTEMENV_ENABLED
The configuration to enable or disable system env for Python execution.
|
static ConfigOption<Integer> |
STATE_CACHE_SIZE
The maximum number of states cached in a Python UDF worker.
|
static ConfigOption<Boolean> |
USE_MANAGED_MEMORY
Whether the memory used by the Python framework is managed memory.
|
Constructor and Description |
---|
PythonOptions() |
public static final ConfigOption<Integer> MAX_BUNDLE_SIZE
public static final ConfigOption<Long> MAX_BUNDLE_TIME_MILLS
public static final ConfigOption<Integer> MAX_ARROW_BATCH_SIZE
public static final ConfigOption<Boolean> PYTHON_METRIC_ENABLED
public static final ConfigOption<Boolean> PYTHON_PROFILE_ENABLED
public static final ConfigOption<Boolean> PYTHON_SYSTEMENV_ENABLED
public static final ConfigOption<Boolean> PYTHON_OPERATOR_CHAINING_ENABLED
public static final ConfigOption<String> PYTHON_FILES
public static final ConfigOption<String> PYTHON_REQUIREMENTS
public static final ConfigOption<String> PYTHON_PATH
public static final ConfigOption<String> PYTHON_ARCHIVES
public static final ConfigOption<String> PYTHON_EXECUTABLE
public static final ConfigOption<String> PYTHON_CLIENT_EXECUTABLE
public static final ConfigOption<Boolean> USE_MANAGED_MEMORY
@Experimental public static final ConfigOption<Integer> STATE_CACHE_SIZE
@Experimental public static final ConfigOption<Integer> MAP_STATE_READ_CACHE_SIZE
@Experimental public static final ConfigOption<Integer> MAP_STATE_WRITE_CACHE_SIZE
@Experimental public static final ConfigOption<Integer> MAP_STATE_ITERATE_RESPONSE_BATCH_SIZE
@Experimental public static final ConfigOption<String> PYTHON_EXECUTION_MODE
public static final ConfigOption<Map<String,String>> PYTHON_JOB_OPTIONS
public static final ConfigOption<Map<String,String>> PYTHON_FILES_DISTRIBUTED_CACHE_INFO
public static final ConfigOption<Map<String,String>> PYTHON_REQUIREMENTS_FILE_DISTRIBUTED_CACHE_INFO
public static final ConfigOption<Map<String,String>> PYTHON_ARCHIVES_DISTRIBUTED_CACHE_INFO
public static final ConfigOption<String> PYTHON_LOOPBACK_SERVER_ADDRESS
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.