public class PythonFilterFunction extends AbstractPythonUDF<FilterFunction<org.python.core.PyObject>> implements FilterFunction<org.python.core.PyObject>
PythonFilterFunction
is a thin wrapper layer over a Python UDF FilterFunction
.
It receives a FilterFunction
as an input and keeps it internally in a serialized form.
It is then delivered, as part of job graph, up to the TaskManager, then it is opened and becomes
a sort of mediator to the Python UDF FilterFunction
.
This function is used internally by the Python thin wrapper layer over the streaming data functionality
fun, log
Constructor and Description |
---|
PythonFilterFunction(FilterFunction<org.python.core.PyObject> fun) |
Modifier and Type | Method and Description |
---|---|
boolean |
filter(org.python.core.PyObject value)
The filter function that evaluates the predicate.
|
close, open
getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
public PythonFilterFunction(FilterFunction<org.python.core.PyObject> fun) throws IOException
IOException
public boolean filter(org.python.core.PyObject value) throws Exception
FilterFunction
IMPORTANT: The system assumes that the function does not modify the elements on which the predicate is applied. Violating this assumption can lead to incorrect results.
filter
in interface FilterFunction<org.python.core.PyObject>
value
- The value to be filtered.Exception
- This method may throw exceptions. Throwing an exception will cause the operation
to fail and may trigger recovery.Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.