IN
- Type of the input to the partition@Deprecated @Internal public class BoundedOneInputStreamTaskRunner<IN> extends RichMapPartitionFunction<IN,TaggedOperatorSubtaskState>
RichMapPartitionFunction
that serves as the runtime for a BoundedStreamTask
.
The task is executed processing the data in a particular partition instead of the pulling from
the network stack. After all data has been processed the runner will output the OperatorSubtaskState
from the snapshot of the bounded task.
Constructor and Description |
---|
BoundedOneInputStreamTaskRunner(StreamConfig streamConfig,
int maxParallelism,
Timestamper<IN> timestamper)
Deprecated.
Create a new
BoundedOneInputStreamTaskRunner . |
Modifier and Type | Method and Description |
---|---|
void |
mapPartition(Iterable<IN> values,
Collector<TaggedOperatorSubtaskState> out)
Deprecated.
A user-implemented function that modifies or transforms an incoming object.
|
void |
open(OpenContext openContext)
Deprecated.
Initialization method for the function.
|
close, getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext
public BoundedOneInputStreamTaskRunner(StreamConfig streamConfig, int maxParallelism, Timestamper<IN> timestamper)
BoundedOneInputStreamTaskRunner
.streamConfig
- The internal configuration for the task.maxParallelism
- The max parallelism of the operator.public void open(OpenContext openContext) throws Exception
RichFunction
The openContext object passed to the function can be used for configuration and initialization. The openContext contains some necessary information that were configured on the function in the program composition.
public class MyFilter extends RichFilterFunction<String> {
private String searchString;
public void open(OpenContext openContext) {
// initialize the value of searchString
}
public boolean filter(String value) {
return value.equals(searchString);
}
}
By default, this method does nothing.
1. If you implement open(OpenContext openContext)
, the open(OpenContext
openContext)
will be invoked and the open(Configuration parameters)
won't be
invoked. 2. If you don't implement open(OpenContext openContext)
, the open(Configuration parameters)
will be invoked in the default implementation of the open(OpenContext openContext)
.
openContext
- The context containing information about the context in which the function
is opened.Exception
- Implementations may forward exceptions, which are caught by the runtime.
When the runtime catches an exception, it aborts the task and lets the fail-over logic
decide whether to retry the task execution.public void mapPartition(Iterable<IN> values, Collector<TaggedOperatorSubtaskState> out) throws Exception
MapPartitionFunction
mapPartition
in interface MapPartitionFunction<IN,TaggedOperatorSubtaskState>
mapPartition
in class RichMapPartitionFunction<IN,TaggedOperatorSubtaskState>
values
- All records for the mapperout
- The collector to hand results to.Exception
- This method may throw exceptions. Throwing an exception will cause the
operation to fail and may trigger recovery.Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.