IT
- The mapper's input data type.OT
- The mapper's output data type.public class MapPartitionDriver<IT,OT> extends Object implements Driver<MapPartitionFunction<IT,OT>,OT>
The MapPartitionTask creates an iterator over all key-value pairs of its input and hands that to the map_partition()
method
of the MapFunction.
MapPartitionFunction
Constructor and Description |
---|
MapPartitionDriver() |
Modifier and Type | Method and Description |
---|---|
void |
cancel()
This method is invoked when the driver must aborted in mid processing.
|
void |
cleanup()
This method is invoked in any case (clean termination and exception) at the end of the tasks operation.
|
int |
getNumberOfDriverComparators()
Gets the number of comparators required for this driver.
|
int |
getNumberOfInputs()
Gets the number of inputs that the task has.
|
Class<MapPartitionFunction<IT,OT>> |
getStubType()
Gets the class of the stub type that is run by this task.
|
void |
prepare()
This method is called before the user code is opened.
|
void |
run()
The main operation method of the task.
|
void |
setup(TaskContext<MapPartitionFunction<IT,OT>,OT> context) |
public void setup(TaskContext<MapPartitionFunction<IT,OT>,OT> context)
public int getNumberOfInputs()
Driver
getNumberOfInputs
in interface Driver<MapPartitionFunction<IT,OT>,OT>
public Class<MapPartitionFunction<IT,OT>> getStubType()
Driver
MapFunction.class
.getStubType
in interface Driver<MapPartitionFunction<IT,OT>,OT>
public int getNumberOfDriverComparators()
Driver
getNumberOfDriverComparators
in interface Driver<MapPartitionFunction<IT,OT>,OT>
public void prepare()
Driver
public void run() throws Exception
Driver
run
in interface Driver<MapPartitionFunction<IT,OT>,OT>
Exception
- Any exception thrown by this method signals task failure. Because exceptions in the user
code typically signal situations where this instance in unable to proceed, exceptions
from the user code should be forwarded.public void cleanup()
Driver
Copyright © 2014–2019 The Apache Software Foundation. All rights reserved.