Class LocatableInputSplitAssigner

  • All Implemented Interfaces:
    InputSplitAssigner

    @Public
    public final class LocatableInputSplitAssigner
    extends Object
    implements InputSplitAssigner
    The locatable input split assigner assigns to each host splits that are local, before assigning splits that are not local.
    • Method Detail

      • getNextInputSplit

        public LocatableInputSplit getNextInputSplit​(String host,
                                                     int taskId)
        Description copied from interface: InputSplitAssigner
        Returns the next input split that shall be consumed. The consumer's host is passed as a parameter to allow localized assignments.
        Specified by:
        getNextInputSplit in interface InputSplitAssigner
        Parameters:
        host - The host address of split requesting task.
        taskId - The id of the split requesting task.
        Returns:
        the next input split to be consumed, or null if no more splits remain.
      • returnInputSplit

        public void returnInputSplit​(List<InputSplit> splits,
                                     int taskId)
        Description copied from interface: InputSplitAssigner
        Return the splits to assigner if the task failed to process it.
        Specified by:
        returnInputSplit in interface InputSplitAssigner
        Parameters:
        splits - The list of input splits to be returned.
        taskId - The id of the task that failed to process the input splits.
      • getNumberOfLocalAssignments

        public int getNumberOfLocalAssignments()
      • getNumberOfRemoteAssignments

        public int getNumberOfRemoteAssignments()