Interface FileSplitAssigner

    • Method Detail

      • getNext

        Optional<FileSourceSplit> getNext​(@Nullable
                                          String hostname)
        Gets the next split.

        When this method returns an empty Optional, then the set of splits is assumed to be done and the source will finish once the readers finished their current splits.

      • addSplits

        void addSplits​(Collection<FileSourceSplit> splits)
        Adds a set of splits to this assigner. This happens for example when some split processing failed and the splits need to be re-added, or when new splits got discovered.