@PublicEvolving public interface FileEnumerator
FileEnumerator's task is to discover all files to be read and to split them into a
This includes possibly, path traversals, file filtering (by name or other patterns) and deciding whether to split files into multiple splits, and how to split them.
|Modifier and Type
|Interface and Description
Factory for the
FileEnumerator, to allow the
FileEnumerator to be eagerly
initialized and to not be serializable.
Collection<FileSourceSplit> enumerateSplits(Path paths, int minDesiredSplits) throws IOException
minDesiredSplits is an optional hint indicating how many splits would be necessary to
exploit parallelism properly.
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.