@PublicEvolving public interface DynamicFileEnumerator extends FileEnumerator
FileEnumerator
that supports dynamic filtering. The enumerator only enumerates splits
that exist in the given DynamicFilteringData
, while enumerates all splits if no
DynamicFilteringData is provided when #enumerateSplits is called.Modifier and Type | Interface and Description |
---|---|
static interface |
DynamicFileEnumerator.Provider
Factory for the
DynamicFileEnumerator . |
Modifier and Type | Method and Description |
---|---|
void |
setDynamicFilteringData(DynamicFilteringData data)
Provides a
DynamicFilteringData for filtering while the enumerator is enumerating
splits. |
enumerateSplits
void setDynamicFilteringData(DynamicFilteringData data)
DynamicFilteringData
for filtering while the enumerator is enumerating
splits.
The DynamicFilteringData
is typically collected by a collector operator, and
transferred here by a coordinating event. The method should never be called directly by
users.
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.