@Experimental public interface PartitionableTableSource
PartitionableTableSource can exclude partitions from reading, which
includes skipping the metadata. This is especially useful when there are thousands
of partitions in a table.
A partition is represented as a
Map<String, String> which maps from partition
field name to partition value. Since the map is NOT ordered, the correct order of partition
fields should be obtained via
|Modifier and Type||Method and Description|
Applies the remaining partitions to the table source.
Gets the partition field names of the table.
Returns all the partitions of this
All the partition fields should exist in the
TableSource applyPartitionPruning(List<Map<String,String>> remainingPartitions)
remainingPartitionsis the remaining partitions of
getPartitions()after partition pruning applied.
After trying to apply partition pruning, we should return a new
instance which holds all pruned-partitions.
remainingPartitions- Remaining partitions after partition pruning applied.
TableSourceholds all pruned-partitions.
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.