Package | Description |
---|---|
org.apache.flink.connector.file.src.assigners | |
org.apache.flink.connector.file.src.impl | |
org.apache.flink.connectors.hive |
Modifier and Type | Class and Description |
---|---|
class |
LocalityAwareSplitAssigner
A
FileSplitAssigner that assigns to each host preferably splits that are local, before
assigning splits that are not local. |
class |
SimpleSplitAssigner
The
SimpleSplitAssigner hands out splits in a random order, without any consideration for
order or locality. |
Modifier and Type | Method and Description |
---|---|
FileSplitAssigner |
FileSplitAssigner.Provider.create(Collection<FileSourceSplit> initialSplits)
Creates a new
FileSplitAssigner that starts with the given set of initial splits. |
Constructor and Description |
---|
ContinuousFileSplitEnumerator(SplitEnumeratorContext<FileSourceSplit> context,
FileEnumerator enumerator,
FileSplitAssigner splitAssigner,
Path[] paths,
Collection<Path> alreadyDiscoveredPaths,
long discoveryInterval) |
StaticFileSplitEnumerator(SplitEnumeratorContext<FileSourceSplit> context,
FileSplitAssigner splitAssigner) |
Constructor and Description |
---|
ContinuousHiveSplitEnumerator(SplitEnumeratorContext<HiveSourceSplit> enumeratorContext,
T currentReadOffset,
Collection<List<String>> seenPartitionsSinceOffset,
FileSplitAssigner splitAssigner,
long discoveryInterval,
org.apache.hadoop.mapred.JobConf jobConf,
ObjectPath tablePath,
ContinuousPartitionFetcher<org.apache.hadoop.hive.metastore.api.Partition,T> fetcher,
HiveTableSource.HiveContinuousPartitionFetcherContext<T> fetcherContext) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.