Uses of Class
org.apache.flink.connector.file.src.FileSourceSplit

Packages that use FileSourceSplit

Package	Description
org.apache.flink.connector.file.src
org.apache.flink.connector.file.src.assigners
org.apache.flink.connector.file.src.enumerate
org.apache.flink.connector.file.src.impl
org.apache.flink.connector.file.src.reader
org.apache.flink.connector.file.table
org.apache.flink.connector.file.table.stream.compact
org.apache.flink.formats.avro
org.apache.flink.formats.csv
org.apache.flink.formats.parquet
org.apache.flink.formats.parquet.vector
org.apache.flink.orc
org.apache.flink.orc.nohive
org.apache.flink.orc.vector

Uses of FileSourceSplit in org.apache.flink.connector.file.src

Classes in org.apache.flink.connector.file.src with type parameters of type FileSourceSplit

Modifier and Type	Class	Description
class	AbstractFileSource<T,SplitT extends FileSourceSplit>	The base class for File Sources.
protected static class	AbstractFileSource.AbstractFileSourceBuilder<T,SplitT extends FileSourceSplit,SELF extends AbstractFileSource.AbstractFileSourceBuilder<T,SplitT,SELF>>	The generic base builder.
class	FileSourceSplitState<SplitT extends FileSourceSplit>	State of the reader, essentially a mutable version of the FileSourceSplit.
class	PendingSplitsCheckpoint<SplitT extends FileSourceSplit>	A checkpoint of the current state of the containing the currently pending splits that are not yet assigned.
class	PendingSplitsCheckpointSerializer<T extends FileSourceSplit>	A serializer for the PendingSplitsCheckpoint.

Methods in org.apache.flink.connector.file.src with type parameters of type FileSourceSplit

Modifier and Type	Method	Description
static <T extends FileSourceSplit> PendingSplitsCheckpoint<T>	PendingSplitsCheckpoint.fromCollectionSnapshot(Collection<T> splits)
static <T extends FileSourceSplit> PendingSplitsCheckpoint<T>	PendingSplitsCheckpoint.fromCollectionSnapshot(Collection<T> splits, Collection<Path> alreadyProcessedPaths)

Methods in org.apache.flink.connector.file.src that return FileSourceSplit

Modifier and Type	Method	Description
FileSourceSplit	FileSourceSplitSerializer.deserialize(int version, byte[] serialized)
FileSourceSplit	FileSourceSplit.updateWithCheckpointedPosition(CheckpointedPosition position)	Creates a copy of this split where the checkpointed position is replaced by the given new position.

Methods in org.apache.flink.connector.file.src that return types with arguments of type FileSourceSplit

Modifier and Type	Method	Description
SimpleVersionedSerializer<FileSourceSplit>	FileSource.getSplitSerializer()

Methods in org.apache.flink.connector.file.src with parameters of type FileSourceSplit

Modifier and Type	Method	Description
byte[]	FileSourceSplitSerializer.serialize(FileSourceSplit split)

Method parameters in org.apache.flink.connector.file.src with type arguments of type FileSourceSplit

Modifier and Type	Method	Description
static <T> FileSource.FileSourceBuilder<T>	FileSource.forBulkFileFormat(BulkFormat<T,FileSourceSplit> bulkFormat, Path... paths)	Builds a new FileSource using a BulkFormat to read batches of records from files.

Uses of FileSourceSplit in org.apache.flink.connector.file.src.assigners

Methods in org.apache.flink.connector.file.src.assigners that return types with arguments of type FileSourceSplit

Modifier and Type	Method	Description
Optional<FileSourceSplit>	FileSplitAssigner.getNext(String hostname)	Gets the next split.
Optional<FileSourceSplit>	LocalityAwareSplitAssigner.getNext(String host)
Optional<FileSourceSplit>	SimpleSplitAssigner.getNext(String hostname)
Collection<FileSourceSplit>	FileSplitAssigner.remainingSplits()	Gets the remaining splits that this assigner has pending.
Collection<FileSourceSplit>	LocalityAwareSplitAssigner.remainingSplits()
Collection<FileSourceSplit>	SimpleSplitAssigner.remainingSplits()

Method parameters in org.apache.flink.connector.file.src.assigners with type arguments of type FileSourceSplit

Modifier and Type	Method	Description
void	FileSplitAssigner.addSplits(Collection<FileSourceSplit> splits)	Adds a set of splits to this assigner.
void	LocalityAwareSplitAssigner.addSplits(Collection<FileSourceSplit> splits)
void	SimpleSplitAssigner.addSplits(Collection<FileSourceSplit> newSplits)
FileSplitAssigner	FileSplitAssigner.Provider.create(Collection<FileSourceSplit> initialSplits)	Creates a new FileSplitAssigner that starts with the given set of initial splits.

Constructor parameters in org.apache.flink.connector.file.src.assigners with type arguments of type FileSourceSplit

Constructor	Description
LocalityAwareSplitAssigner(Collection<FileSourceSplit> splits)
SimpleSplitAssigner(Collection<FileSourceSplit> splits)

Uses of FileSourceSplit in org.apache.flink.connector.file.src.enumerate

Methods in org.apache.flink.connector.file.src.enumerate that return types with arguments of type FileSourceSplit

Modifier and Type	Method	Description
Collection<FileSourceSplit>	FileEnumerator.enumerateSplits(Path[] paths, int minDesiredSplits)	Generates all file splits for the relevant files under the given paths.
Collection<FileSourceSplit>	NonSplittingRecursiveEnumerator.enumerateSplits(Path[] paths, int minDesiredSplits)

Method parameters in org.apache.flink.connector.file.src.enumerate with type arguments of type FileSourceSplit

Modifier and Type	Method	Description
protected void	BlockSplittingRecursiveAllDirEnumerator.addSplitsForPath(FileStatus fileStatus, FileSystem fs, ArrayList<FileSourceSplit> target)
protected void	NonSplittingRecursiveAllDirEnumerator.addSplitsForPath(FileStatus fileStatus, FileSystem fs, ArrayList<FileSourceSplit> target)
protected void	NonSplittingRecursiveEnumerator.addSplitsForPath(FileStatus fileStatus, FileSystem fs, ArrayList<FileSourceSplit> target)
protected void	BlockSplittingRecursiveEnumerator.convertToSourceSplits(FileStatus file, FileSystem fs, List<FileSourceSplit> target)
protected void	NonSplittingRecursiveEnumerator.convertToSourceSplits(FileStatus file, FileSystem fs, List<FileSourceSplit> target)

Uses of FileSourceSplit in org.apache.flink.connector.file.src.impl

Classes in org.apache.flink.connector.file.src.impl with type parameters of type FileSourceSplit

Modifier and Type	Class	Description
class	DynamicFileSplitEnumerator<SplitT extends FileSourceSplit>	A SplitEnumerator implementation that supports dynamic filtering.
class	FileSourceReader<T,SplitT extends FileSourceSplit>	A SourceReader that read records from FileSourceSplit.

Methods in org.apache.flink.connector.file.src.impl that return types with arguments of type FileSourceSplit

Modifier and Type	Method	Description
PendingSplitsCheckpoint<FileSourceSplit>	ContinuousFileSplitEnumerator.snapshotState(long checkpointId)
PendingSplitsCheckpoint<FileSourceSplit>	StaticFileSplitEnumerator.snapshotState(long checkpointId)

Methods in org.apache.flink.connector.file.src.impl with parameters of type FileSourceSplit

Modifier and Type	Method	Description
BulkFormat.Reader<T>	StreamFormatAdapter.createReader(Configuration config, FileSourceSplit split)
BulkFormat.Reader<T>	StreamFormatAdapter.restoreReader(Configuration config, FileSourceSplit split)

Method parameters in org.apache.flink.connector.file.src.impl with type arguments of type FileSourceSplit

Modifier and Type	Method	Description
void	ContinuousFileSplitEnumerator.addSplitsBack(List<FileSourceSplit> splits, int subtaskId)
void	StaticFileSplitEnumerator.addSplitsBack(List<FileSourceSplit> splits, int subtaskId)

Constructor parameters in org.apache.flink.connector.file.src.impl with type arguments of type FileSourceSplit

Constructor	Description
ContinuousFileSplitEnumerator(SplitEnumeratorContext<FileSourceSplit> context, FileEnumerator enumerator, FileSplitAssigner splitAssigner, Path[] paths, Collection<Path> alreadyDiscoveredPaths, long discoveryInterval)
StaticFileSplitEnumerator(SplitEnumeratorContext<FileSourceSplit> context, FileSplitAssigner splitAssigner)

Uses of FileSourceSplit in org.apache.flink.connector.file.src.reader

Classes in org.apache.flink.connector.file.src.reader with type parameters of type FileSourceSplit

Modifier and Type	Interface	Description
interface	BulkFormat<T,SplitT extends FileSourceSplit>	The BulkFormat reads and decodes batches of records at a time.

Uses of FileSourceSplit in org.apache.flink.connector.file.table

Classes in org.apache.flink.connector.file.table with type parameters of type FileSourceSplit

Modifier and Type	Class	Description
class	LimitableBulkFormat<T,SplitT extends FileSourceSplit>	A BulkFormat that can limit output record number.
interface	PartitionFieldExtractor<T extends FileSourceSplit>	Interface to extract partition field from split.

Methods in org.apache.flink.connector.file.table with type parameters of type FileSourceSplit

Modifier and Type	Method	Description
static <T,SplitT extends FileSourceSplit> BulkFormat<T,SplitT>	LimitableBulkFormat.create(BulkFormat<T,SplitT> format, Long limit)

Methods in org.apache.flink.connector.file.table that return types with arguments of type FileSourceSplit

Modifier and Type	Method	Description
static PartitionFieldExtractor<FileSourceSplit>	PartitionFieldExtractor.forFileSystem(String defaultPartValue)

Methods in org.apache.flink.connector.file.table with parameters of type FileSourceSplit

Modifier and Type	Method	Description
org.apache.flink.connector.file.table.DeserializationSchemaAdapter.Reader	DeserializationSchemaAdapter.createReader(Configuration config, FileSourceSplit split)
org.apache.flink.connector.file.table.DeserializationSchemaAdapter.Reader	DeserializationSchemaAdapter.restoreReader(Configuration config, FileSourceSplit split)

Constructor parameters in org.apache.flink.connector.file.table with type arguments of type FileSourceSplit

Constructor	Description
FileSystemTableSource(ObjectIdentifier tableIdentifier, DataType physicalRowDataType, List<String> partitionKeys, ReadableConfig tableOptions, DecodingFormat<BulkFormat<RowData,FileSourceSplit>> bulkReaderFormat, DecodingFormat<DeserializationSchema<RowData>> deserializationFormat)

Uses of FileSourceSplit in org.apache.flink.connector.file.table.stream.compact

Method parameters in org.apache.flink.connector.file.table.stream.compact with type arguments of type FileSourceSplit

Modifier and Type	Method	Description
static <T> CompactReader.Factory<T>	CompactBulkReader.factory(BulkFormat<T,FileSourceSplit> format)

Uses of FileSourceSplit in org.apache.flink.formats.avro

Classes in org.apache.flink.formats.avro with type parameters of type FileSourceSplit

Modifier and Type	Class	Description
class	AbstractAvroBulkFormat<A,T,SplitT extends FileSourceSplit>	Provides a BulkFormat for Avro records.

Uses of FileSourceSplit in org.apache.flink.formats.csv

Methods in org.apache.flink.formats.csv that return types with arguments of type FileSourceSplit

Modifier and Type	Method	Description
BulkFormat<RowData,FileSourceSplit>	CsvFileFormatFactory.CsvBulkDecodingFormat.createRuntimeDecoder(DynamicTableSource.Context context, DataType physicalDataType, int[][] projections)

Uses of FileSourceSplit in org.apache.flink.formats.parquet

Classes in org.apache.flink.formats.parquet with type parameters of type FileSourceSplit

Modifier and Type	Class	Description
class	ParquetColumnarRowInputFormat<SplitT extends FileSourceSplit>	A ParquetVectorizedInputFormat to provide RowData iterator.
class	ParquetVectorizedInputFormat<T,SplitT extends FileSourceSplit>	Parquet BulkFormat that reads data from the file to VectorizedColumnBatch in vectorized mode.

Methods in org.apache.flink.formats.parquet with type parameters of type FileSourceSplit

Modifier and Type	Method	Description
static <SplitT extends FileSourceSplit> ParquetColumnarRowInputFormat<SplitT>	ParquetColumnarRowInputFormat.createPartitionedFormat(org.apache.hadoop.conf.Configuration hadoopConfig, RowType producedRowType, TypeInformation<RowData> producedTypeInfo, List<String> partitionKeys, PartitionFieldExtractor<SplitT> extractor, int batchSize, boolean isUtcTimestamp, boolean isCaseSensitive)	Create a partitioned ParquetColumnarRowInputFormat, the partition columns can be generated by Path.

Methods in org.apache.flink.formats.parquet that return types with arguments of type FileSourceSplit

Modifier and Type	Method	Description
BulkFormat<RowData,FileSourceSplit>	ParquetFileFormatFactory.ParquetBulkDecodingFormat.createRuntimeDecoder(DynamicTableSource.Context sourceContext, DataType producedDataType, int[][] projections)

Uses of FileSourceSplit in org.apache.flink.formats.parquet.vector

Classes in org.apache.flink.formats.parquet.vector with type parameters of type FileSourceSplit

Modifier and Type	Interface	Description
interface	ColumnBatchFactory<SplitT extends FileSourceSplit>	Interface to create VectorizedColumnBatch.

Methods in org.apache.flink.formats.parquet.vector with type parameters of type FileSourceSplit

Modifier and Type	Method	Description
static <SplitT extends FileSourceSplit> ColumnBatchFactory<SplitT>	ColumnBatchFactory.withoutExtraFields()

Uses of FileSourceSplit in org.apache.flink.orc

Classes in org.apache.flink.orc with type parameters of type FileSourceSplit

Modifier and Type	Class	Description
class	AbstractOrcFileInputFormat<T,BatchT,SplitT extends FileSourceSplit>	The base for ORC readers for the FileSource.
class	OrcColumnarRowInputFormat<BatchT,SplitT extends FileSourceSplit>	An ORC reader that produces a stream of ColumnarRowData records.

Methods in org.apache.flink.orc with type parameters of type FileSourceSplit

Modifier and Type	Method	Description
static <SplitT extends FileSourceSplit> OrcColumnarRowInputFormat<org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch,SplitT>	OrcColumnarRowInputFormat.createPartitionedFormat(OrcShim<org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch> shim, org.apache.hadoop.conf.Configuration hadoopConfig, RowType tableType, List<String> partitionKeys, PartitionFieldExtractor<SplitT> extractor, int[] selectedFields, List<OrcFilters.Predicate> conjunctPredicates, int batchSize, Function<RowType,TypeInformation<RowData>> rowTypeInfoFactory)	Create a partitioned OrcColumnarRowInputFormat, the partition columns can be generated by split.

Methods in org.apache.flink.orc that return types with arguments of type FileSourceSplit

Modifier and Type	Method	Description
BulkFormat<RowData,FileSourceSplit>	OrcFileFormatFactory.OrcBulkDecodingFormat.createRuntimeDecoder(DynamicTableSource.Context sourceContext, DataType producedDataType, int[][] projections)

Uses of FileSourceSplit in org.apache.flink.orc.nohive

Methods in org.apache.flink.orc.nohive with type parameters of type FileSourceSplit

Modifier and Type	Method	Description
static <SplitT extends FileSourceSplit> OrcColumnarRowInputFormat<?,SplitT>	OrcNoHiveColumnarRowInputFormat.createPartitionedFormat(org.apache.hadoop.conf.Configuration hadoopConfig, RowType tableType, List<String> partitionKeys, PartitionFieldExtractor<SplitT> extractor, int[] selectedFields, List<OrcFilters.Predicate> conjunctPredicates, int batchSize, Function<RowType,TypeInformation<RowData>> rowTypeInfoFactory)	Create a partitioned OrcColumnarRowInputFormat, the partition columns can be generated by split.

Uses of FileSourceSplit in org.apache.flink.orc.vector

Classes in org.apache.flink.orc.vector with type parameters of type FileSourceSplit

Modifier and Type	Interface	Description
interface	ColumnBatchFactory<BatchT,SplitT extends FileSourceSplit>	Interface to create VectorizedColumnBatch.