Package org.apache.flink.connector.file.table
-
Interface Summary Interface Description ContinuousPartitionFetcher<P,T extends Comparable<T>> Partition fetcher for helping continuously fetch partitioned table.ContinuousPartitionFetcher.Context<P,T extends Comparable<T>> Context for fetch partitions, partition information is stored in hive meta store.FileSystemFactory A factory to create file systems.OutputFormatFactory<T> A factory to create anOutputFormat
.PartitionCommitPolicy Policy for commit a partition.PartitionCommitPolicy.Context Context of policy, including table information and partition information.PartitionComputer<T> Compute partition path from record and project non-partition columns for output writer.PartitionFetcher<P> Fetcher to fetch the suitable partitions of a filesystem table.PartitionFetcher.Context<P> Context for fetch partitions, partition information is stored in hive meta store.PartitionFetcher.Context.ComparablePartitionValue<P,T extends Comparable<T>> A comparable partition value that can compare order by using its comparator.PartitionFieldExtractor<T extends FileSourceSplit> Interface to extract partition field from split.PartitionReader<P,OUT> Reader that reads record from given partitions.PartitionTimeExtractor Time extractor to extract time from partition values.PartitionWriter<T> Partition writer to write records with partition.PartitionWriter.PartitionWriterListener Listener for partition writer.PartitionWriterFactory<T> Factory ofPartitionWriter
to avoid virtual function calls.TableMetaStoreFactory Meta store factory to createTableMetaStoreFactory.TableMetaStore
.TableMetaStoreFactory.TableMetaStore Meta store to manage the location paths of this table and its partitions. -
Class Summary Class Description BinPacking A bin packing implementation.ColumnarRowIterator ABulkFormat.RecordIterator
that returnsRowData
s.DefaultPartTimeExtractor DefaultPartitionTimeExtractor
.DeserializationSchemaAdapter Adapter to turn aDeserializationSchema
into aBulkFormat
.DynamicPartitionWriter<T> Dynamic partition writer to writing multiple partitions at the same time, it maybe consumes more memory.EmptyMetaStoreFactory Empty implementationTableMetaStoreFactory
.EnrichedRowData FileSystemCommitter File system file committer implementation.FileSystemConnectorOptions Options for the filesystem connector.FileSystemOutputFormat<T> File systemOutputFormat
for batch job.FileSystemOutputFormat.Builder<T> Builder to buildFileSystemOutputFormat
.FileSystemTableFactory File systemTableFactory
.FileSystemTableSink File systemDynamicTableSink
.FileSystemTableSink.ProjectionBulkFactory Project row to non-partition fields.FileSystemTableSink.TableBucketAssigner Table bucket assigner, wrapPartitionComputer
.FileSystemTableSink.TableRollingPolicy TableRollingPolicy
, it extendsCheckpointRollingPolicy
for bulk writers.FileSystemTableSource File system table source.GroupedPartitionWriter<T> PartitionWriter
for grouped dynamic partition inserting.LimitableBulkFormat<T,SplitT extends FileSourceSplit> ABulkFormat
that can limit output record number.MetastoreCommitPolicy Partition commit policy to update metastore.PartitionCommitPolicyFactory A factory to createPartitionCommitPolicy
chain.PartitionLoader Loader to temporary files to final output path and meta store.PartitionTempFileManager Manage temporary files for writing files.PartitionWriter.Context<T> Context for partition writer, provide some information and generation utils.PartitionWriter.DefaultPartitionWriterListener Default implementation for PartitionWriterListener.RowDataPartitionComputer PartitionComputer
forRowData
.RowPartitionComputer PartitionComputer
forRow
.SerializationSchemaAdapter Adapter to turn aSerializationSchema
into aEncoder
.SingleDirectoryWriter<T> PartitionWriter
for single directory writer.SuccessFileCommitPolicy Partition commit policy to add success file to directory. -
Enum Summary Enum Description FileSystemConnectorOptions.FileStatisticsType Statistics types for file system, seeFileSystemConnectorOptions.SOURCE_REPORT_STATISTICS
.FileSystemConnectorOptions.PartitionCommitTriggerType Trigger types for partition commit, seeFileSystemConnectorOptions.SINK_PARTITION_COMMIT_TRIGGER
.