Interface | Description |
---|---|
ContinuousPartitionFetcher<P,T extends Comparable<T>> |
Partition fetcher for helping continuously fetch partitioned table.
|
ContinuousPartitionFetcher.Context<P,T extends Comparable<T>> |
Context for fetch partitions, partition information is stored in hive meta store.
|
FileSystemFactory |
A factory to create file systems.
|
OutputFormatFactory<T> |
A factory to create an
OutputFormat . |
PartitionCommitPolicy |
Policy for commit a partition.
|
PartitionCommitPolicy.Context |
Context of policy, including table information and partition information.
|
PartitionComputer<T> |
Compute partition path from record and project non-partition columns for output writer.
|
PartitionFetcher<P> |
Fetcher to fetch the suitable partitions of a filesystem table.
|
PartitionFetcher.Context<P> |
Context for fetch partitions, partition information is stored in hive meta store.
|
PartitionFetcher.Context.ComparablePartitionValue<P,T extends Comparable<T>> |
A comparable partition value that can compare order by using its comparator.
|
PartitionFieldExtractor<T extends FileSourceSplit> |
Interface to extract partition field from split.
|
PartitionReader<P,OUT> |
Reader that reads record from given partitions.
|
PartitionTimeExtractor |
Time extractor to extract time from partition values.
|
PartitionWriter<T> |
Partition writer to write records with partition.
|
PartitionWriterFactory<T> |
Factory of
PartitionWriter to avoid virtual function calls. |
TableMetaStoreFactory |
Meta store factory to create
TableMetaStoreFactory.TableMetaStore . |
TableMetaStoreFactory.TableMetaStore |
Meta store to manage the location paths of this table and its partitions.
|
Class | Description |
---|---|
ColumnarRowIterator |
A
BulkFormat.RecordIterator that returns RowData s. |
DefaultPartTimeExtractor |
Default
PartitionTimeExtractor . |
DeserializationSchemaAdapter |
Adapter to turn a
DeserializationSchema into a BulkFormat . |
DynamicPartitionWriter<T> |
Dynamic partition writer to writing multiple partitions at the same time, it maybe consumes more
memory.
|
EmptyMetaStoreFactory |
Empty implementation
TableMetaStoreFactory . |
FileSystemLookupFunction<P> |
Lookup function for filesystem connector tables.
|
FileSystemOptions |
This class holds configuration constants used by filesystem(Including hive) connector.
|
FileSystemOutputFormat<T> |
File system
OutputFormat for batch job. |
FileSystemOutputFormat.Builder<T> |
Builder to build
FileSystemOutputFormat . |
FileSystemTableFactory |
File system
TableFactory . |
FileSystemTableSink |
File system
DynamicTableSink . |
FileSystemTableSink.ProjectionBulkFactory |
Project row to non-partition fields.
|
FileSystemTableSink.TableBucketAssigner |
Table bucket assigner, wrap
PartitionComputer . |
FileSystemTableSink.TableRollingPolicy |
Table
RollingPolicy , it extends CheckpointRollingPolicy for bulk writers. |
FileSystemTableSource |
File system table source.
|
GroupedPartitionWriter<T> |
PartitionWriter for grouped dynamic partition inserting. |
LimitableBulkFormat<T,SplitT extends FileSourceSplit> |
A
BulkFormat that can limit output record number. |
MetastoreCommitPolicy |
Partition commit policy to update metastore.
|
PartitionLoader |
Loader to temporary files to final output path and meta store.
|
PartitionTempFileManager |
Manage temporary files for writing files.
|
PartitionWriter.Context<T> |
Context for partition writer, provide some information and generation utils.
|
RowDataPartitionComputer |
PartitionComputer for RowData . |
RowPartitionComputer |
PartitionComputer for Row . |
SerializationSchemaAdapter |
Adapter to turn a
SerializationSchema into a Encoder . |
SingleDirectoryWriter<T> |
PartitionWriter for single directory writer. |
SuccessFileCommitPolicy |
Partition commit policy to add success file to directory.
|
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.