Modifier and Type | Field and Description |
---|---|
protected BulkFormat<T,SplitT> |
AbstractFileSource.AbstractFileSourceBuilder.readerFormat |
Modifier and Type | Method and Description |
---|---|
static <T> FileSource.FileSourceBuilder<T> |
FileSource.forBulkFileFormat(BulkFormat<T,FileSourceSplit> bulkFormat,
Path... paths)
Builds a new
FileSource using a BulkFormat to read batches of records from
files. |
Constructor and Description |
---|
AbstractFileSource(Path[] inputPaths,
FileEnumerator.Provider fileEnumerator,
FileSplitAssigner.Provider splitAssigner,
BulkFormat<T,SplitT> readerFormat,
ContinuousEnumerationSettings continuousEnumerationSettings) |
AbstractFileSourceBuilder(Path[] inputPaths,
BulkFormat<T,SplitT> readerFormat,
FileEnumerator.Provider defaultFileEnumerator,
FileSplitAssigner.Provider defaultSplitAssigner) |
Modifier and Type | Class and Description |
---|---|
class |
FileRecordFormatAdapter<T>
Deprecated.
Please use
StreamFormatAdapter instead. |
class |
StreamFormatAdapter<T>
Adapter to turn a
StreamFormat into a BulkFormat . |
Constructor and Description |
---|
FileSourceReader(SourceReaderContext readerContext,
BulkFormat<T,SplitT> readerFormat,
Configuration config) |
Modifier and Type | Class and Description |
---|---|
class |
DeserializationSchemaAdapter
Adapter to turn a
DeserializationSchema into a BulkFormat . |
class |
LimitableBulkFormat<T,SplitT extends FileSourceSplit>
A
BulkFormat that can limit output record number. |
Modifier and Type | Method and Description |
---|---|
static <T,SplitT extends FileSourceSplit> |
LimitableBulkFormat.create(BulkFormat<T,SplitT> format,
Long limit) |
Modifier and Type | Method and Description |
---|---|
static <T,SplitT extends FileSourceSplit> |
LimitableBulkFormat.create(BulkFormat<T,SplitT> format,
Long limit) |
Constructor and Description |
---|
FileSystemTableSource(ObjectIdentifier tableIdentifier,
DataType physicalRowDataType,
List<String> partitionKeys,
ReadableConfig tableOptions,
DecodingFormat<BulkFormat<RowData,FileSourceSplit>> bulkReaderFormat,
DecodingFormat<DeserializationSchema<RowData>> deserializationFormat) |
Modifier and Type | Method and Description |
---|---|
static <T> CompactReader.Factory<T> |
CompactBulkReader.factory(BulkFormat<T,FileSourceSplit> format) |
Modifier and Type | Method and Description |
---|---|
protected BulkFormat<RowData,HiveSourceSplit> |
HiveSourceBuilder.createDefaultBulkFormat() |
Modifier and Type | Method and Description |
---|---|
<T> HiveSource<T> |
HiveSourceBuilder.buildWithBulkFormat(BulkFormat<T,HiveSourceSplit> bulkFormat)
Builds HiveSource with custom BulkFormat.
|
Modifier and Type | Class and Description |
---|---|
class |
HiveBulkFormatAdapter
Deprecated.
Please use
HiveInputFormat . |
class |
HiveInputFormat
A BulkFormat implementation for HiveSource.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractAvroBulkFormat<A,T,SplitT extends FileSourceSplit>
Provides a
BulkFormat for Avro records. |
Modifier and Type | Method and Description |
---|---|
BulkFormat<RowData,FileSourceSplit> |
CsvFileFormatFactory.CsvBulkDecodingFormat.createRuntimeDecoder(DynamicTableSource.Context context,
DataType physicalDataType,
int[][] projections) |
Modifier and Type | Class and Description |
---|---|
class |
ParquetColumnarRowInputFormat<SplitT extends FileSourceSplit>
A
ParquetVectorizedInputFormat to provide RowData iterator. |
class |
ParquetVectorizedInputFormat<T,SplitT extends FileSourceSplit>
Parquet
BulkFormat that reads data from the file to VectorizedColumnBatch in
vectorized mode. |
Modifier and Type | Method and Description |
---|---|
BulkFormat<RowData,FileSourceSplit> |
ParquetFileFormatFactory.ParquetBulkDecodingFormat.createRuntimeDecoder(DynamicTableSource.Context sourceContext,
DataType producedDataType,
int[][] projections) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractOrcFileInputFormat<T,BatchT,SplitT extends FileSourceSplit>
The base for ORC readers for the
FileSource . |
class |
OrcColumnarRowFileInputFormat<BatchT,SplitT extends FileSourceSplit>
Deprecated.
Please use
OrcColumnarRowInputFormat . |
class |
OrcColumnarRowInputFormat<BatchT,SplitT extends FileSourceSplit>
An ORC reader that produces a stream of
ColumnarRowData records. |
Modifier and Type | Method and Description |
---|---|
BulkFormat<RowData,FileSourceSplit> |
OrcFileFormatFactory.OrcBulkDecodingFormat.createRuntimeDecoder(DynamicTableSource.Context sourceContext,
DataType producedDataType,
int[][] projections) |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.