public class ParquetFileFormat extends FileFormat
FileFormat
.formatIdentifier
Constructor and Description |
---|
ParquetFileFormat(org.apache.flink.configuration.Configuration formatOptions) |
Modifier and Type | Method and Description |
---|---|
org.apache.flink.connector.file.src.reader.BulkFormat<org.apache.flink.table.data.RowData,org.apache.flink.connector.file.src.FileSourceSplit> |
createReaderFactory(org.apache.flink.table.types.logical.RowType type,
int[][] projection,
List<Predicate> filters)
Create a
BulkFormat from the type, with projection pushed down. |
Optional<FileStatsExtractor> |
createStatsExtractor(org.apache.flink.table.types.logical.RowType type) |
org.apache.flink.api.common.serialization.BulkWriter.Factory<org.apache.flink.table.data.RowData> |
createWriterFactory(org.apache.flink.table.types.logical.RowType type)
Create a
BulkWriter.Factory from the type. |
static org.apache.hadoop.conf.Configuration |
getParquetConfiguration(org.apache.flink.configuration.Configuration options) |
createReaderFactory, createReaderFactory, fromIdentifier, fromTableOptions, getFormatIdentifier
public ParquetFileFormat(org.apache.flink.configuration.Configuration formatOptions)
public org.apache.flink.connector.file.src.reader.BulkFormat<org.apache.flink.table.data.RowData,org.apache.flink.connector.file.src.FileSourceSplit> createReaderFactory(org.apache.flink.table.types.logical.RowType type, int[][] projection, List<Predicate> filters)
FileFormat
BulkFormat
from the type, with projection pushed down.createReaderFactory
in class FileFormat
type
- Type without projection.projection
- See Projection.toNestedIndexes()
.filters
- A list of filters in conjunctive form for filtering on a best-effort basis.public org.apache.flink.api.common.serialization.BulkWriter.Factory<org.apache.flink.table.data.RowData> createWriterFactory(org.apache.flink.table.types.logical.RowType type)
FileFormat
BulkWriter.Factory
from the type.createWriterFactory
in class FileFormat
public Optional<FileStatsExtractor> createStatsExtractor(org.apache.flink.table.types.logical.RowType type)
createStatsExtractor
in class FileFormat
public static org.apache.hadoop.conf.Configuration getParquetConfiguration(org.apache.flink.configuration.Configuration options)
Copyright © 2019–2023 The Apache Software Foundation. All rights reserved.