public abstract class FileFormat extends Object
NOTE: This class must be thread safe.
Modifier and Type | Field and Description |
---|---|
protected String |
formatIdentifier |
Modifier | Constructor and Description |
---|---|
protected |
FileFormat(String formatIdentifier) |
Modifier and Type | Method and Description |
---|---|
org.apache.flink.connector.file.src.reader.BulkFormat<org.apache.flink.table.data.RowData,org.apache.flink.connector.file.src.FileSourceSplit> |
createReaderFactory(org.apache.flink.table.types.logical.RowType rowType) |
org.apache.flink.connector.file.src.reader.BulkFormat<org.apache.flink.table.data.RowData,org.apache.flink.connector.file.src.FileSourceSplit> |
createReaderFactory(org.apache.flink.table.types.logical.RowType rowType,
int[][] projection) |
abstract org.apache.flink.connector.file.src.reader.BulkFormat<org.apache.flink.table.data.RowData,org.apache.flink.connector.file.src.FileSourceSplit> |
createReaderFactory(org.apache.flink.table.types.logical.RowType type,
int[][] projection,
List<Predicate> filters)
Create a
BulkFormat from the type, with projection pushed down. |
Optional<FileStatsExtractor> |
createStatsExtractor(org.apache.flink.table.types.logical.RowType type) |
abstract org.apache.flink.api.common.serialization.BulkWriter.Factory<org.apache.flink.table.data.RowData> |
createWriterFactory(org.apache.flink.table.types.logical.RowType type)
Create a
BulkWriter.Factory from the type. |
static FileFormat |
fromIdentifier(String identifier,
org.apache.flink.configuration.Configuration options)
Create a
FileFormat from format identifier and format options. |
static FileFormat |
fromTableOptions(org.apache.flink.configuration.Configuration tableOptions,
org.apache.flink.configuration.ConfigOption<String> formatOption)
Create a
FileFormat from table options. |
String |
getFormatIdentifier() |
protected String formatIdentifier
protected FileFormat(String formatIdentifier)
public String getFormatIdentifier()
public abstract org.apache.flink.connector.file.src.reader.BulkFormat<org.apache.flink.table.data.RowData,org.apache.flink.connector.file.src.FileSourceSplit> createReaderFactory(org.apache.flink.table.types.logical.RowType type, int[][] projection, @Nullable List<Predicate> filters)
BulkFormat
from the type, with projection pushed down.type
- Type without projection.projection
- See Projection.toNestedIndexes()
.filters
- A list of filters in conjunctive form for filtering on a best-effort basis.public abstract org.apache.flink.api.common.serialization.BulkWriter.Factory<org.apache.flink.table.data.RowData> createWriterFactory(org.apache.flink.table.types.logical.RowType type)
BulkWriter.Factory
from the type.public org.apache.flink.connector.file.src.reader.BulkFormat<org.apache.flink.table.data.RowData,org.apache.flink.connector.file.src.FileSourceSplit> createReaderFactory(org.apache.flink.table.types.logical.RowType rowType)
public org.apache.flink.connector.file.src.reader.BulkFormat<org.apache.flink.table.data.RowData,org.apache.flink.connector.file.src.FileSourceSplit> createReaderFactory(org.apache.flink.table.types.logical.RowType rowType, int[][] projection)
public Optional<FileStatsExtractor> createStatsExtractor(org.apache.flink.table.types.logical.RowType type)
public static FileFormat fromTableOptions(org.apache.flink.configuration.Configuration tableOptions, org.apache.flink.configuration.ConfigOption<String> formatOption)
FileFormat
from table options.public static FileFormat fromIdentifier(String identifier, org.apache.flink.configuration.Configuration options)
FileFormat
from format identifier and format options.Copyright © 2019–2023 The Apache Software Foundation. All rights reserved.