Package org.apache.flink.formats.parquet

Class ParquetFileFormatFactory

java.lang.Object

org.apache.flink.formats.parquet.ParquetFileFormatFactory

All Implemented Interfaces:

BulkReaderFormatFactory, BulkWriterFormatFactory, DecodingFormatFactory<BulkFormat<RowData,FileSourceSplit>>, EncodingFormatFactory<BulkWriter.Factory<RowData>>, Factory, FormatFactory

public class ParquetFileFormatFactory
extends Object
implements BulkReaderFormatFactory, BulkWriterFormatFactory

Parquet format factory for file system.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ParquetFileFormatFactory.ParquetBulkDecodingFormat	ParquetBulkDecodingFormat which implements FileBasedStatisticsReportableInputFormat.

Field Summary

Fields

Modifier and Type	Field	Description
static ConfigOption<Integer>	BATCH_SIZE
static String	IDENTIFIER
static ConfigOption<String>	TIMESTAMP_TIME_UNIT
static ConfigOption<Boolean>	UTC_TIMEZONE
static ConfigOption<Boolean>	WRITE_INT64_TIMESTAMP

Constructor Summary

Constructors

Constructor	Description
ParquetFileFormatFactory()

Method Summary

Modifier and Type	Method	Description
BulkDecodingFormat<RowData>	createDecodingFormat(DynamicTableFactory.Context context, ReadableConfig formatOptions)	Creates a BulkDecodingFormat from the given context and format options.
EncodingFormat<BulkWriter.Factory<RowData>>	createEncodingFormat(DynamicTableFactory.Context context, ReadableConfig formatOptions)	Creates a format from the given context and format options.
String	factoryIdentifier()	Returns a unique identifier among same factory interfaces.
Set<ConfigOption<?>>	optionalOptions()	Returns a set of ConfigOption that an implementation of this factory consumes in addition to Factory.requiredOptions().
Set<ConfigOption<?>>	requiredOptions()	Returns a set of ConfigOption that an implementation of this factory requires in addition to Factory.optionalOptions().

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.factories.FormatFactory

forwardOptions

Field Detail

IDENTIFIER

public static final String IDENTIFIER

See Also:

Constant Field Values

UTC_TIMEZONE

public static final ConfigOption<Boolean> UTC_TIMEZONE

TIMESTAMP_TIME_UNIT

public static final ConfigOption<String> TIMESTAMP_TIME_UNIT

WRITE_INT64_TIMESTAMP

public static final ConfigOption<Boolean> WRITE_INT64_TIMESTAMP

BATCH_SIZE

public static final ConfigOption<Integer> BATCH_SIZE

Constructor Detail

ParquetFileFormatFactory

public ParquetFileFormatFactory()

Method Detail

createDecodingFormat

public BulkDecodingFormat<RowData> createDecodingFormat(DynamicTableFactory.Context context,
                                                        ReadableConfig formatOptions)

Description copied from interface: BulkReaderFormatFactory

Creates a BulkDecodingFormat from the given context and format options.

Specified by:

createDecodingFormat in interface BulkReaderFormatFactory

Specified by:

createDecodingFormat in interface DecodingFormatFactory<BulkFormat<RowData,FileSourceSplit>>

createEncodingFormat

public EncodingFormat<BulkWriter.Factory<RowData>> createEncodingFormat(DynamicTableFactory.Context context,
                                                                        ReadableConfig formatOptions)

Description copied from interface: EncodingFormatFactory

Creates a format from the given context and format options.

The format options have been projected to top-level options (e.g. from format.ignore-errors to ignore-errors).

Specified by:

createEncodingFormat in interface EncodingFormatFactory<BulkWriter.Factory<RowData>>

factoryIdentifier

public String factoryIdentifier()

Description copied from interface: Factory

Returns a unique identifier among same factory interfaces.

For consistency, an identifier should be declared as one lower case word (e.g. kafka). If multiple factories exist for different versions, a version should be appended using "-" (e.g. elasticsearch-7).

Specified by:

factoryIdentifier in interface Factory

requiredOptions

public Set<ConfigOption<?>> requiredOptions()

Description copied from interface: Factory

Returns a set of ConfigOption that an implementation of this factory requires in addition to Factory.optionalOptions().

See the documentation of Factory for more information.

Specified by:

requiredOptions in interface Factory

optionalOptions

public Set<ConfigOption<?>> optionalOptions()

Description copied from interface: Factory

Returns a set of ConfigOption that an implementation of this factory consumes in addition to Factory.requiredOptions().

See the documentation of Factory for more information.

Specified by:

optionalOptions in interface Factory