Modifier and Type | Method and Description |
---|---|
static <IN> FileSink.DefaultBulkFormatBuilder<IN> |
FileSink.forBulkFormat(Path basePath,
BulkWriter.Factory<IN> bulkWriterFactory) |
Constructor and Description |
---|
BulkFormatBuilder(Path basePath,
BulkWriter.Factory<IN> writerFactory,
BucketAssigner<IN,String> assigner) |
BulkFormatBuilder(Path basePath,
long bucketCheckInterval,
BulkWriter.Factory<IN> writerFactory,
BucketAssigner<IN,String> assigner,
CheckpointRollingPolicy<IN,String> policy,
FileWriterBucketFactory<IN> bucketFactory,
OutputFileConfig outputFileConfig) |
Modifier and Type | Class and Description |
---|---|
static class |
FileSystemTableSink.ProjectionBulkFactory
Project row to non-partition fields.
|
Constructor and Description |
---|
ProjectionBulkFactory(BulkWriter.Factory<RowData> factory,
RowDataPartitionComputer computer) |
Modifier and Type | Class and Description |
---|---|
class |
AvroWriterFactory<T>
A factory that creates an
AvroBulkWriter . |
Modifier and Type | Method and Description |
---|---|
EncodingFormat<BulkWriter.Factory<RowData>> |
AvroFileFormatFactory.createEncodingFormat(DynamicTableFactory.Context context,
ReadableConfig formatOptions) |
Modifier and Type | Class and Description |
---|---|
class |
CompressWriterFactory<IN>
A factory that creates for
bulk writers that, when provided with a CompressionCodec , they compress the data they write. |
Modifier and Type | Method and Description |
---|---|
static BulkWriter.Factory<RowData> |
PythonCsvUtils.createCsvBulkWriterFactory(org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema schema,
DataType physicalDataType)
Util for creating a
BulkWriter.Factory that wraps CsvBulkWriter.forSchema(org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvMapper, org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema, org.apache.flink.formats.common.Converter<T, R, C>, C, org.apache.flink.core.fs.FSDataOutputStream) . |
Modifier and Type | Method and Description |
---|---|
EncodingFormat<BulkWriter.Factory<RowData>> |
CsvFileFormatFactory.createEncodingFormat(DynamicTableFactory.Context context,
ReadableConfig formatOptions) |
Modifier and Type | Class and Description |
---|---|
class |
ParquetWriterFactory<T>
A factory that creates a Parquet
BulkWriter . |
Modifier and Type | Method and Description |
---|---|
EncodingFormat<BulkWriter.Factory<RowData>> |
ParquetFileFormatFactory.createEncodingFormat(DynamicTableFactory.Context context,
ReadableConfig formatOptions) |
Modifier and Type | Class and Description |
---|---|
class |
SequenceFileWriterFactory<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>
A factory that creates a SequenceFile
BulkWriter . |
Modifier and Type | Method and Description |
---|---|
EncodingFormat<BulkWriter.Factory<RowData>> |
OrcFileFormatFactory.createEncodingFormat(DynamicTableFactory.Context context,
ReadableConfig formatOptions) |
Modifier and Type | Class and Description |
---|---|
class |
OrcNoHiveBulkWriterFactory
A
BulkWriter.Factory from orc no-hive version. |
Modifier and Type | Class and Description |
---|---|
class |
OrcBulkWriterFactory<T>
A factory that creates an ORC
BulkWriter . |
Modifier and Type | Method and Description |
---|---|
static <IN> StreamingFileSink.DefaultBulkFormatBuilder<IN> |
StreamingFileSink.forBulkFormat(Path basePath,
BulkWriter.Factory<IN> writerFactory)
Deprecated.
Creates the builder for a
StreamingFileSink with bulk-encoding format. |
Constructor and Description |
---|
BulkBucketWriter(RecoverableWriter recoverableWriter,
BulkWriter.Factory<IN> writerFactory) |
BulkFormatBuilder(Path basePath,
BulkWriter.Factory<IN> writerFactory,
BucketAssigner<IN,BucketID> assigner) |
BulkFormatBuilder(Path basePath,
BulkWriter.Factory<IN> writerFactory,
BucketAssigner<IN,BucketID> assigner,
CheckpointRollingPolicy<IN,BucketID> policy,
long bucketCheckInterval,
BucketFactory<IN,BucketID> bucketFactory,
OutputFileConfig outputFileConfig) |
Modifier and Type | Method and Description |
---|---|
BulkWriter.Factory<RowData> |
HiveShimV200.createOrcBulkWriterFactory(Configuration conf,
String schema,
LogicalType[] fieldTypes) |
BulkWriter.Factory<RowData> |
HiveShim.createOrcBulkWriterFactory(Configuration conf,
String schema,
LogicalType[] fieldTypes)
Create orc
BulkWriter.Factory for different hive versions. |
BulkWriter.Factory<RowData> |
HiveShimV100.createOrcBulkWriterFactory(Configuration conf,
String schema,
LogicalType[] fieldTypes) |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.