Package | Description |
---|---|
org.apache.flink.connector.file.table.stream | |
org.apache.flink.connector.file.table.stream.compact | |
org.apache.flink.connectors.hive.read |
Modifier and Type | Method and Description |
---|---|
static <T> DataStream<PartitionCommitInfo> |
StreamingSink.compactionWriter(ProviderContext providerContext,
DataStream<T> inputStream,
long bucketCheckInterval,
StreamingFileSink.BucketsBuilder<T,String,? extends StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder,
FileSystemFactory fsFactory,
Path path,
CompactReader.Factory<T> readFactory,
long targetFileSize,
int parallelism)
Create a file writer with compaction operators by input stream.
|
Modifier and Type | Method and Description |
---|---|
static <T> CompactReader.Factory<T> |
CompactBulkReader.factory(BulkFormat<T,FileSourceSplit> format) |
static <T> CompactReader.Factory<T> |
FileInputFormatCompactReader.factory(FileInputFormat<T> format) |
Constructor and Description |
---|
CompactOperator(SupplierWithException<FileSystem,IOException> fsFactory,
CompactReader.Factory<T> readerFactory,
CompactWriter.Factory<T> writerFactory) |
Modifier and Type | Class and Description |
---|---|
class |
HiveCompactReaderFactory
The
CompactReader.Factory to delegate hive bulk format. |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.