Package | Description |
---|---|
org.apache.flink.table.filesystem.stream |
Modifier and Type | Method and Description |
---|---|
static <T> DataStream<PartitionCommitInfo> |
StreamingSink.compactionWriter(DataStream<T> inputStream,
long bucketCheckInterval,
StreamingFileSink.BucketsBuilder<T,String,? extends StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder,
FileSystemFactory fsFactory,
Path path,
CompactReader.Factory<T> readFactory,
long targetFileSize)
Create a file writer with compaction operators by input stream.
|
static <T> DataStream<PartitionCommitInfo> |
StreamingSink.writer(DataStream<T> inputStream,
long bucketCheckInterval,
StreamingFileSink.BucketsBuilder<T,String,? extends StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder)
Create a file writer by input stream.
|
Modifier and Type | Method and Description |
---|---|
void |
PartitionCommitter.processElement(StreamRecord<PartitionCommitInfo> element) |
static DataStreamSink<?> |
StreamingSink.sink(DataStream<PartitionCommitInfo> writer,
Path locationPath,
ObjectIdentifier identifier,
List<String> partitionKeys,
TableMetaStoreFactory msFactory,
FileSystemFactory fsFactory,
Configuration options)
Create a sink from file writer.
|
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.