Package | Description |
---|---|
org.apache.flink.connector.file.table | |
org.apache.flink.connector.file.table.stream | |
org.apache.flink.connectors.hive |
Modifier and Type | Method and Description |
---|---|
FileSystemOutputFormat.Builder<T> |
FileSystemOutputFormat.Builder.setFileSystemFactory(FileSystemFactory fileSystemFactory) |
Modifier and Type | Method and Description |
---|---|
static <T> DataStream<PartitionCommitInfo> |
StreamingSink.compactionWriter(ProviderContext providerContext,
DataStream<T> inputStream,
long bucketCheckInterval,
StreamingFileSink.BucketsBuilder<T,String,? extends StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder,
FileSystemFactory fsFactory,
Path path,
CompactReader.Factory<T> readFactory,
long targetFileSize,
int parallelism)
Create a file writer with compaction operators by input stream.
|
static DataStreamSink<?> |
StreamingSink.sink(ProviderContext providerContext,
DataStream<PartitionCommitInfo> writer,
Path locationPath,
ObjectIdentifier identifier,
List<String> partitionKeys,
TableMetaStoreFactory msFactory,
FileSystemFactory fsFactory,
Configuration options)
Create a sink from file writer.
|
Constructor and Description |
---|
PartitionCommitter(Path locationPath,
ObjectIdentifier tableIdentifier,
List<String> partitionKeys,
TableMetaStoreFactory metaStoreFactory,
FileSystemFactory fsFactory,
Configuration conf) |
Modifier and Type | Class and Description |
---|---|
class |
HadoopFileSystemFactory
Hive
FileSystemFactory , hive need use job conf to create file system. |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.