Package | Description |
---|---|
org.apache.flink.connectors.hive | |
org.apache.flink.table.filesystem | |
org.apache.flink.table.filesystem.stream |
Modifier and Type | Class and Description |
---|---|
class |
HadoopFileSystemFactory
Hive
FileSystemFactory , hive need use job conf to create file system. |
Modifier and Type | Method and Description |
---|---|
FileSystemOutputFormat.Builder<T> |
FileSystemOutputFormat.Builder.setFileSystemFactory(FileSystemFactory fileSystemFactory) |
Modifier and Type | Method and Description |
---|---|
static <T> DataStream<PartitionCommitInfo> |
StreamingSink.compactionWriter(DataStream<T> inputStream,
long bucketCheckInterval,
StreamingFileSink.BucketsBuilder<T,String,? extends StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder,
FileSystemFactory fsFactory,
Path path,
CompactReader.Factory<T> readFactory,
long targetFileSize,
int parallelism)
Create a file writer with compaction operators by input stream.
|
static DataStreamSink<?> |
StreamingSink.sink(DataStream<PartitionCommitInfo> writer,
Path locationPath,
ObjectIdentifier identifier,
List<String> partitionKeys,
TableMetaStoreFactory msFactory,
FileSystemFactory fsFactory,
Configuration options)
Create a sink from file writer.
|
Constructor and Description |
---|
PartitionCommitter(Path locationPath,
ObjectIdentifier tableIdentifier,
List<String> partitionKeys,
TableMetaStoreFactory metaStoreFactory,
FileSystemFactory fsFactory,
Configuration conf) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.