Modifier and Type | Method and Description |
---|---|
static <T> DataStream<PartitionCommitInfo> |
StreamingSink.compactionWriter(ProviderContext providerContext,
DataStream<T> inputStream,
long bucketCheckInterval,
StreamingFileSink.BucketsBuilder<T,String,? extends StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder,
FileSystemFactory fsFactory,
Path path,
CompactReader.Factory<T> readFactory,
long targetFileSize,
int parallelism)
Create a file writer with compaction operators by input stream.
|
static DataStreamSink<?> |
StreamingSink.sink(ProviderContext providerContext,
DataStream<PartitionCommitInfo> writer,
Path locationPath,
ObjectIdentifier identifier,
List<String> partitionKeys,
TableMetaStoreFactory msFactory,
FileSystemFactory fsFactory,
Configuration options)
Create a sink from file writer.
|
static <T> DataStream<PartitionCommitInfo> |
StreamingSink.writer(ProviderContext providerContext,
DataStream<T> inputStream,
long bucketCheckInterval,
StreamingFileSink.BucketsBuilder<T,String,? extends StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder,
int parallelism,
List<String> partitionKeys,
Configuration conf)
Create a file writer by input stream.
|
Modifier and Type | Method and Description |
---|---|
protected DataStream<RowData> |
HiveTableSource.getDataStream(ProviderContext providerContext,
StreamExecutionEnvironment execEnv) |
Modifier and Type | Method and Description |
---|---|
default DataStreamSink<?> |
DataStreamSinkProvider.consumeDataStream(ProviderContext providerContext,
DataStream<RowData> dataStream)
Consumes the given Java
DataStream and returns the sink transformation DataStreamSink . |
Modifier and Type | Method and Description |
---|---|
default DataStream<RowData> |
DataStreamScanProvider.produceDataStream(ProviderContext providerContext,
StreamExecutionEnvironment execEnv)
Creates a scan Java
DataStream from a StreamExecutionEnvironment . |
Modifier and Type | Interface and Description |
---|---|
static interface |
TransformationSinkProvider.Context
|
Modifier and Type | Method and Description |
---|---|
Transformation<RowData> |
TransformationScanProvider.createTransformation(ProviderContext providerContext)
Creates a
Transformation instance. |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.