Modifier and Type | Method and Description |
---|---|
static <T> DataStreamSink<?> |
BatchSink.createBatchCompactSink(DataStream<CompactMessages.CoordinatorInput> dataStream,
StreamingFileSink.BucketsBuilder<T,String,? extends StreamingFileSink.BucketsBuilder<T,String,?>> builder,
CompactReader.Factory<T> readFactory,
FileSystemFactory fsFactory,
TableMetaStoreFactory metaStoreFactory,
PartitionCommitPolicyFactory partitionCommitPolicyFactory,
String[] partitionColumns,
LinkedHashMap<String,String> staticPartitionSpec,
Path tmpPath,
ObjectIdentifier identifier,
long compactAverageSize,
long compactTargetSize,
boolean isToLocal,
boolean overwrite,
int compactParallelism,
boolean compactParallelismConfigured) |
Modifier and Type | Method and Description |
---|---|
void |
BatchCompactCoordinator.processElement(StreamRecord<CompactMessages.CoordinatorInput> element) |
Modifier and Type | Class and Description |
---|---|
static class |
CompactMessages.EndCheckpoint
A flag to end checkpoint, coordinator can start coordinating one checkpoint.
|
static class |
CompactMessages.InputFile
A partitioned input file.
|
Modifier and Type | Method and Description |
---|---|
void |
CompactCoordinator.processElement(StreamRecord<CompactMessages.CoordinatorInput> element) |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.