Modifier and Type | Method and Description |
---|---|
void |
WriteBuffer.forEach(Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunction<KeyValue> mergeFunction,
WriteBuffer.KvConsumer rawConsumer,
WriteBuffer.KvConsumer mergedConsumer)
Performs the given action for each remaining element in this buffer until all elements have
been processed or the action throws an exception.
|
void |
SortBufferWriteBuffer.forEach(Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunction<KeyValue> mergeFunction,
WriteBuffer.KvConsumer rawConsumer,
WriteBuffer.KvConsumer mergedConsumer) |
static RecordReader<KeyValue> |
MergeTreeReaders.readerForMergeTree(List<List<SortedRun>> sections,
boolean dropDelete,
KeyValueFileReaderFactory readerFactory,
Comparator<org.apache.flink.table.data.RowData> userKeyComparator,
MergeFunction<KeyValue> mergeFunction) |
Constructor and Description |
---|
MergeTreeWriter(boolean writeBufferSpillable,
int sortMaxFan,
org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager,
CompactManager compactManager,
long maxSequenceNumber,
Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunction<KeyValue> mergeFunction,
KeyValueFileWriterFactory writerFactory,
boolean commitForceCompact,
CoreOptions.ChangelogProducer changelogProducer) |
Modifier and Type | Class and Description |
---|---|
class |
DeduplicateMergeFunction
A
MergeFunction where key is primary key (unique) and value is the full record, only keep
the latest one. |
class |
PartialUpdateMergeFunction
A
MergeFunction where key is primary key (unique) and value is the partial record, update
non-null fields on merge. |
class |
ValueCountMergeFunction
A
MergeFunction where key is the full record and value is a count which represents number
of records of the exact same fields. |
Modifier and Type | Method and Description |
---|---|
default MergeFunction<T> |
MergeFunctionFactory.create() |
MergeFunction<T> |
MergeFunctionFactory.create(int[][] projection) |
Constructor and Description |
---|
FullChangelogMergeFunctionWrapper(MergeFunction<KeyValue> mergeFunction,
int maxLevel) |
ReducerMergeFunctionWrapper(MergeFunction<KeyValue> mergeFunction) |
Modifier and Type | Class and Description |
---|---|
class |
AggregateMergeFunction
A
MergeFunction where key is primary key (unique) and value is the partial record,
pre-aggregate non-null fields on merge. |
Copyright © 2019–2023 The Apache Software Foundation. All rights reserved.