Modifier and Type | Field and Description |
---|---|
protected KeyValue |
MergeTreeBenchmark.kv |
Modifier and Type | Field and Description |
---|---|
protected RecordWriter<KeyValue> |
MergeTreeBenchmark.writer |
Modifier and Type | Method and Description |
---|---|
KeyValue |
KeyValue.copy(org.apache.flink.table.runtime.typeutils.RowDataSerializer keySerializer,
org.apache.flink.table.runtime.typeutils.RowDataSerializer valueSerializer) |
KeyValue |
KeyValueSerializer.fromRow(org.apache.flink.table.data.RowData row) |
KeyValue |
KeyValueSerializer.getReusedKv() |
KeyValue |
KeyValue.replace(org.apache.flink.table.data.RowData key,
long sequenceNumber,
org.apache.flink.types.RowKind valueKind,
org.apache.flink.table.data.RowData value) |
KeyValue |
KeyValue.replace(org.apache.flink.table.data.RowData key,
org.apache.flink.types.RowKind valueKind,
org.apache.flink.table.data.RowData value) |
KeyValue |
KeyValue.replaceKey(org.apache.flink.table.data.RowData key) |
KeyValue |
KeyValue.setLevel(int level) |
Modifier and Type | Method and Description |
---|---|
org.apache.flink.table.data.RowData |
KeyValueSerializer.toRow(KeyValue record) |
Constructor and Description |
---|
KeyValueFileStore(SchemaManager schemaManager,
long schemaId,
CoreOptions options,
org.apache.flink.table.types.logical.RowType partitionType,
org.apache.flink.table.types.logical.RowType bucketKeyType,
org.apache.flink.table.types.logical.RowType keyType,
org.apache.flink.table.types.logical.RowType valueType,
KeyValueFieldsExtractor keyValueFieldsExtractor,
MergeFunctionFactory<KeyValue> mfFactory) |
Modifier and Type | Method and Description |
---|---|
RecordReader<KeyValue> |
KeyValueFileReaderFactory.createRecordReader(long schemaId,
String fileName,
int level) |
RollingFileWriter<KeyValue,DataFileMeta> |
KeyValueFileWriterFactory.createRollingChangelogFileWriter(int level) |
RollingFileWriter<KeyValue,DataFileMeta> |
KeyValueFileWriterFactory.createRollingMergeTreeFileWriter(int level) |
RecordReader.RecordIterator<KeyValue> |
KeyValueDataFileRecordReader.readBatch() |
Modifier and Type | Method and Description |
---|---|
void |
KeyValueDataFileWriter.write(KeyValue kv) |
Constructor and Description |
---|
KeyValueDataFileWriter(org.apache.flink.api.common.serialization.BulkWriter.Factory<org.apache.flink.table.data.RowData> factory,
org.apache.flink.core.fs.Path path,
java.util.function.Function<KeyValue,org.apache.flink.table.data.RowData> converter,
org.apache.flink.table.types.logical.RowType keyType,
org.apache.flink.table.types.logical.RowType valueType,
FileStatsExtractor fileStatsExtractor,
long schemaId,
int level) |
Modifier and Type | Method and Description |
---|---|
RecordReader.RecordIterator<KeyValue> |
DropDeleteReader.readBatch() |
static RecordReader<KeyValue> |
MergeTreeReaders.readerForMergeTree(List<List<SortedRun>> sections,
boolean dropDelete,
KeyValueFileReaderFactory readerFactory,
Comparator<org.apache.flink.table.data.RowData> userKeyComparator,
MergeFunction<KeyValue> mergeFunction) |
static RecordReader<KeyValue> |
MergeTreeReaders.readerForRun(SortedRun run,
KeyValueFileReaderFactory readerFactory) |
static RecordReader<KeyValue> |
MergeTreeReaders.readerForSection(List<SortedRun> section,
KeyValueFileReaderFactory readerFactory,
Comparator<org.apache.flink.table.data.RowData> userKeyComparator,
MergeFunctionWrapper<KeyValue> mergeFunctionWrapper) |
Modifier and Type | Method and Description |
---|---|
void |
WriteBuffer.KvConsumer.accept(KeyValue kv) |
void |
MergeTreeWriter.write(KeyValue kv) |
Modifier and Type | Method and Description |
---|---|
void |
WriteBuffer.forEach(Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunction<KeyValue> mergeFunction,
WriteBuffer.KvConsumer rawConsumer,
WriteBuffer.KvConsumer mergedConsumer)
Performs the given action for each remaining element in this buffer until all elements have
been processed or the action throws an exception.
|
void |
SortBufferWriteBuffer.forEach(Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunction<KeyValue> mergeFunction,
WriteBuffer.KvConsumer rawConsumer,
WriteBuffer.KvConsumer mergedConsumer) |
static RecordReader<KeyValue> |
MergeTreeReaders.readerForMergeTree(List<List<SortedRun>> sections,
boolean dropDelete,
KeyValueFileReaderFactory readerFactory,
Comparator<org.apache.flink.table.data.RowData> userKeyComparator,
MergeFunction<KeyValue> mergeFunction) |
static RecordReader<KeyValue> |
MergeTreeReaders.readerForSection(List<SortedRun> section,
KeyValueFileReaderFactory readerFactory,
Comparator<org.apache.flink.table.data.RowData> userKeyComparator,
MergeFunctionWrapper<KeyValue> mergeFunctionWrapper) |
Constructor and Description |
---|
DropDeleteReader(RecordReader<KeyValue> reader) |
MergeTreeWriter(boolean writeBufferSpillable,
int sortMaxFan,
org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager,
CompactManager compactManager,
long maxSequenceNumber,
Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunction<KeyValue> mergeFunction,
KeyValueFileWriterFactory writerFactory,
boolean commitForceCompact,
CoreOptions.ChangelogProducer changelogProducer) |
Modifier and Type | Field and Description |
---|---|
protected MergeFunctionFactory<KeyValue> |
MergeTreeCompactRewriter.mfFactory |
Modifier and Type | Method and Description |
---|---|
KeyValue |
FullChangelogMergeFunctionWrapper.Result.after()
Latest full compaction result for this key.
|
KeyValue |
FullChangelogMergeFunctionWrapper.Result.before()
Previous full compaction result for this key.
|
KeyValue |
ReducerMergeFunctionWrapper.getResult()
Get current value of the
MergeFunction helper. |
KeyValue |
PartialUpdateMergeFunction.getResult() |
KeyValue |
DeduplicateMergeFunction.getResult() |
KeyValue |
ValueCountMergeFunction.getResult() |
KeyValue |
FullChangelogMergeFunctionWrapper.Result.result()
Latest full compaction result (result of merge function) for this key.
|
Modifier and Type | Method and Description |
---|---|
static MergeFunctionFactory<KeyValue> |
DeduplicateMergeFunction.factory() |
static MergeFunctionFactory<KeyValue> |
ValueCountMergeFunction.factory() |
static MergeFunctionFactory<KeyValue> |
PartialUpdateMergeFunction.factory(boolean ignoreDelete,
List<org.apache.flink.table.types.logical.LogicalType> tableTypes) |
Modifier and Type | Method and Description |
---|---|
void |
ReducerMergeFunctionWrapper.add(KeyValue kv)
Adds the given
KeyValue to the MergeFunction helper. |
void |
PartialUpdateMergeFunction.add(KeyValue kv) |
void |
DeduplicateMergeFunction.add(KeyValue kv) |
void |
MergeFunctionWrapper.add(KeyValue kv) |
void |
ValueCountMergeFunction.add(KeyValue kv) |
void |
MergeFunction.add(KeyValue kv)
Add the given
KeyValue to the merge function. |
void |
FullChangelogMergeFunctionWrapper.add(KeyValue kv) |
Constructor and Description |
---|
FullChangelogMergeFunctionWrapper(MergeFunction<KeyValue> mergeFunction,
int maxLevel) |
FullChangelogMergeTreeCompactRewriter(int maxLevel,
KeyValueFileReaderFactory readerFactory,
KeyValueFileWriterFactory writerFactory,
Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunctionFactory<KeyValue> mfFactory) |
MergeTreeCompactRewriter(KeyValueFileReaderFactory readerFactory,
KeyValueFileWriterFactory writerFactory,
Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunctionFactory<KeyValue> mfFactory) |
ReducerMergeFunctionWrapper(MergeFunction<KeyValue> mergeFunction) |
SortMergeReader(List<RecordReader<KeyValue>> readers,
Comparator<org.apache.flink.table.data.RowData> userKeyComparator,
MergeFunctionWrapper<T> mergeFunctionWrapper) |
Modifier and Type | Method and Description |
---|---|
KeyValue |
AggregateMergeFunction.getResult() |
Modifier and Type | Method and Description |
---|---|
static MergeFunctionFactory<KeyValue> |
AggregateMergeFunction.factory(org.apache.flink.configuration.Configuration conf,
List<String> tableNames,
List<org.apache.flink.table.types.logical.LogicalType> tableTypes,
List<String> primaryKeys) |
Modifier and Type | Method and Description |
---|---|
void |
AggregateMergeFunction.add(KeyValue kv) |
Modifier and Type | Method and Description |
---|---|
AbstractFileStoreWrite.WriterContainer<KeyValue> |
KeyValueFileStoreWrite.createEmptyWriterContainer(org.apache.flink.table.data.binary.BinaryRowData partition,
int bucket,
ExecutorService compactExecutor) |
RecordReader<KeyValue> |
KeyValueFileStoreRead.createReader(DataSplit split) |
AbstractFileStoreWrite.WriterContainer<KeyValue> |
KeyValueFileStoreWrite.createWriterContainer(org.apache.flink.table.data.binary.BinaryRowData partition,
int bucket,
ExecutorService compactExecutor) |
FileStoreRead<KeyValue> |
KeyValueFileStoreRead.withFilter(Predicate predicate) |
Constructor and Description |
---|
KeyValueFileStoreRead(SchemaManager schemaManager,
long schemaId,
org.apache.flink.table.types.logical.RowType keyType,
org.apache.flink.table.types.logical.RowType valueType,
Comparator<org.apache.flink.table.data.RowData> keyComparator,
MergeFunctionFactory<KeyValue> mfFactory,
FileFormat fileFormat,
FileStorePathFactory pathFactory,
KeyValueFieldsExtractor extractor) |
KeyValueFileStoreWrite(SchemaManager schemaManager,
long schemaId,
String commitUser,
org.apache.flink.table.types.logical.RowType keyType,
org.apache.flink.table.types.logical.RowType valueType,
java.util.function.Supplier<Comparator<org.apache.flink.table.data.RowData>> keyComparatorSupplier,
MergeFunctionFactory<KeyValue> mfFactory,
FileStorePathFactory pathFactory,
SnapshotManager snapshotManager,
FileStoreScan scan,
CoreOptions options,
KeyValueFieldsExtractor extractor) |
Modifier and Type | Method and Description |
---|---|
KeyValue |
ResetRowKindRecordIterator.nextKeyValue() |
Modifier and Type | Method and Description |
---|---|
protected abstract RecordReader.RecordIterator<org.apache.flink.table.data.RowData> |
KeyValueTableRead.rowDataRecordIteratorFromKv(RecordReader.RecordIterator<KeyValue> kvRecordIterator) |
Constructor and Description |
---|
ResetRowKindRecordIterator(RecordReader.RecordIterator<KeyValue> kvIterator) |
ValueContentRowDataRecordIterator(RecordReader.RecordIterator<KeyValue> kvIterator) |
ValueCountRowDataRecordIterator(RecordReader.RecordIterator<KeyValue> kvIterator) |
Copyright © 2019–2023 The Apache Software Foundation. All rights reserved.