org.apache.flink.table.planner.plan.reuse

Class ScanReuserUtils

java.lang.Object

org.apache.flink.table.planner.plan.reuse.ScanReuserUtils

public class ScanReuserUtils
extends Object

Utils for ScanReuser.

Method Summary

Modifier and Type	Method and Description
static List<SourceAbilitySpec>	abilitySpecsWithoutEscaped(org.apache.flink.table.planner.plan.schema.TableSourceTable table) Returns a list of SourceAbilitySpec instances associated with a given TableSourceTable instance, excluding some particular abilities, such as ProjectPushDownSpec.
static int[][]	concatProjectedFields(ResolvedSchema schema, RowType originType, int[][] physicalFields, List<String> metaKeys)
static boolean	containsRexNodeSpecAfterProjection(org.apache.flink.table.planner.plan.nodes.physical.common.CommonPhysicalTableSourceScan table) Contains SourceAbilitySpec.needAdjustFieldReferenceAfterProjection() spec after projection push down except WatermarkPushDownSpec.
static org.apache.calcite.rel.core.Calc	createCalcForScan(org.apache.calcite.rel.RelNode input, org.apache.calcite.rex.RexProgram program)
static <T extends SourceAbilitySpec> T	getAbilitySpec(SourceAbilitySpec[] abilitySpecs, Class<T> specClass)
static Optional<WatermarkPushDownSpec>	getAdjustedWatermarkSpec(org.apache.flink.table.planner.plan.schema.TableSourceTable table, RowType oldSourceType, RowType newSourceType) Watermark push down must be after projection push down, so we need to adjust its index.
static String	getDigest(org.apache.flink.table.planner.plan.nodes.physical.common.CommonPhysicalTableSourceScan scan, boolean withoutEscape) Get the digest of CommonPhysicalTableSourceScan, which ignoring certain SourceAbilitySpec.
static int	indexOf(int[][] projectedFields, int[] fieldIndices) Found the index of specific projected field in the nested array which is made up of all projected fields index paths.
static boolean	isEscapeDigest(SourceAbilitySpec spec)
static List<String>	metadataKeys(org.apache.flink.table.planner.plan.schema.TableSourceTable source)
static org.apache.flink.table.planner.plan.nodes.physical.common.CommonPhysicalTableSourceScan	pickScanWithWatermark(List<org.apache.flink.table.planner.plan.nodes.physical.common.CommonPhysicalTableSourceScan> scans)
static int[][]	projectedFields(org.apache.flink.table.planner.plan.schema.TableSourceTable source)
static boolean	reusableWithoutAdjust(List<? extends org.apache.calcite.rel.RelNode> reusableNodes)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

indexOf

public static int indexOf(int[][] projectedFields,
                          int[] fieldIndices)

Found the index of specific projected field in the nested array which is made up of all projected fields index paths.

abilitySpecsWithoutEscaped

public static List<SourceAbilitySpec> abilitySpecsWithoutEscaped(org.apache.flink.table.planner.plan.schema.TableSourceTable table)

Returns a list of SourceAbilitySpec instances associated with a given TableSourceTable instance, excluding some particular abilities, such as ProjectPushDownSpec. These abilities don't need before do scan reuse.

isEscapeDigest

public static boolean isEscapeDigest(SourceAbilitySpec spec)

containsRexNodeSpecAfterProjection

public static boolean containsRexNodeSpecAfterProjection(org.apache.flink.table.planner.plan.nodes.physical.common.CommonPhysicalTableSourceScan table)

Contains SourceAbilitySpec.needAdjustFieldReferenceAfterProjection() spec after projection push down except WatermarkPushDownSpec. We have customized the solution for watermark push down.

getAdjustedWatermarkSpec

public static Optional<WatermarkPushDownSpec> getAdjustedWatermarkSpec(org.apache.flink.table.planner.plan.schema.TableSourceTable table,
                                                                       RowType oldSourceType,
                                                                       RowType newSourceType)

Watermark push down must be after projection push down, so we need to adjust its index.

createCalcForScan

public static org.apache.calcite.rel.core.Calc createCalcForScan(org.apache.calcite.rel.RelNode input,
                                                                 org.apache.calcite.rex.RexProgram program)

projectedFields

public static int[][] projectedFields(org.apache.flink.table.planner.plan.schema.TableSourceTable source)

metadataKeys

public static List<String> metadataKeys(org.apache.flink.table.planner.plan.schema.TableSourceTable source)

concatProjectedFields

public static int[][] concatProjectedFields(ResolvedSchema schema,
                                            RowType originType,
                                            int[][] physicalFields,
                                            List<String> metaKeys)

reusableWithoutAdjust

public static boolean reusableWithoutAdjust(List<? extends org.apache.calcite.rel.RelNode> reusableNodes)

getDigest

public static String getDigest(org.apache.flink.table.planner.plan.nodes.physical.common.CommonPhysicalTableSourceScan scan,
                               boolean withoutEscape)

Get the digest of CommonPhysicalTableSourceScan, which ignoring certain SourceAbilitySpec.

Parameters:

scan - input CommonPhysicalTableSourceScan.

withoutEscape - Whether to include these escape SourceAbilitySpecs in returned digest.

Returns:

the digest that ignore certain SourceAbilitySpec.

getAbilitySpec

public static <T extends SourceAbilitySpec> T getAbilitySpec(SourceAbilitySpec[] abilitySpecs,
                                                             Class<T> specClass)

pickScanWithWatermark

public static org.apache.flink.table.planner.plan.nodes.physical.common.CommonPhysicalTableSourceScan pickScanWithWatermark(List<org.apache.flink.table.planner.plan.nodes.physical.common.CommonPhysicalTableSourceScan> scans)