Modifier and Type | Method and Description |
---|---|
JdbcRowConverter |
PostgresDialect.getRowConverter(RowType rowType) |
JdbcRowConverter |
JdbcDialect.getRowConverter(RowType rowType)
Get converter that convert jdbc object and Flink internal object each other.
|
JdbcRowConverter |
MySQLDialect.getRowConverter(RowType rowType) |
Modifier and Type | Field and Description |
---|---|
protected RowType |
AbstractJdbcRowConverter.rowType |
Constructor and Description |
---|
AbstractJdbcRowConverter(RowType rowType) |
DerbyRowConverter(RowType rowType) |
MySQLRowConverter(RowType rowType) |
PostgresRowConverter(RowType rowType) |
Constructor and Description |
---|
JdbcRowDataLookupFunction(JdbcOptions options,
JdbcLookupOptions lookupOptions,
String[] fieldNames,
DataType[] fieldTypes,
String[] keyNames,
RowType rowType) |
Constructor and Description |
---|
AvroRowDataDeserializationSchema(RowType rowType,
TypeInformation<RowData> typeInfo)
Creates a Avro deserialization schema for the given logical type.
|
AvroRowDataSerializationSchema(RowType rowType)
Creates an Avro serialization schema for the given specific record class.
|
Modifier and Type | Method and Description |
---|---|
static org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema |
CsvRowSchemaConverter.convert(RowType rowType)
Convert
RowType to CsvSchema . |
Constructor and Description |
---|
Builder(RowType rowType)
Creates a
CsvRowDataSerializationSchema expecting the given RowType . |
Builder(RowType rowType,
TypeInformation<RowData> resultTypeInfo)
Creates a CSV deserialization schema for the given
TypeInformation with optional
parameters. |
CsvInputFormat(Path[] filePaths,
DataType[] fieldTypes,
String[] fieldNames,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema,
RowType formatRowType,
int[] selectFields,
List<String> partitionKeys,
String defaultPartValue,
long limit,
int[] csvSelectFieldToProjectFieldMapping,
int[] csvSelectFieldToCsvFieldMapping,
boolean ignoreParseErrors) |
Constructor and Description |
---|
JsonRowDataDeserializationSchema(RowType rowType,
TypeInformation<RowData> resultTypeInfo,
boolean failOnMissingField,
boolean ignoreParseErrors,
TimestampFormat timestampFormat) |
JsonRowDataSerializationSchema(RowType rowType,
TimestampFormat timestampFormat) |
Constructor and Description |
---|
CanalJsonDeserializationSchema(RowType rowType,
TypeInformation<RowData> resultTypeInfo,
boolean ignoreParseErrors,
TimestampFormat timestampFormatOption) |
Constructor and Description |
---|
DebeziumJsonDeserializationSchema(RowType rowType,
TypeInformation<RowData> resultTypeInfo,
boolean schemaInclude,
boolean ignoreParseErrors,
TimestampFormat timestampFormatOption) |
Modifier and Type | Method and Description |
---|---|
static ParquetWriterFactory<RowData> |
ParquetRowDataBuilder.createWriterFactory(RowType rowType,
Configuration conf,
boolean utcTimestamp)
Create a parquet
BulkWriter.Factory . |
Constructor and Description |
---|
FlinkParquetBuilder(RowType rowType,
Configuration conf,
boolean utcTimestamp) |
ParquetRowDataBuilder(org.apache.parquet.io.OutputFile path,
RowType rowType,
boolean utcTimestamp) |
ParquetRowDataWriter(org.apache.parquet.io.api.RecordConsumer recordConsumer,
RowType rowType,
org.apache.parquet.schema.GroupType schema,
boolean utcTimestamp) |
Modifier and Type | Method and Description |
---|---|
static org.apache.parquet.schema.MessageType |
ParquetSchemaConverter.convertToParquetMessageType(String name,
RowType rowType) |
Modifier and Type | Method and Description |
---|---|
default RowType |
FileSystemFormatFactory.ReaderContext.getFormatRowType()
RowType of table that excludes partition key fields.
|
default RowType |
FileSystemFormatFactory.WriterContext.getFormatRowType()
Get RowType of the table without partition keys.
|
Modifier and Type | Method and Description |
---|---|
static RowArrowReader |
ArrowUtils.createRowArrowReader(org.apache.arrow.vector.VectorSchemaRoot root,
RowType rowType)
Creates an
ArrowReader for the specified VectorSchemaRoot . |
static ArrowWriter<Row> |
ArrowUtils.createRowArrowWriter(org.apache.arrow.vector.VectorSchemaRoot root,
RowType rowType)
Creates an
ArrowWriter for the specified VectorSchemaRoot . |
static RowDataArrowReader |
ArrowUtils.createRowDataArrowReader(org.apache.arrow.vector.VectorSchemaRoot root,
RowType rowType)
Creates an
ArrowReader for blink planner for the specified VectorSchemaRoot . |
static ArrowWriter<RowData> |
ArrowUtils.createRowDataArrowWriter(org.apache.arrow.vector.VectorSchemaRoot root,
RowType rowType)
Creates an
ArrowWriter for blink planner for the specified VectorSchemaRoot . |
static org.apache.arrow.vector.types.pojo.Schema |
ArrowUtils.toArrowSchema(RowType rowType)
Returns the Arrow schema of the specified type.
|
Modifier and Type | Field and Description |
---|---|
protected RowType |
AbstractPythonStatelessFunctionFlatMap.inputType
The input logical type.
|
protected RowType |
AbstractPythonStatelessFunctionFlatMap.outputType
The output logical type.
|
protected RowType |
AbstractPythonStatelessFunctionFlatMap.userDefinedFunctionInputType
The user-defined function input logical type.
|
protected RowType |
AbstractPythonStatelessFunctionFlatMap.userDefinedFunctionOutputType
The user-defined function output logical type.
|
Constructor and Description |
---|
AbstractPythonScalarFunctionFlatMap(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
AbstractPythonStatelessFunctionFlatMap(Configuration config,
RowType inputType,
RowType outputType,
int[] userDefinedFunctionInputOffsets) |
PythonScalarFunctionFlatMap(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
PythonTableFunctionFlatMap(Configuration config,
PythonFunctionInfo tableFunction,
RowType inputType,
RowType outputType,
int[] udtfInputOffsets,
org.apache.calcite.rel.core.JoinRelType joinType) |
Constructor and Description |
---|
ArrowPythonScalarFunctionFlatMap(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
Constructor and Description |
---|
MiniBatchGroupAggFunction(GeneratedAggsHandleFunction genAggsHandler,
GeneratedRecordEqualiser genRecordEqualiser,
LogicalType[] accTypes,
RowType inputType,
int indexOfCountStar,
boolean generateUpdateBefore)
Creates a
MiniBatchGroupAggFunction . |
Modifier and Type | Method and Description |
---|---|
static HashJoinOperator |
HashJoinOperator.newHashJoinOperator(HashJoinType type,
GeneratedJoinCondition condFuncCode,
boolean reverseJoinFunction,
boolean[] filterNullKeys,
GeneratedProjection buildProjectionCode,
GeneratedProjection probeProjectionCode,
boolean tryDistinctBuildRow,
int buildRowSize,
long buildRowCount,
long probeRowCount,
RowType keyType) |
Modifier and Type | Field and Description |
---|---|
protected RowType |
AbstractStatelessFunctionOperator.inputType
The input logical type.
|
protected RowType |
AbstractStatelessFunctionOperator.outputType
The output logical type.
|
protected RowType |
AbstractStatelessFunctionOperator.userDefinedFunctionInputType
The user-defined function input logical type.
|
protected RowType |
AbstractStatelessFunctionOperator.userDefinedFunctionOutputType
The user-defined function output logical type.
|
Constructor and Description |
---|
AbstractStatelessFunctionOperator(Configuration config,
RowType inputType,
RowType outputType,
int[] userDefinedFunctionInputOffsets) |
Constructor and Description |
---|
AbstractRowDataPythonScalarFunctionOperator(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
AbstractRowPythonScalarFunctionOperator(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
PythonScalarFunctionOperator(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
RowDataPythonScalarFunctionOperator(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
Constructor and Description |
---|
ArrowPythonScalarFunctionOperator(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
RowDataArrowPythonScalarFunctionOperator(Configuration config,
PythonFunctionInfo[] scalarFunctions,
RowType inputType,
RowType outputType,
int[] udfInputOffsets,
int[] forwardedFields) |
Constructor and Description |
---|
AbstractPythonTableFunctionOperator(Configuration config,
PythonFunctionInfo tableFunction,
RowType inputType,
RowType outputType,
int[] udtfInputOffsets,
org.apache.calcite.rel.core.JoinRelType joinType) |
PythonTableFunctionOperator(Configuration config,
PythonFunctionInfo tableFunction,
RowType inputType,
RowType outputType,
int[] udtfInputOffsets,
org.apache.calcite.rel.core.JoinRelType joinType) |
RowDataPythonTableFunctionOperator(Configuration config,
PythonFunctionInfo tableFunction,
RowType inputType,
RowType outputType,
int[] udtfInputOffsets,
org.apache.calcite.rel.core.JoinRelType joinType) |
Modifier and Type | Method and Description |
---|---|
RowType |
AbstractPythonStatelessFunctionRunner.getInputType()
Gets the logical type of the input elements of the Python user-defined functions.
|
RowType |
AbstractPythonStatelessFunctionRunner.getOutputType()
Gets the logical type of the execution results of the Python user-defined functions.
|
Constructor and Description |
---|
AbstractPythonStatelessFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
String functionUrn,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
Constructor and Description |
---|
AbstractGeneralPythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
AbstractPythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
PythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
RowDataPythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
Constructor and Description |
---|
AbstractArrowPythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
int maxArrowBatchSize,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
ArrowPythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
int maxArrowBatchSize,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
RowDataArrowPythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
int maxBatchSize,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
Constructor and Description |
---|
AbstractPythonTableFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo tableFunction,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
PythonTableFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo tableFunction,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
RowDataPythonTableFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo tableFunction,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
Modifier and Type | Method and Description |
---|---|
static RowType |
PlannerTypeUtils.toRowType(LogicalType t) |
Modifier and Type | Method and Description |
---|---|
RowType |
RowDataTypeInfo.toRowType() |
Modifier and Type | Method and Description |
---|---|
static RowDataTypeInfo |
RowDataTypeInfo.of(RowType rowType) |
FlinkFnApi.Schema.FieldType |
PythonTypeUtils.LogicalTypeToProtoTypeConverter.visit(RowType rowType) |
Constructor and Description |
---|
RowDataSerializer(ExecutionConfig config,
RowType rowType) |
RowDataTypeInfo(RowType rowType) |
Modifier and Type | Method and Description |
---|---|
static RowType |
RowType.of(LogicalType... types) |
static RowType |
RowType.of(LogicalType[] types,
String[] names) |
Modifier and Type | Method and Description |
---|---|
R |
LogicalTypeVisitor.visit(RowType rowType) |
Modifier and Type | Method and Description |
---|---|
R |
LogicalTypeDefaultVisitor.visit(RowType rowType) |
LogicalType |
LogicalTypeDuplicator.visit(RowType rowType) |
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.