Modifier and Type | Method and Description |
---|---|
static void |
HBaseOptions.validatePrimaryKey(TableSchema schema)
Checks that the HBase table have row key defined.
|
Modifier and Type | Method and Description |
---|---|
TableSchema |
AbstractHBaseTableSource.getTableSchema() |
Modifier and Type | Method and Description |
---|---|
TableSchema |
HBaseTableSchema.convertsToTableSchema()
Converts this
HBaseTableSchema to TableSchema , the fields are consisted of
families and rowkey, the order is in the definition order (i.e. |
Modifier and Type | Method and Description |
---|---|
static HBaseTableSchema |
HBaseTableSchema.fromTableSchema(TableSchema schema)
Construct a
HBaseTableSchema from a TableSchema . |
Modifier and Type | Method and Description |
---|---|
TableSchema |
HBaseUpsertTableSink.getTableSchema() |
Modifier and Type | Method and Description |
---|---|
TableSchema |
HBaseUpsertTableSink.getTableSchema() |
Modifier and Type | Method and Description |
---|---|
default void |
JdbcDialect.validate(TableSchema schema)
Check if this dialect instance support a specific data type in table schema.
|
Modifier and Type | Field and Description |
---|---|
protected TableSchema |
JdbcTableSource.Builder.schema |
protected TableSchema |
JdbcUpsertTableSink.Builder.schema |
Modifier and Type | Method and Description |
---|---|
TableSchema |
JdbcTableSource.getTableSchema() |
Modifier and Type | Method and Description |
---|---|
JdbcTableSource.Builder |
JdbcTableSource.Builder.setSchema(TableSchema schema)
required, table schema of this table source.
|
JdbcUpsertTableSink.Builder |
JdbcUpsertTableSink.Builder.setTableSchema(TableSchema schema)
required, table schema of this table source.
|
Constructor and Description |
---|
JdbcDynamicTableSink(JdbcOptions jdbcOptions,
JdbcExecutionOptions executionOptions,
JdbcDmlOptions dmlOptions,
TableSchema tableSchema) |
JdbcDynamicTableSource(JdbcOptions options,
JdbcReadOptions readOptions,
JdbcLookupOptions lookupOptions,
TableSchema physicalSchema) |
Modifier and Type | Method and Description |
---|---|
static TableSchema |
JdbcTypeUtil.normalizeTableSchema(TableSchema schema)
The original table schema may contain generated columns which shouldn't be produced/consumed
by TableSource/TableSink.
|
Modifier and Type | Method and Description |
---|---|
static TableSchema |
JdbcTypeUtil.normalizeTableSchema(TableSchema schema)
The original table schema may contain generated columns which shouldn't be produced/consumed
by TableSource/TableSink.
|
Modifier and Type | Method and Description |
---|---|
protected TableSchema |
HiveTableSource.getProducedTableSchema() |
protected TableSchema |
HiveTableSource.getTableSchema() |
Constructor and Description |
---|
HiveWriterFactory(org.apache.hadoop.mapred.JobConf jobConf,
Class hiveOutputFormatClz,
org.apache.hadoop.hive.metastore.api.SerDeInfo serDeInfo,
TableSchema schema,
String[] partitionColumns,
Properties tableProperties,
HiveShim hiveShim,
boolean isCompressed) |
Modifier and Type | Method and Description |
---|---|
TableSchema |
ParquetTableSource.getTableSchema() |
Modifier and Type | Method and Description |
---|---|
TableSchema |
OrcTableSource.getTableSchema() |
Modifier and Type | Method and Description |
---|---|
TableSchema |
StreamSQLTestProgram.GeneratorTableSource.getTableSchema() |
TableSchema |
BatchSQLTestProgram.GeneratorTableSource.getTableSchema() |
Modifier and Type | Method and Description |
---|---|
protected abstract ElasticsearchUpsertTableSinkBase |
ElasticsearchUpsertTableSinkBase.copy(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String docType,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions,
ElasticsearchUpsertTableSinkBase.RequestFactory requestFactory) |
protected abstract ElasticsearchUpsertTableSinkBase |
ElasticsearchUpsertTableSinkFactoryBase.createElasticsearchUpsertTableSink(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String docType,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions) |
Constructor and Description |
---|
ElasticsearchUpsertTableSinkBase(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String docType,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions,
ElasticsearchUpsertTableSinkBase.RequestFactory requestFactory) |
Modifier and Type | Method and Description |
---|---|
static IndexGenerator |
IndexGeneratorFactory.createIndexGenerator(String index,
TableSchema schema) |
Modifier and Type | Method and Description |
---|---|
protected ElasticsearchUpsertTableSinkBase |
Elasticsearch6UpsertTableSink.copy(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String docType,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions,
ElasticsearchUpsertTableSinkBase.RequestFactory requestFactory) |
protected ElasticsearchUpsertTableSinkBase |
Elasticsearch6UpsertTableSinkFactory.createElasticsearchUpsertTableSink(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String docType,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions) |
Constructor and Description |
---|
Elasticsearch6UpsertTableSink(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String docType,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions) |
Modifier and Type | Method and Description |
---|---|
protected ElasticsearchUpsertTableSinkBase |
Elasticsearch7UpsertTableSink.copy(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String docType,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions,
ElasticsearchUpsertTableSinkBase.RequestFactory requestFactory) |
protected ElasticsearchUpsertTableSinkBase |
Elasticsearch7UpsertTableSinkFactory.createElasticsearchUpsertTableSink(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String docType,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions) |
Constructor and Description |
---|
Elasticsearch7UpsertTableSink(boolean isAppendOnly,
TableSchema schema,
List<ElasticsearchUpsertTableSinkBase.Host> hosts,
String index,
String keyDelimiter,
String keyNullLiteral,
SerializationSchema<Row> serializationSchema,
org.elasticsearch.common.xcontent.XContentType contentType,
ActionRequestFailureHandler failureHandler,
Map<ElasticsearchUpsertTableSinkBase.SinkOption,String> sinkOptions) |
Modifier and Type | Method and Description |
---|---|
TableSchema |
KafkaTableSourceBase.getTableSchema()
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
protected KafkaTableSinkBase |
KafkaTableSourceSinkFactory.createKafkaTableSink(TableSchema schema,
String topic,
Properties properties,
Optional<FlinkKafkaPartitioner<Row>> partitioner,
SerializationSchema<Row> serializationSchema)
Deprecated.
|
protected abstract KafkaTableSinkBase |
KafkaTableSourceSinkFactoryBase.createKafkaTableSink(TableSchema schema,
String topic,
Properties properties,
Optional<FlinkKafkaPartitioner<Row>> partitioner,
SerializationSchema<Row> serializationSchema)
Deprecated.
Constructs the version-specific Kafka table sink.
|
protected KafkaTableSourceBase |
KafkaTableSourceSinkFactory.createKafkaTableSource(TableSchema schema,
Optional<String> proctimeAttribute,
List<RowtimeAttributeDescriptor> rowtimeAttributeDescriptors,
Map<String,String> fieldMapping,
String topic,
Properties properties,
DeserializationSchema<Row> deserializationSchema,
StartupMode startupMode,
Map<KafkaTopicPartition,Long> specificStartupOffsets,
long startupTimestampMillis)
Deprecated.
|
protected abstract KafkaTableSourceBase |
KafkaTableSourceSinkFactoryBase.createKafkaTableSource(TableSchema schema,
Optional<String> proctimeAttribute,
List<RowtimeAttributeDescriptor> rowtimeAttributeDescriptors,
Map<String,String> fieldMapping,
String topic,
Properties properties,
DeserializationSchema<Row> deserializationSchema,
StartupMode startupMode,
Map<KafkaTopicPartition,Long> specificStartupOffsets,
long startupTimestampMillis)
Deprecated.
Constructs the version-specific Kafka table source.
|
Constructor and Description |
---|
KafkaTableSink(TableSchema schema,
String topic,
Properties properties,
Optional<FlinkKafkaPartitioner<Row>> partitioner,
SerializationSchema<Row> serializationSchema)
Deprecated.
|
KafkaTableSinkBase(TableSchema schema,
String topic,
Properties properties,
Optional<FlinkKafkaPartitioner<Row>> partitioner,
SerializationSchema<Row> serializationSchema)
Deprecated.
|
KafkaTableSource(TableSchema schema,
Optional<String> proctimeAttribute,
List<RowtimeAttributeDescriptor> rowtimeAttributeDescriptors,
Optional<Map<String,String>> fieldMapping,
String topic,
Properties properties,
DeserializationSchema<Row> deserializationSchema,
StartupMode startupMode,
Map<KafkaTopicPartition,Long> specificStartupOffsets,
long startupTimestampMillis)
Deprecated.
Creates a generic Kafka
StreamTableSource . |
KafkaTableSource(TableSchema schema,
String topic,
Properties properties,
DeserializationSchema<Row> deserializationSchema)
Deprecated.
Creates a generic Kafka
StreamTableSource . |
KafkaTableSourceBase(TableSchema schema,
Optional<String> proctimeAttribute,
List<RowtimeAttributeDescriptor> rowtimeAttributeDescriptors,
Optional<Map<String,String>> fieldMapping,
String topic,
Properties properties,
DeserializationSchema<Row> deserializationSchema,
StartupMode startupMode,
Map<KafkaTopicPartition,Long> specificStartupOffsets,
long startupTimestampMillis)
Deprecated.
Creates a generic Kafka
StreamTableSource . |
KafkaTableSourceBase(TableSchema schema,
String topic,
Properties properties,
DeserializationSchema<Row> deserializationSchema)
Deprecated.
Creates a generic Kafka
StreamTableSource . |
Modifier and Type | Method and Description |
---|---|
TableSchema |
TableSchema.Builder.build()
Returns a
TableSchema instance. |
TableSchema |
TableSchema.copy()
Deprecated.
Returns a deep copy of the table schema.
|
static TableSchema |
TableSchema.fromResolvedSchema(ResolvedSchema resolvedSchema)
Deprecated.
Helps to migrate to the new
ResolvedSchema to old API methods. |
static TableSchema |
TableSchema.fromTypeInfo(TypeInformation<?> typeInfo)
Deprecated.
This method will be removed soon. Use
DataTypes to declare types. |
default TableSchema |
Table.getSchema()
Deprecated.
This method has been deprecated as part of FLIP-164.
TableSchema has been
replaced by two more dedicated classes Schema and ResolvedSchema . Use
Schema for declaration in APIs. ResolvedSchema is offered by the
framework after resolution and validation. |
default TableSchema |
TableResult.getTableSchema()
Deprecated.
This method has been deprecated as part of FLIP-164.
TableSchema has been
replaced by two more dedicated classes Schema and ResolvedSchema . Use
Schema for declaration in APIs. ResolvedSchema is offered by the
framework after resolution and validation. |
Modifier and Type | Method and Description |
---|---|
static <T1> TableSchema |
ConnectorCatalogTable.calculateSourceSchema(TableSource<T1> source,
boolean isBatch) |
TableSchema |
AbstractCatalogView.getSchema() |
TableSchema |
AbstractCatalogTable.getSchema() |
default TableSchema |
ResolvedCatalogBaseTable.getSchema()
Deprecated.
This method returns the deprecated
TableSchema class. The old class was a
hybrid of resolved and unresolved schema information. It has been replaced by the new
ResolvedSchema which is resolved by the framework and accessible via ResolvedCatalogBaseTable.getResolvedSchema() . |
default TableSchema |
CatalogBaseTable.getSchema()
Deprecated.
This method returns the deprecated
TableSchema class. The old class was a
hybrid of resolved and unresolved schema information. It has been replaced by the new
Schema which is always unresolved and will be resolved by the framework later. |
Modifier and Type | Method and Description |
---|---|
static QueryOperationCatalogViewTable |
QueryOperationCatalogViewTable.createCalciteTable(QueryOperationCatalogView catalogView,
TableSchema resolvedSchema) |
static Map<String,String> |
CatalogTableImpl.removeRedundant(Map<String,String> properties,
TableSchema schema,
List<String> partitionKeys)
Deprecated.
Construct catalog table properties from
CatalogTableImpl.toProperties() . |
Constructor and Description |
---|
AbstractCatalogTable(TableSchema tableSchema,
List<String> partitionKeys,
Map<String,String> options,
String comment) |
AbstractCatalogTable(TableSchema tableSchema,
Map<String,String> options,
String comment) |
AbstractCatalogView(String originalQuery,
String expandedQuery,
TableSchema schema,
Map<String,String> options,
String comment) |
CatalogTableBuilder(ConnectorDescriptor connectorDescriptor,
TableSchema tableSchema) |
CatalogTableImpl(TableSchema tableSchema,
List<String> partitionKeys,
Map<String,String> properties,
String comment)
Deprecated.
|
CatalogTableImpl(TableSchema tableSchema,
Map<String,String> properties,
String comment)
Deprecated.
|
CatalogViewImpl(String originalQuery,
String expandedQuery,
TableSchema schema,
Map<String,String> properties,
String comment)
Deprecated.
|
ConnectorCatalogTable(TableSource<T1> tableSource,
TableSink<T2> tableSink,
TableSchema tableSchema,
boolean isBatch) |
Modifier and Type | Method and Description |
---|---|
static TableSchema |
HiveTableUtil.createTableSchema(List<org.apache.hadoop.hive.metastore.api.FieldSchema> cols,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> partitionKeys,
Set<String> notNullColumns,
UniqueConstraint primaryKey)
Create a Flink's TableSchema from Hive table's columns and partition keys.
|
Modifier and Type | Method and Description |
---|---|
static List<org.apache.hadoop.hive.metastore.api.FieldSchema> |
HiveTableUtil.createHiveColumns(TableSchema schema)
Create Hive columns from Flink TableSchema.
|
Modifier and Type | Method and Description |
---|---|
static TableSchema |
SchemaValidator.deriveTableSinkSchema(DescriptorProperties properties)
Deprecated.
This method combines two separate concepts of table schema and field mapping.
This should be split into two methods once we have support for the corresponding
interfaces (see FLINK-9870).
|
TableSchema |
DescriptorProperties.getTableSchema(String key)
Deprecated.
Returns a table schema under the given existing key.
|
Modifier and Type | Method and Description |
---|---|
Optional<TableSchema> |
DescriptorProperties.getOptionalTableSchema(String key)
Deprecated.
Returns a table schema under the given key if it exists.
|
Modifier and Type | Method and Description |
---|---|
void |
DescriptorProperties.putTableSchema(String key,
TableSchema schema)
Deprecated.
Adds a table schema under the given key.
|
OldCsv |
OldCsv.schema(TableSchema schema)
Deprecated.
OldCsv supports derive schema from table schema by default, it is no
longer necessary to explicitly declare the format schema. This method will be removed in
the future. |
Schema |
Schema.schema(TableSchema schema)
Sets the schema with field names and the types.
|
Modifier and Type | Method and Description |
---|---|
static TableSchema |
TableFormatFactoryBase.deriveSchema(Map<String,String> properties)
Finds the table schema that can be used for a format schema (without time attributes and
generated columns).
|
TableSchema |
FileSystemFormatFactory.ReaderContext.getSchema()
Full schema of the table.
|
Constructor and Description |
---|
DataGenTableSource(DataGenerator<?>[] fieldGenerators,
String tableName,
TableSchema schema,
long rowsPerSecond,
Long numberOfRows) |
Constructor and Description |
---|
DeserializationSchemaAdapter(DeserializationSchema<RowData> deserializationSchema,
TableSchema schema,
int[] projectFields,
List<String> partitionKeys,
String defaultPartValue) |
Modifier and Type | Method and Description |
---|---|
static TableSchema |
OperationConverterUtils.changeColumn(TableSchema oldSchema,
String oldName,
TableColumn newTableColumn,
boolean first,
String after) |
Modifier and Type | Method and Description |
---|---|
static TableSchema |
OperationConverterUtils.changeColumn(TableSchema oldSchema,
String oldName,
TableColumn newTableColumn,
boolean first,
String after) |
Modifier and Type | Method and Description |
---|---|
TableSchema |
AbstractArrowTableSource.getTableSchema() |
Modifier and Type | Method and Description |
---|---|
TableSchema |
BatchSelectTableSink.getTableSchema() |
TableSchema |
StreamSelectTableSink.getTableSchema() |
TableSchema |
CsvTableSink.getTableSchema() |
default TableSchema |
TableSink.getTableSchema()
Deprecated.
Returns the schema of the consumed table.
|
Constructor and Description |
---|
BatchSelectTableSink(TableSchema tableSchema) |
StreamSelectTableSink(TableSchema tableSchema) |
Modifier and Type | Method and Description |
---|---|
TableSchema |
CsvTableSource.getTableSchema() |
TableSchema |
TableSource.getTableSchema()
Deprecated.
Table schema is a logical description of a table and should not be part of the
physical TableSource. Define schema when registering a Table either in DDL or in
TableEnvironment#connect(...) . |
Modifier and Type | Method and Description |
---|---|
static List<LogicalType> |
CsvTableSourceFactoryBase.getFieldLogicalTypes(TableSchema schema) |
static void |
TableSourceValidation.validateTableSource(TableSource<?> tableSource,
TableSchema schema)
Validates a TableSource.
|
Modifier and Type | Method and Description |
---|---|
static TableSchema |
TableSchemaUtils.checkOnlyPhysicalColumns(TableSchema schema)
Throws an exception if the given
TableSchema contains any non-physical columns. |
static TableSchema |
TableSchemaUtils.dropConstraint(TableSchema oriSchema,
String constraintName)
Creates a new schema but drop the constraint with given name.
|
static TableSchema |
TableSchemaUtils.getPhysicalSchema(TableSchema tableSchema)
Return
TableSchema which consists of all physical columns. |
static TableSchema |
TableSchemaUtils.projectSchema(TableSchema tableSchema,
int[][] projectedFields)
Creates a new
TableSchema with the projected fields from another TableSchema . |
Modifier and Type | Method and Description |
---|---|
static TableSchema.Builder |
TableSchemaUtils.builderWithGivenSchema(TableSchema oriSchema)
Creates a builder with given table schema.
|
static TableSchema |
TableSchemaUtils.checkOnlyPhysicalColumns(TableSchema schema)
Throws an exception if the given
TableSchema contains any non-physical columns. |
static boolean |
TableSchemaUtils.containsPhysicalColumnsOnly(TableSchema schema)
Returns true if there are only physical columns in the given
TableSchema . |
static TableSchema |
TableSchemaUtils.dropConstraint(TableSchema oriSchema,
String constraintName)
Creates a new schema but drop the constraint with given name.
|
static TableSchema |
TableSchemaUtils.getPhysicalSchema(TableSchema tableSchema)
Return
TableSchema which consists of all physical columns. |
static int[] |
TableSchemaUtils.getPrimaryKeyIndices(TableSchema schema)
Returns the field indices of primary key in the physical columns of this schema (not include
computed columns or metadata columns).
|
static TableSchema |
TableSchemaUtils.projectSchema(TableSchema tableSchema,
int[][] projectedFields)
Creates a new
TableSchema with the projected fields from another TableSchema . |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.