Constructor and Description |
---|
HiveTableSink(ReadableConfig flinkConf,
org.apache.hadoop.mapred.JobConf jobConf,
ObjectIdentifier identifier,
CatalogTable table,
Integer configuredParallelism) |
Modifier and Type | Method and Description |
---|---|
protected QueryOperation |
StreamTableEnvironmentImpl.qualifyQueryOperation(ObjectIdentifier identifier,
QueryOperation queryOperation) |
Modifier and Type | Method and Description |
---|---|
protected QueryOperation |
TableEnvironmentImpl.qualifyQueryOperation(ObjectIdentifier identifier,
QueryOperation queryOperation)
Subclasses can override this method to transform the given QueryOperation to a new one with
the qualified object identifier.
|
Modifier and Type | Method and Description |
---|---|
static ObjectIdentifier |
ObjectIdentifier.of(String catalogName,
String databaseName,
String objectName) |
ObjectIdentifier |
CatalogManager.qualifyIdentifier(UnresolvedIdentifier identifier)
Returns the full name of the given table path, this name may be padded with current
catalog/database name based on the
identifier's length. |
Modifier and Type | Method and Description |
---|---|
void |
CatalogManager.alterTable(CatalogBaseTable table,
ObjectIdentifier objectIdentifier,
boolean ignoreIfNotExists)
Alters a table in a given fully qualified path.
|
void |
CatalogManager.createTable(CatalogBaseTable table,
ObjectIdentifier objectIdentifier,
boolean ignoreIfExists)
Creates a table in a given fully qualified path.
|
void |
CatalogManager.createTemporaryTable(CatalogBaseTable table,
ObjectIdentifier objectIdentifier,
boolean ignoreIfExists)
Creates a temporary table in a given fully qualified path.
|
void |
CatalogManager.dropTable(ObjectIdentifier objectIdentifier,
boolean ignoreIfNotExists)
Drops a table in a given fully qualified path.
|
CatalogFunction |
FunctionCatalog.dropTempCatalogFunction(ObjectIdentifier identifier,
boolean ignoreIfNotExist)
Drop a temporary catalog function.
|
void |
CatalogManager.dropTemporaryTable(ObjectIdentifier objectIdentifier,
boolean ignoreIfNotExists)
Drop a temporary table in a given fully qualified path.
|
void |
CatalogManager.dropTemporaryView(ObjectIdentifier objectIdentifier,
boolean ignoreIfNotExists)
Drop a temporary view in a given fully qualified path.
|
void |
CatalogManager.dropView(ObjectIdentifier objectIdentifier,
boolean ignoreIfNotExists)
Drops a view in a given fully qualified path.
|
Optional<CatalogPartition> |
CatalogManager.getPartition(ObjectIdentifier tableIdentifier,
CatalogPartitionSpec partitionSpec)
Retrieves a partition with a fully qualified table path and partition spec.
|
Optional<CatalogManager.TableLookupResult> |
CatalogManager.getTable(ObjectIdentifier objectIdentifier)
Retrieves a fully qualified table.
|
protected Optional<TemporaryOperationListener> |
CatalogManager.getTemporaryOperationListener(ObjectIdentifier identifier) |
boolean |
FunctionCatalog.hasTemporaryCatalogFunction(ObjectIdentifier functionIdentifier)
Check whether a temporary catalog function is already registered.
|
void |
FunctionCatalog.registerTempCatalogScalarFunction(ObjectIdentifier oi,
ScalarFunction function)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
ObjectIdentifier |
TableSourceFactoryContextImpl.getObjectIdentifier() |
ObjectIdentifier |
TableSourceFactory.Context.getObjectIdentifier() |
ObjectIdentifier |
TableSinkFactory.Context.getObjectIdentifier() |
ObjectIdentifier |
DynamicTableFactory.Context.getObjectIdentifier()
Returns the identifier of the table in the
Catalog . |
ObjectIdentifier |
FactoryUtil.DefaultDynamicTableContext.getObjectIdentifier() |
ObjectIdentifier |
TableSinkFactoryContextImpl.getObjectIdentifier() |
Modifier and Type | Method and Description |
---|---|
static DynamicTableSink |
FactoryUtil.createTableSink(Catalog catalog,
ObjectIdentifier objectIdentifier,
ResolvedCatalogTable catalogTable,
ReadableConfig configuration,
ClassLoader classLoader,
boolean isTemporary)
Creates a
DynamicTableSink from a CatalogTable . |
static DynamicTableSource |
FactoryUtil.createTableSource(Catalog catalog,
ObjectIdentifier objectIdentifier,
ResolvedCatalogTable catalogTable,
ReadableConfig configuration,
ClassLoader classLoader,
boolean isTemporary)
Creates a
DynamicTableSource from a CatalogTable . |
static <T> TableSink<T> |
TableFactoryUtil.findAndCreateTableSink(Catalog catalog,
ObjectIdentifier objectIdentifier,
CatalogTable catalogTable,
ReadableConfig configuration,
boolean isStreamingMode,
boolean isTemporary)
Creates a
TableSink from a CatalogTable . |
static <T> TableSource<T> |
TableFactoryUtil.findAndCreateTableSource(Catalog catalog,
ObjectIdentifier objectIdentifier,
CatalogTable catalogTable,
ReadableConfig configuration,
boolean isTemporary)
Creates a
TableSource from a CatalogTable . |
Constructor and Description |
---|
DefaultDynamicTableContext(ObjectIdentifier objectIdentifier,
ResolvedCatalogTable catalogTable,
ReadableConfig configuration,
ClassLoader classLoader,
boolean isTemporary) |
TableSinkFactoryContextImpl(ObjectIdentifier identifier,
CatalogTable table,
ReadableConfig config,
boolean isBounded,
boolean isTemporary) |
TableSourceFactoryContextImpl(ObjectIdentifier identifier,
CatalogTable table,
ReadableConfig config,
boolean isTemporary) |
Modifier and Type | Method and Description |
---|---|
static DataStreamSink<?> |
StreamingSink.sink(DataStream<PartitionCommitInfo> writer,
Path locationPath,
ObjectIdentifier identifier,
List<String> partitionKeys,
TableMetaStoreFactory msFactory,
FileSystemFactory fsFactory,
Configuration options)
Create a sink from file writer.
|
Constructor and Description |
---|
PartitionCommitter(Path locationPath,
ObjectIdentifier tableIdentifier,
List<String> partitionKeys,
TableMetaStoreFactory metaStoreFactory,
FileSystemFactory fsFactory,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static ObjectIdentifier |
FunctionIdentifier.normalizeObjectIdentifier(ObjectIdentifier oi)
Normalize an object identifier by only normalizing the function name.
|
Modifier and Type | Method and Description |
---|---|
Optional<ObjectIdentifier> |
FunctionIdentifier.getIdentifier() |
Modifier and Type | Method and Description |
---|---|
static ObjectIdentifier |
FunctionIdentifier.normalizeObjectIdentifier(ObjectIdentifier oi)
Normalize an object identifier by only normalizing the function name.
|
static FunctionIdentifier |
FunctionIdentifier.of(ObjectIdentifier oi) |
Modifier and Type | Field and Description |
---|---|
protected ObjectIdentifier |
ShowPartitionsOperation.tableIdentifier |
Modifier and Type | Method and Description |
---|---|
ObjectIdentifier |
ScalaExternalQueryOperation.getIdentifier() |
ObjectIdentifier |
JavaExternalQueryOperation.getIdentifier() |
ObjectIdentifier |
DescribeTableOperation.getSqlIdentifier() |
ObjectIdentifier |
CatalogSinkModifyOperation.getTableIdentifier() |
ObjectIdentifier |
ShowCreateTableOperation.getTableIdentifier() |
ObjectIdentifier |
CollectModifyOperation.getTableIdentifier() |
ObjectIdentifier |
CatalogQueryOperation.getTableIdentifier() |
ObjectIdentifier |
ExternalModifyOperation.getTableIdentifier() |
ObjectIdentifier |
ShowPartitionsOperation.getTableIdentifier() |
Modifier and Type | Method and Description |
---|---|
Optional<ObjectIdentifier> |
ScalaDataStreamQueryOperation.getIdentifier() |
Optional<ObjectIdentifier> |
JavaDataStreamQueryOperation.getIdentifier() |
Modifier and Type | Field and Description |
---|---|
protected ObjectIdentifier |
AlterTableOperation.tableIdentifier |
protected ObjectIdentifier |
AlterViewOperation.viewIdentifier |
Modifier and Type | Method and Description |
---|---|
ObjectIdentifier |
AlterCatalogFunctionOperation.getFunctionIdentifier() |
ObjectIdentifier |
DropCatalogFunctionOperation.getFunctionIdentifier() |
ObjectIdentifier |
CreateCatalogFunctionOperation.getFunctionIdentifier() |
ObjectIdentifier |
AlterTableRenameOperation.getNewTableIdentifier() |
ObjectIdentifier |
AlterViewRenameOperation.getNewViewIdentifier() |
ObjectIdentifier |
CreateTableOperation.getTableIdentifier() |
ObjectIdentifier |
DropTableOperation.getTableIdentifier() |
ObjectIdentifier |
AlterTableOperation.getTableIdentifier() |
ObjectIdentifier |
CreateViewOperation.getViewIdentifier() |
ObjectIdentifier |
DropViewOperation.getViewIdentifier() |
ObjectIdentifier |
AlterViewOperation.getViewIdentifier() |
Modifier and Type | Method and Description |
---|---|
ObjectIdentifier |
CatalogSchemaTable.getTableIdentifier() |
Constructor and Description |
---|
CatalogSchemaTable(ObjectIdentifier tableIdentifier,
CatalogManager.TableLookupResult lookupResult,
org.apache.flink.table.planner.plan.stats.FlinkStatistic statistic,
boolean isStreaming)
Create a CatalogSchemaTable instance.
|
Modifier and Type | Method and Description |
---|---|
static org.apache.calcite.rel.RelNode |
DynamicSourceUtils.convertDataStreamToRel(boolean isBatchMode,
ReadableConfig config,
org.apache.flink.table.planner.calcite.FlinkRelBuilder relBuilder,
ObjectIdentifier identifier,
ResolvedSchema schema,
DataStream<?> dataStream,
DataType physicalDataType,
boolean isTopLevelRecord,
ChangelogMode changelogMode)
Converts a given
DataStream to a RelNode . |
static org.apache.calcite.rel.RelNode |
DynamicSourceUtils.convertSourceToRel(boolean isBatchMode,
ReadableConfig config,
org.apache.flink.table.planner.calcite.FlinkRelBuilder relBuilder,
ObjectIdentifier identifier,
ResolvedCatalogTable catalogTable,
org.apache.flink.table.planner.plan.stats.FlinkStatistic statistic,
List<org.apache.calcite.rel.hint.RelHint> hints,
DynamicTableSource tableSource)
Converts a given
DynamicTableSource to a RelNode . |
static void |
DynamicSourceUtils.prepareDynamicSource(ObjectIdentifier sourceIdentifier,
ResolvedCatalogTable table,
DynamicTableSource source,
boolean isBatchMode,
ReadableConfig config)
Prepares the given
DynamicTableSource . |
static org.apache.calcite.rel.RelNode |
DynamicSinkUtils.validateSchemaAndApplyImplicitCast(org.apache.calcite.rel.RelNode query,
ResolvedSchema sinkSchema,
ObjectIdentifier sinkIdentifier,
DataTypeFactory dataTypeFactory,
org.apache.flink.table.planner.calcite.FlinkTypeFactory typeFactory)
Checks if the given query can be written into the given sink's table schema.
|
Modifier and Type | Method and Description |
---|---|
ObjectIdentifier |
RichTableSourceQueryOperation.getIdentifier() |
ObjectIdentifier |
DataStreamQueryOperation.getIdentifier() |
Constructor and Description |
---|
DataStreamQueryOperation(ObjectIdentifier identifier,
DataStream<E> dataStream,
int[] fieldIndices,
ResolvedSchema resolvedSchema,
boolean[] fieldNullables,
org.apache.flink.table.planner.plan.stats.FlinkStatistic statistic) |
RichTableSourceQueryOperation(ObjectIdentifier identifier,
TableSource<T> tableSource,
org.apache.flink.table.planner.plan.stats.FlinkStatistic statistic) |
Modifier and Type | Method and Description |
---|---|
static ObjectIdentifier |
ObjectIdentifierJsonDeserializer.deserialize(org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.JsonNode identifierNode) |
ObjectIdentifier |
ObjectIdentifierJsonDeserializer.deserialize(org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParser jsonParser,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.DeserializationContext ctx) |
Modifier and Type | Method and Description |
---|---|
void |
ObjectIdentifierJsonSerializer.serialize(ObjectIdentifier objectIdentifier,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonGenerator jsonGenerator,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.SerializerProvider serializerProvider) |
Modifier and Type | Field and Description |
---|---|
protected ObjectIdentifier |
CatalogTableSpecBase.objectIdentifier |
Modifier and Type | Method and Description |
---|---|
ObjectIdentifier |
CatalogTableSpecBase.getObjectIdentifier() |
Constructor and Description |
---|
CatalogTableSpecBase(ObjectIdentifier objectIdentifier,
ResolvedCatalogTable catalogTable) |
DynamicTableSinkSpec(ObjectIdentifier objectIdentifier,
ResolvedCatalogTable catalogTable,
List<SinkAbilitySpec> sinkAbilitySpecs) |
DynamicTableSourceSpec(ObjectIdentifier objectIdentifier,
ResolvedCatalogTable catalogTable,
List<SourceAbilitySpec> sourceAbilitySpecs) |
Modifier and Type | Method and Description |
---|---|
static Operation |
OperationConverterUtils.convertAddReplaceColumns(ObjectIdentifier tableIdentifier,
SqlAddReplaceColumns addReplaceColumns,
CatalogTable catalogTable,
org.apache.calcite.sql.validate.SqlValidator sqlValidator) |
static Operation |
OperationConverterUtils.convertChangeColumn(ObjectIdentifier tableIdentifier,
SqlChangeColumn changeColumn,
CatalogTable catalogTable,
org.apache.calcite.sql.validate.SqlValidator sqlValidator) |
Modifier and Type | Method and Description |
---|---|
Optional<ObjectIdentifier> |
UserDefinedType.getObjectIdentifier() |
Modifier and Type | Method and Description |
---|---|
static StructuredType.Builder |
StructuredType.newBuilder(ObjectIdentifier objectIdentifier)
Creates a builder for a
StructuredType that has been stored in a catalog and is
identified by an ObjectIdentifier . |
static StructuredType.Builder |
StructuredType.newBuilder(ObjectIdentifier objectIdentifier,
Class<?> implementationClass)
Creates a builder for a
StructuredType that has been stored in a catalog and is
identified by an ObjectIdentifier . |
static DistinctType.Builder |
DistinctType.newBuilder(ObjectIdentifier objectIdentifier,
LogicalType sourceType)
Creates a builder for a
DistinctType . |
Constructor and Description |
---|
Builder(ObjectIdentifier objectIdentifier) |
Builder(ObjectIdentifier objectIdentifier,
Class<?> implementationClass) |
Builder(ObjectIdentifier objectIdentifier,
LogicalType sourceType) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.