org.apache.flink.table.catalog.hive.client

Class HiveShimV310

java.lang.Object

org.apache.flink.table.catalog.hive.client.HiveShimV100

org.apache.flink.table.catalog.hive.client.HiveShimV101

org.apache.flink.table.catalog.hive.client.HiveShimV110

org.apache.flink.table.catalog.hive.client.HiveShimV111

org.apache.flink.table.catalog.hive.client.HiveShimV120

org.apache.flink.table.catalog.hive.client.HiveShimV121

org.apache.flink.table.catalog.hive.client.HiveShimV122

org.apache.flink.table.catalog.hive.client.HiveShimV200

org.apache.flink.table.catalog.hive.client.HiveShimV201

org.apache.flink.table.catalog.hive.client.HiveShimV210

org.apache.flink.table.catalog.hive.client.HiveShimV211

org.apache.flink.table.catalog.hive.client.HiveShimV220

org.apache.flink.table.catalog.hive.client.HiveShimV230

org.apache.flink.table.catalog.hive.client.HiveShimV231

org.apache.flink.table.catalog.hive.client.HiveShimV232

org.apache.flink.table.catalog.hive.client.HiveShimV233

org.apache.flink.table.catalog.hive.client.HiveShimV234

org.apache.flink.table.catalog.hive.client.HiveShimV235

org.apache.flink.table.catalog.hive.client.HiveShimV236

org.apache.flink.table.catalog.hive.client.HiveShimV237

org.apache.flink.table.catalog.hive.client.HiveShimV238

org.apache.flink.table.catalog.hive.client.HiveShimV239

org.apache.flink.table.catalog.hive.client.HiveShimV310

All Implemented Interfaces:

Serializable, HiveShim

Direct Known Subclasses:

HiveShimV311

public class HiveShimV310
extends HiveShimV239

Shim for Hive version 3.1.0.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected int	stmtIdInLoadTableOrPartition
protected long	writeIdInLoadTableOrPartition

Fields inherited from class org.apache.flink.table.catalog.hive.client.HiveShimV210

hasFollowingStatsTask

Fields inherited from class org.apache.flink.table.catalog.hive.client.HiveShimV100

holdDDLTime, inheritTableSpecs, isAcid, isSkewedStoreAsSubdir

Constructor Summary

Constructors

Constructor and Description
HiveShimV310()

Method Summary

Modifier and Type	Method and Description
void	createTableWithConstraints(org.apache.hadoop.hive.metastore.IMetaStoreClient client, org.apache.hadoop.hive.metastore.api.Table table, org.apache.hadoop.conf.Configuration conf, UniqueConstraint pk, List<Byte> pkTraits, List<String> notNullCols, List<Byte> nnTraits) Creates a table with PK and NOT NULL constraints.
Class<?>	getDateDataTypeClass() Hive Date data type class was changed in Hive 3.1.0.
Class<?>	getDateWritableClass() Gets writable class for Date type.
org.apache.hadoop.hive.metastore.IMetaStoreClient	getHiveMetastoreClient(HiveConf hiveConf) Create a Hive Metastore client based on the given HiveConf object.
Class<?>	getHiveMetaStoreUtilsClass() Get the class of Hive's HiveMetaStoreUtils as it was split from MetaStoreUtils class in Hive 3.1.0.
Class<?>	getMetaStoreUtilsClass() Get the class of Hive's MetaStoreUtils because its package name was changed in Hive 3.1.0.
Set<String>	getNotNullColumns(org.apache.hadoop.hive.metastore.IMetaStoreClient client, org.apache.hadoop.conf.Configuration conf, String dbName, String tableName) Get the set of columns that have NOT NULL constraints.
Class<?>	getTimestampDataTypeClass() Hive Timestamp data type class was changed in Hive 3.1.0.
Class<?>	getTimestampWritableClass() Gets writable class for Timestamp type.
org.apache.hadoop.io.Writable	hivePrimitiveToWritable(Object value) Converts a Hive primitive java object to corresponding Writable object.
void	loadPartition(org.apache.hadoop.hive.ql.metadata.Hive hive, org.apache.hadoop.fs.Path loadPath, String tableName, Map<String,String> partSpec, boolean isSkewedStoreAsSubdir, boolean replace, boolean isSrcLocal)
void	loadTable(org.apache.hadoop.hive.ql.metadata.Hive hive, org.apache.hadoop.fs.Path loadPath, String tableName, boolean replace, boolean isSrcLocal)
java.time.LocalDate	toFlinkDate(Object hiveDate) Converts a hive date instance to LocalDate which is expected by DataFormatConverter.
java.time.LocalDateTime	toFlinkTimestamp(Object hiveTimestamp) Converts a hive timestamp instance to LocalDateTime which is expected by DataFormatConverter.
Object	toHiveDate(Object flinkDate) Converts a Flink date instance to what's expected by Hive.
Object	toHiveTimestamp(Object flinkTimestamp) Converts a Flink timestamp instance to what's expected by Hive.

Methods inherited from class org.apache.flink.table.catalog.hive.client.HiveShimV230

alterTable, createUDAFParameterInfo, getViews, isMaterializedView

Methods inherited from class org.apache.flink.table.catalog.hive.client.HiveShimV210

alterPartition, getPrimaryKey

Methods inherited from class org.apache.flink.table.catalog.hive.client.HiveShimV200

createOrcBulkWriterFactory

Methods inherited from class org.apache.flink.table.catalog.hive.client.HiveShimV120

getIntervalDayTimeTypeInfo, getIntervalYearMonthTypeInfo, isDateStats, isIntervalDayTimeType, isIntervalYearMonthType, listBuiltInFunctions, registerTemporaryFunction, toFlinkDateColStats, toHiveDateColStats

Methods inherited from class org.apache.flink.table.catalog.hive.client.HiveShimV110

getFieldsFromDeserializer, getHiveOutputFormatClass, getHiveRecordWriter

Methods inherited from class org.apache.flink.table.catalog.hive.client.HiveShimV100

getBuiltInFunctionInfo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

writeIdInLoadTableOrPartition

protected final long writeIdInLoadTableOrPartition

See Also:

Constant Field Values

stmtIdInLoadTableOrPartition

protected final int stmtIdInLoadTableOrPartition

See Also:

Constant Field Values

Constructor Detail

HiveShimV310

public HiveShimV310()

Method Detail

getHiveMetastoreClient

public org.apache.hadoop.hive.metastore.IMetaStoreClient getHiveMetastoreClient(HiveConf hiveConf)

Description copied from interface: HiveShim

Create a Hive Metastore client based on the given HiveConf object.

Specified by:

getHiveMetastoreClient in interface HiveShim

Overrides:

getHiveMetastoreClient in class HiveShimV230

Parameters:

hiveConf - HiveConf instance

Returns:

an IMetaStoreClient instance

getMetaStoreUtilsClass

public Class<?> getMetaStoreUtilsClass()

Description copied from interface: HiveShim

Get the class of Hive's MetaStoreUtils because its package name was changed in Hive 3.1.0.

Specified by:

getMetaStoreUtilsClass in interface HiveShim

Overrides:

getMetaStoreUtilsClass in class HiveShimV100

Returns:

MetaStoreUtils class

getHiveMetaStoreUtilsClass

public Class<?> getHiveMetaStoreUtilsClass()

Description copied from interface: HiveShim

Get the class of Hive's HiveMetaStoreUtils as it was split from MetaStoreUtils class in Hive 3.1.0.

Specified by:

getHiveMetaStoreUtilsClass in interface HiveShim

Overrides:

getHiveMetaStoreUtilsClass in class HiveShimV100

Returns:

HiveMetaStoreUtils class

getDateDataTypeClass

public Class<?> getDateDataTypeClass()

Description copied from interface: HiveShim

Hive Date data type class was changed in Hive 3.1.0.

Specified by:

getDateDataTypeClass in interface HiveShim

Overrides:

getDateDataTypeClass in class HiveShimV100

Returns:

Hive's Date class

getDateWritableClass

public Class<?> getDateWritableClass()

Description copied from interface: HiveShim

Gets writable class for Date type.

Specified by:

getDateWritableClass in interface HiveShim

Overrides:

getDateWritableClass in class HiveShimV100

getTimestampDataTypeClass

public Class<?> getTimestampDataTypeClass()

Description copied from interface: HiveShim

Hive Timestamp data type class was changed in Hive 3.1.0.

Specified by:

getTimestampDataTypeClass in interface HiveShim

Overrides:

getTimestampDataTypeClass in class HiveShimV100

Returns:

Hive's Timestamp class

getTimestampWritableClass

public Class<?> getTimestampWritableClass()

Description copied from interface: HiveShim

Gets writable class for Timestamp type.

Specified by:

getTimestampWritableClass in interface HiveShim

Overrides:

getTimestampWritableClass in class HiveShimV100

getNotNullColumns

public Set<String> getNotNullColumns(org.apache.hadoop.hive.metastore.IMetaStoreClient client,
                                     org.apache.hadoop.conf.Configuration conf,
                                     String dbName,
                                     String tableName)

Description copied from interface: HiveShim

Get the set of columns that have NOT NULL constraints.

Specified by:

getNotNullColumns in interface HiveShim

Overrides:

getNotNullColumns in class HiveShimV100

toHiveTimestamp

public Object toHiveTimestamp(Object flinkTimestamp)

Description copied from interface: HiveShim

Converts a Flink timestamp instance to what's expected by Hive.

Specified by:

toHiveTimestamp in interface HiveShim

Overrides:

toHiveTimestamp in class HiveShimV100

toFlinkTimestamp

public java.time.LocalDateTime toFlinkTimestamp(Object hiveTimestamp)

Description copied from interface: HiveShim

Converts a hive timestamp instance to LocalDateTime which is expected by DataFormatConverter.

Specified by:

toFlinkTimestamp in interface HiveShim

Overrides:

toFlinkTimestamp in class HiveShimV100

toHiveDate

public Object toHiveDate(Object flinkDate)

Description copied from interface: HiveShim

Converts a Flink date instance to what's expected by Hive.

Specified by:

toHiveDate in interface HiveShim

Overrides:

toHiveDate in class HiveShimV100

toFlinkDate

public java.time.LocalDate toFlinkDate(Object hiveDate)

Description copied from interface: HiveShim

Converts a hive date instance to LocalDate which is expected by DataFormatConverter.

Specified by:

toFlinkDate in interface HiveShim

Overrides:

toFlinkDate in class HiveShimV100

hivePrimitiveToWritable

public org.apache.hadoop.io.Writable hivePrimitiveToWritable(Object value)

Description copied from interface: HiveShim

Converts a Hive primitive java object to corresponding Writable object.

Specified by:

hivePrimitiveToWritable in interface HiveShim

Overrides:

hivePrimitiveToWritable in class HiveShimV100

createTableWithConstraints

public void createTableWithConstraints(org.apache.hadoop.hive.metastore.IMetaStoreClient client,
                                       org.apache.hadoop.hive.metastore.api.Table table,
                                       org.apache.hadoop.conf.Configuration conf,
                                       UniqueConstraint pk,
                                       List<Byte> pkTraits,
                                       List<String> notNullCols,
                                       List<Byte> nnTraits)

Description copied from interface: HiveShim

Creates a table with PK and NOT NULL constraints.

Specified by:

createTableWithConstraints in interface HiveShim

Overrides:

createTableWithConstraints in class HiveShimV210

loadTable

public void loadTable(org.apache.hadoop.hive.ql.metadata.Hive hive,
                      org.apache.hadoop.fs.Path loadPath,
                      String tableName,
                      boolean replace,
                      boolean isSrcLocal)

Specified by:

loadTable in interface HiveShim

Overrides:

loadTable in class HiveShimV210

loadPartition

public void loadPartition(org.apache.hadoop.hive.ql.metadata.Hive hive,
                          org.apache.hadoop.fs.Path loadPath,
                          String tableName,
                          Map<String,String> partSpec,
                          boolean isSkewedStoreAsSubdir,
                          boolean replace,
                          boolean isSrcLocal)

Specified by:

loadPartition in interface HiveShim

Overrides:

loadPartition in class HiveShimV210