This documentation is for an unreleased version of Apache Flink Table Store. We recommend you use the latest stable version.

Overview #

Apache Flink Table Store utilizes the same pluggable file systems as Apache Flink. Users can follow the standard plugin mechanism to configure the plugin structure if using Flink as compute engine. However, for other engines like Spark or Hive, the provided opt jars (by Flink) may get conflicts and cannot be used directly. It is not convenient for users to fix class conflicts, thus Flink Table Store provides the self-contained and engine-unified FileSystem pluggable jars for user to query tables from Spark/Hive side.

Supported FileSystems #

FileSystem URI Scheme Pluggable Description
Local File System file:// N Built-in Support
HDFS hdfs:// N Built-in Support, ensure that the cluster is in the hadoop environment
Aliyun OSS oss:// Y
S3 s3:// Y