org.apache.flink.addons.hbase

Class HBaseTableSource

java.lang.Object

org.apache.flink.addons.hbase.HBaseTableSource

All Implemented Interfaces:

org.apache.flink.table.sources.BatchTableSource<Row>, org.apache.flink.table.sources.ProjectableTableSource<Row>, org.apache.flink.table.sources.TableSource<Row>

public class HBaseTableSource
extends Object
implements org.apache.flink.table.sources.BatchTableSource<Row>, org.apache.flink.table.sources.ProjectableTableSource<Row>

Creates a TableSource to scan an HBase table.

The table name and required HBase configuration is passed during HBaseTableSource construction. Use addColumn(String, String, Class) to specify the family, qualifier, and type of columns to scan.

The TableSource returns Row with nested Rows for each column family.

The HBaseTableSource is used as shown in the example below.

 
 HBaseTableSource hSrc = new HBaseTableSource(conf, "hTable");
 hSrc.addColumn("fam1", "col1", byte[].class);
 hSrc.addColumn("fam1", "col2", Integer.class);
 hSrc.addColumn("fam2", "col1", String.class);

 tableEnv.registerTableSource("hTable", hSrc);
 Table res = tableEnv.sql("SELECT t.fam2.col1, SUM(t.fam1.col2) FROM hTable AS t GROUP BY t.fam2.col1");
 
 

Constructor Summary

Constructors

Constructor and Description
HBaseTableSource(Configuration conf, String tableName) The HBase configuration and the name of the table to read.

Method Summary

Modifier and Type	Method and Description
void	addColumn(String family, String qualifier, Class<?> clazz) Adds a column defined by family, qualifier, and type to the table schema.
String	explainSource()
DataSet<Row>	getDataSet(ExecutionEnvironment execEnv)
TypeInformation<Row>	getReturnType()
org.apache.flink.table.api.TableSchema	getTableSchema()
HBaseTableSource	projectFields(int[] fields)
void	setCharset(String charset) Specifies the charset to parse Strings to HBase byte[] keys and String values.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HBaseTableSource

public HBaseTableSource(Configuration conf,
                        String tableName)

The HBase configuration and the name of the table to read.

Parameters:

conf - hbase configuration

tableName - the tableName

Method Detail

addColumn

public void addColumn(String family,
                      String qualifier,
                      Class<?> clazz)

Adds a column defined by family, qualifier, and type to the table schema.

Parameters:

family - the family name

qualifier - the qualifier name

clazz - the data type of the qualifier

setCharset

public void setCharset(String charset)

Specifies the charset to parse Strings to HBase byte[] keys and String values.

Parameters:

charset - Name of the charset to use.

getReturnType

public TypeInformation<Row> getReturnType()

Specified by:

getReturnType in interface org.apache.flink.table.sources.TableSource<Row>

getTableSchema

public org.apache.flink.table.api.TableSchema getTableSchema()

Specified by:

getTableSchema in interface org.apache.flink.table.sources.TableSource<Row>

getDataSet

public DataSet<Row> getDataSet(ExecutionEnvironment execEnv)

Specified by:

getDataSet in interface org.apache.flink.table.sources.BatchTableSource<Row>

projectFields

public HBaseTableSource projectFields(int[] fields)

Specified by:

projectFields in interface org.apache.flink.table.sources.ProjectableTableSource<Row>

explainSource

public String explainSource()

Specified by:

explainSource in interface org.apache.flink.table.sources.TableSource<Row>