org.apache.flink.orc

Class OrcTableSource

java.lang.Object

org.apache.flink.orc.OrcTableSource

All Implemented Interfaces:

org.apache.flink.table.sources.BatchTableSource<Row>, org.apache.flink.table.sources.FilterableTableSource<Row>, org.apache.flink.table.sources.ProjectableTableSource<Row>, org.apache.flink.table.sources.TableSource<Row>

public class OrcTableSource
extends Object
implements org.apache.flink.table.sources.BatchTableSource<Row>, org.apache.flink.table.sources.ProjectableTableSource<Row>, org.apache.flink.table.sources.FilterableTableSource<Row>

A TableSource to read ORC files.

The OrcTableSource supports projection and filter push-down.

An OrcTableSource is used as shown in the example below.

 
 OrcTableSource orcSrc = OrcTableSource.builder()
   .path("file:///my/data/file.orc")
   .forOrcSchema("struct<col1:boolean,col2:tinyint,col3:smallint,col4:int>")
   .build();

 tEnv.registerTableSource("orcTable", orcSrc);
 Table res = tableEnv.sql("SELECT * FROM orcTable");
 
 

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	OrcTableSource.Builder Constructs an OrcTableSource.

Method Summary

Modifier and Type	Method and Description
org.apache.flink.table.sources.TableSource<Row>	applyPredicate(List<org.apache.flink.table.expressions.Expression> predicates)
static OrcTableSource.Builder	builder()
protected OrcRowInputFormat	buildOrcInputFormat()
String	explainSource()
DataSet<Row>	getDataSet(ExecutionEnvironment execEnv)
TypeInformation<Row>	getReturnType()
org.apache.flink.table.api.TableSchema	getTableSchema()
boolean	isFilterPushedDown()
org.apache.flink.table.sources.TableSource<Row>	projectFields(int[] selectedFields)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getDataSet

public DataSet<Row> getDataSet(ExecutionEnvironment execEnv)

Specified by:

getDataSet in interface org.apache.flink.table.sources.BatchTableSource<Row>

buildOrcInputFormat

@VisibleForTesting
protected OrcRowInputFormat buildOrcInputFormat()

getReturnType

public TypeInformation<Row> getReturnType()

Specified by:

getReturnType in interface org.apache.flink.table.sources.TableSource<Row>

getTableSchema

public org.apache.flink.table.api.TableSchema getTableSchema()

Specified by:

getTableSchema in interface org.apache.flink.table.sources.TableSource<Row>

projectFields

public org.apache.flink.table.sources.TableSource<Row> projectFields(int[] selectedFields)

Specified by:

projectFields in interface org.apache.flink.table.sources.ProjectableTableSource<Row>

applyPredicate

public org.apache.flink.table.sources.TableSource<Row> applyPredicate(List<org.apache.flink.table.expressions.Expression> predicates)

Specified by:

applyPredicate in interface org.apache.flink.table.sources.FilterableTableSource<Row>

isFilterPushedDown

public boolean isFilterPushedDown()

Specified by:

isFilterPushedDown in interface org.apache.flink.table.sources.FilterableTableSource<Row>

explainSource

public String explainSource()

Specified by:

explainSource in interface org.apache.flink.table.sources.TableSource<Row>

builder

public static OrcTableSource.Builder builder()