Package | Description |
---|---|
org.apache.flink.orc | |
org.apache.flink.orc.nohive.shim | |
org.apache.flink.orc.shim |
Modifier and Type | Field and Description |
---|---|
protected OrcShim<BatchT> |
AbstractOrcFileInputFormat.shim |
Modifier and Type | Method and Description |
---|---|
static <SplitT extends FileSourceSplit> |
OrcColumnarRowFileInputFormat.createPartitionedFormat(OrcShim<org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch> shim,
Configuration hadoopConfig,
RowType tableType,
List<String> partitionKeys,
PartitionFieldExtractor<SplitT> extractor,
int[] selectedFields,
List<OrcFilters.Predicate> conjunctPredicates,
int batchSize)
Create a partitioned
OrcColumnarRowFileInputFormat , the partition columns can be
generated by split. |
Constructor and Description |
---|
AbstractOrcFileInputFormat(OrcShim<BatchT> shim,
Configuration hadoopConfig,
org.apache.orc.TypeDescription schema,
int[] selectedFields,
List<OrcFilters.Predicate> conjunctPredicates,
int batchSize) |
OrcColumnarRowFileInputFormat(OrcShim<BatchT> shim,
Configuration hadoopConfig,
org.apache.orc.TypeDescription schema,
int[] selectedFields,
List<OrcFilters.Predicate> conjunctPredicates,
int batchSize,
ColumnBatchFactory<BatchT,SplitT> batchFactory,
RowType projectedOutputType) |
OrcColumnarRowSplitReader(OrcShim<BATCH> shim,
Configuration conf,
org.apache.orc.TypeDescription schema,
int[] selectedFields,
OrcColumnarRowSplitReader.ColumnBatchGenerator<BATCH> batchGenerator,
List<OrcFilters.Predicate> conjunctPredicates,
int batchSize,
Path path,
long splitStart,
long splitLength) |
OrcSplitReader(OrcShim<BATCH> shim,
Configuration conf,
org.apache.orc.TypeDescription schema,
int[] selectedFields,
List<OrcFilters.Predicate> conjunctPredicates,
int batchSize,
Path path,
long splitStart,
long splitLength) |
OrcVectorizedReader(OrcShim<BatchT> shim,
org.apache.orc.RecordReader orcReader,
Pool<AbstractOrcFileInputFormat.OrcReaderBatch<T,BatchT>> pool) |
Modifier and Type | Class and Description |
---|---|
class |
OrcNoHiveShim
Shim for orc reader without hive dependents.
|
Modifier and Type | Class and Description |
---|---|
class |
OrcShimV200
Shim orc for Hive version 2.0.0 and upper versions.
|
class |
OrcShimV210
Shim orc for Hive version 2.1.0 and upper versions.
|
class |
OrcShimV230
Shim orc for Hive version 2.1.0 and upper versions.
|
Modifier and Type | Method and Description |
---|---|
static OrcShim<org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch> |
OrcShim.createShim(String hiveVersion)
Create shim from hive version.
|
static OrcShim<org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch> |
OrcShim.defaultShim()
Default with orc dependent, we should use v2.3.0.
|
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.