org.apache.flink.connectors.hive

Class MRSplitsGetter

java.lang.Object

org.apache.flink.connectors.hive.MRSplitsGetter

All Implemented Interfaces:

Closeable, AutoCloseable

public class MRSplitsGetter
extends Object
implements Closeable

Create MR splits by multi-thread for hive partitions.

Constructor Summary

Constructors

Constructor and Description
MRSplitsGetter(int threadNum)

Method Summary

Modifier and Type	Method and Description
void	close()
List<HiveTablePartitionSplits>	getHiveTablePartitionMRSplits(int minNumSplits, List<HiveTablePartition> partitions, org.apache.hadoop.mapred.JobConf jobConf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MRSplitsGetter

public MRSplitsGetter(int threadNum)

Method Detail

getHiveTablePartitionMRSplits

public List<HiveTablePartitionSplits> getHiveTablePartitionMRSplits(int minNumSplits,
                                                                    List<HiveTablePartition> partitions,
                                                                    org.apache.hadoop.mapred.JobConf jobConf)
                                                             throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException