org.apache.flink.runtime.fs.hdfs

Class HadoopDataInputStream

java.lang.Object

java.io.InputStream

org.apache.flink.core.fs.FSDataInputStream

org.apache.flink.runtime.fs.hdfs.HadoopDataInputStream

All Implemented Interfaces:

Closeable, AutoCloseable

public final class HadoopDataInputStream
extends FSDataInputStream

Concrete implementation of the FSDataInputStream for the Hadoop Distributed File System.

Constructor Summary

Constructors

Constructor and Description
HadoopDataInputStream(org.apache.hadoop.fs.FSDataInputStream fsDataInputStream) Creates a new data input stream from the given HDFS input stream

Method Summary

Modifier and Type	Method and Description
int	available()
void	close()
org.apache.hadoop.fs.FSDataInputStream	getHadoopInputStream() Gets the wrapped Hadoop input stream.
long	getPos() Get the current position in the input stream.
int	read()
int	read(byte[] buffer, int offset, int length)
void	seek(long desired) Seek to the given offset from the start of the file.
long	skip(long n)

Methods inherited from class java.io.InputStream

mark, markSupported, read, reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopDataInputStream

public HadoopDataInputStream(org.apache.hadoop.fs.FSDataInputStream fsDataInputStream)

Creates a new data input stream from the given HDFS input stream

Parameters:

fsDataInputStream - the HDFS input stream

Method Detail

seek

public void seek(long desired)
          throws IOException

Description copied from class: FSDataInputStream

Seek to the given offset from the start of the file. The next read() will be from that location. Can't seek past the end of the file.

Specified by:

seek in class FSDataInputStream

Parameters:

desired - the desired offset

Throws:

IOException - thrown if an error occurred while seeking inside the input stream

getPos

public long getPos()
            throws IOException

Description copied from class: FSDataInputStream

Get the current position in the input stream.

Specified by:

getPos in class FSDataInputStream

Returns:

current position in the input stream

Throws:

IOException

read

public int read()
         throws IOException

Specified by:

read in class InputStream

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class InputStream

Throws:

IOException

read

public int read(byte[] buffer,
                int offset,
                int length)
         throws IOException

Overrides:

read in class InputStream

Throws:

IOException

available

public int available()
              throws IOException

Overrides:

available in class InputStream

Throws:

IOException

skip

public long skip(long n)
          throws IOException

Overrides:

skip in class InputStream

Throws:

IOException

getHadoopInputStream

public org.apache.hadoop.fs.FSDataInputStream getHadoopInputStream()

Gets the wrapped Hadoop input stream.

Returns:

The wrapped Hadoop input stream.