public abstract class AbstractCsvInputFormat<T> extends FileInputFormat<T>
FileInputFormat.FileBaseStatistics, FileInputFormat.InputSplitOpenThread
Modifier and Type | Field and Description |
---|---|
protected InputStream |
csvInputStream |
protected org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema |
csvSchema |
currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable
Constructor and Description |
---|
AbstractCsvInputFormat(Path[] filePaths,
org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema) |
Modifier and Type | Method and Description |
---|---|
void |
open(FileInputSplit split)
Opens an input stream to the file defined in the input format.
|
boolean |
supportsMultiPaths()
Override this method to supports multiple paths.
|
acceptFile, close, configure, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFilePaths, getFileStats, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, getStatistics, getSupportedCompressionFormats, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilePaths, setFilePaths, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, testForUnsplittable, toString
closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
nextRecord, reachedEnd
protected final org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema
protected transient InputStream csvInputStream
public AbstractCsvInputFormat(Path[] filePaths, org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema)
public boolean supportsMultiPaths()
FileInputFormat
supportsMultiPaths
in class FileInputFormat<T>
public void open(FileInputSplit split) throws IOException
FileInputFormat
The stream is actually opened in an asynchronous thread to make sure any interruptions to the thread working on the input format do not reach the file system.
open
in interface InputFormat<T,FileInputSplit>
open
in class FileInputFormat<T>
split
- The split to be opened.IOException
- Thrown, if the spit could not be opened due to an I/O problem.Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.