S - The type of input split.
T - The type of the channel state to be checkpointed / included in the snapshot.
@PublicEvolving public interface CheckpointableInputFormat<S extends InputSplit,T extends Serializable>
InputFormats that allow checkpointing/restoring their state.
T getCurrentState() throws IOException
IOException - Thrown if the creation of the state object failed.
void reopen(S split, T state) throws IOException
InputFormat. This is
necessary when recovering from a task failure. When this method is called, the input format
it guaranteed to be configured.
NOTE: The caller has to make sure that the provided split is the one to whom the state belongs.
split - The split to be opened.
state - The state from which to start from. This can contain the offset, but also other
data, depending on the input format.
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.