CommT- The type of information needed to commit data staged by the sink
GlobalCommT- The type of the aggregated committable
@Experimental public interface GlobalCommitter<CommT,GlobalCommT> extends AutoCloseable
GlobalCommitteris responsible for creating and committing an aggregated committable, which we call global committable (see
GlobalCommitter runs with parallelism equal to 1.
|Modifier and Type||Method and Description|
Compute an aggregated committable from a list of committables.
Commits the given list of
Signals that there is no committable any more.
Find out which global committables need to be retried when recovering from the failure.
List<GlobalCommT> filterRecoveredCommittables(List<GlobalCommT> globalCommittables) throws IOException
globalCommittables- A list of
GlobalCommTfor which we want to verify which ones were successfully committed and which ones did not.
GlobalCommTthat should be committed again.
IOException- if fail to filter the recovered committables.
GlobalCommT combine(List<CommT> committables) throws IOException
committables- A list of
CommTto be combined into a
IOException- if fail to combine the given committables.
List<GlobalCommT> commit(List<GlobalCommT> globalCommittables) throws IOException, InterruptedException
GlobalCommTand returns a list of
GlobalCommTthat need to be re-committed. The elements of the return list must be a subset of the input list, so that successful committables can be inferred.
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.