CommT
- The type of information needed to commit data staged by the sinkGlobalCommT
- The type of the aggregated committableWithPostCommitTopology
with StandardSinkTopologies#addGlobalCommitter
.@Deprecated @PublicEvolving public interface GlobalCommitter<CommT,GlobalCommT> extends AutoCloseable
GlobalCommitter
is responsible for creating and committing an aggregated committable,
which we call global committable (see combine(java.util.List<CommT>)
).
The GlobalCommitter
runs with parallelism equal to 1.
Modifier and Type | Method and Description |
---|---|
GlobalCommT |
combine(List<CommT> committables)
Deprecated.
Compute an aggregated committable from a list of committables.
|
List<GlobalCommT> |
commit(List<GlobalCommT> globalCommittables)
Deprecated.
Commits the given list of
GlobalCommT and returns a list of GlobalCommT that
need to be re-committed. |
void |
endOfInput()
Deprecated.
Signals that there is no committable any more.
|
List<GlobalCommT> |
filterRecoveredCommittables(List<GlobalCommT> globalCommittables)
Deprecated.
Find out which global committables need to be retried when recovering from the failure.
|
close
List<GlobalCommT> filterRecoveredCommittables(List<GlobalCommT> globalCommittables) throws IOException
globalCommittables
- A list of GlobalCommT
for which we want to verify which
ones were successfully committed and which ones did not.GlobalCommT
that should be committed again.IOException
- if fail to filter the recovered committables.GlobalCommT combine(List<CommT> committables) throws IOException
committables
- A list of CommT
to be combined into a GlobalCommT
.IOException
- if fail to combine the given committables.List<GlobalCommT> commit(List<GlobalCommT> globalCommittables) throws IOException, InterruptedException
GlobalCommT
and returns a list of GlobalCommT
that
need to be re-committed. The elements of the return list must be a subset of the input list,
so that successful committables can be inferred.globalCommittables
- a list of GlobalCommT
.GlobalCommT
that need to be re-committed.IOException
- if the commit operation fail and do not want to retry any more.InterruptedException
void endOfInput() throws IOException, InterruptedException
IOException
- if fail to handle this notification.InterruptedException
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.