Interface PartitionCommitPolicy

  • All Known Implementing Classes:
    MetastoreCommitPolicy, SuccessFileCommitPolicy

    @Experimental
    public interface PartitionCommitPolicy
    Policy for commit a partition.

    The implemented commit method needs to be idempotent because the same partition may be committed multiple times.

    Default implementations: See MetastoreCommitPolicy. See SuccessFileCommitPolicy.

    Further more, you can implement your own policy, like: - RPC to notify downstream applications. - Trigger hive to analysis partition for generating statistics. ...