Interface PartitionCommitPolicy
-
- All Known Implementing Classes:
MetastoreCommitPolicy
,SuccessFileCommitPolicy
@Experimental public interface PartitionCommitPolicy
Policy for commit a partition.The implemented commit method needs to be idempotent because the same partition may be committed multiple times.
Default implementations: See
MetastoreCommitPolicy
. SeeSuccessFileCommitPolicy
.Further more, you can implement your own policy, like: - RPC to notify downstream applications. - Trigger hive to analysis partition for generating statistics. ...
-
-
Nested Class Summary
Nested Classes Modifier and Type Interface Description static interface
PartitionCommitPolicy.Context
Context of policy, including table information and partition information.
-
Method Summary
All Methods Static Methods Instance Methods Abstract Methods Modifier and Type Method Description void
commit(PartitionCommitPolicy.Context context)
Commit a partition.static void
validatePolicyChain(boolean isEmptyMetastore, String policyKind)
Validate commit policy.
-
-
-
Field Detail
-
METASTORE
static final String METASTORE
- See Also:
- Constant Field Values
-
SUCCESS_FILE
static final String SUCCESS_FILE
- See Also:
- Constant Field Values
-
CUSTOM
static final String CUSTOM
- See Also:
- Constant Field Values
-
-
Method Detail
-
commit
void commit(PartitionCommitPolicy.Context context) throws Exception
Commit a partition.- Throws:
Exception
-
validatePolicyChain
static void validatePolicyChain(boolean isEmptyMetastore, String policyKind)
Validate commit policy.
-
-