org.apache.flink.connector.file.table

Interface PartitionCommitPolicy

All Known Implementing Classes:

MetastoreCommitPolicy, SuccessFileCommitPolicy

@Experimental
public interface PartitionCommitPolicy

Policy for commit a partition.

The implemented commit method needs to be idempotent because the same partition may be committed multiple times.

Default implementations: See MetastoreCommitPolicy. See SuccessFileCommitPolicy.

Further more, you can implement your own policy, like: - RPC to notify downstream applications. - Trigger hive to analysis partition for generating statistics. ...

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static interface	PartitionCommitPolicy.Context Context of policy, including table information and partition information.

Field Summary

Fields

Modifier and Type	Field and Description
static String	CUSTOM
static String	METASTORE
static String	SUCCESS_FILE

Method Summary

Modifier and Type	Method and Description
void	commit(PartitionCommitPolicy.Context context) Commit a partition.
static void	validatePolicyChain(boolean isEmptyMetastore, String policyKind) Validate commit policy.

Field Detail

METASTORE

static final String METASTORE

See Also:

Constant Field Values

SUCCESS_FILE

static final String SUCCESS_FILE

See Also:

Constant Field Values

CUSTOM

static final String CUSTOM

See Also:

Constant Field Values

Method Detail

commit

void commit(PartitionCommitPolicy.Context context)
     throws Exception

Commit a partition.

Throws:

Exception

validatePolicyChain

static void validatePolicyChain(boolean isEmptyMetastore,
                                String policyKind)

Validate commit policy.