@Internal public class FlinkKafkaShuffleProducer<IN,KEY> extends FlinkKafkaProducer<IN>
FlinkKafkaProducer
in the way
handling elements and watermarksModifier and Type | Class and Description |
---|---|
static class |
FlinkKafkaShuffleProducer.KafkaSerializer<IN>
Flink Kafka Shuffle Serializer.
|
FlinkKafkaProducer.ContextStateSerializer, FlinkKafkaProducer.KafkaTransactionContext, FlinkKafkaProducer.KafkaTransactionState, FlinkKafkaProducer.NextTransactionalIdHint, FlinkKafkaProducer.NextTransactionalIdHintSerializer, FlinkKafkaProducer.Semantic, FlinkKafkaProducer.TransactionStateSerializer
TwoPhaseCommitSinkFunction.State<TXN,CONTEXT>, TwoPhaseCommitSinkFunction.StateSerializer<TXN,CONTEXT>, TwoPhaseCommitSinkFunction.StateSerializerSnapshot<TXN,CONTEXT>, TwoPhaseCommitSinkFunction.TransactionHolder<TXN>
SinkFunction.Context
asyncException, callback, DEFAULT_KAFKA_PRODUCERS_POOL_SIZE, DEFAULT_KAFKA_TRANSACTION_TIMEOUT, defaultTopicId, KEY_DISABLE_METRICS, pendingRecords, producerConfig, SAFE_SCALE_DOWN_FACTOR, semantic, topicPartitionsMap, writeTimestampToKafka
pendingCommitTransactions, state, userContext
Modifier and Type | Method and Description |
---|---|
void |
invoke(FlinkKafkaProducer.KafkaTransactionState transaction,
IN next,
SinkFunction.Context context)
This is the function invoked to handle each element.
|
void |
invoke(Watermark watermark)
This is the function invoked to handle each watermark.
|
abort, acknowledgeMessage, beginTransaction, checkErroneous, close, commit, createProducer, finishRecoveringContext, getPartitionsByTopic, getTransactionTimeout, ignoreFailuresAfterTransactionTimeout, initializeState, initializeUserContext, open, preCommit, recoverAndAbort, recoverAndCommit, setLogFailuresOnly, setTransactionalIdPrefix, setWriteTimestampToKafka, snapshotState
currentTransaction, enableTransactionTimeoutWarnings, finish, finishProcessing, getUserContext, invoke, invoke, notifyCheckpointAborted, notifyCheckpointComplete, pendingTransactions, setTransactionTimeout
getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
writeWatermark
public void invoke(FlinkKafkaProducer.KafkaTransactionState transaction, IN next, SinkFunction.Context context) throws FlinkKafkaException
invoke
in class FlinkKafkaProducer<IN>
transaction
- Transaction state; elements are written to Kafka in transactions to
guarantee different level of data consistencynext
- Element to handlecontext
- Context needed to handle the elementFlinkKafkaException
- for kafka errorpublic void invoke(Watermark watermark) throws FlinkKafkaException
watermark
- Watermark to handleFlinkKafkaException
- For kafka errorCopyright © 2014–2024 The Apache Software Foundation. All rights reserved.