Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<String> |
FileSinkProgram.KeyBucketAssigner.getSerializer() |
Modifier and Type | Method and Description |
---|---|
Optional<SimpleVersionedSerializer<CommT>> |
Sink.getCommittableSerializer()
Returns the serializer of the committable type.
|
Optional<SimpleVersionedSerializer<GlobalCommT>> |
Sink.getGlobalCommittableSerializer()
Returns the serializer of the aggregated committable type.
|
Optional<SimpleVersionedSerializer<WriterStateT>> |
Sink.getWriterStateSerializer()
Return the serializer of the writer's state type.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<EnumChkT> |
Source.getEnumeratorCheckpointSerializer()
Creates the serializer for the
SplitEnumerator checkpoint. |
SimpleVersionedSerializer<SplitT> |
Source.getSplitSerializer()
Creates a serializer for the source splits.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<Collection<NumberSequenceSource.NumberSequenceSplit>> |
NumberSequenceSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<NumberSequenceSource.NumberSequenceSplit> |
NumberSequenceSource.getSplitSerializer() |
Modifier and Type | Class and Description |
---|---|
class |
HybridSourceEnumeratorStateSerializer
The
Serializer for the enumerator state. |
class |
HybridSourceSplitSerializer
Serializes splits by delegating to the source-indexed underlying split serializer.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<HybridSourceEnumeratorState> |
HybridSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<HybridSourceSplit> |
HybridSource.getSplitSerializer() |
Modifier and Type | Method and Description |
---|---|
static <SplitT extends SourceSplit,C extends Collection<SplitT>> |
SerdeUtils.deserializeSplitAssignments(byte[] serialized,
SimpleVersionedSerializer<SplitT> splitSerializer,
java.util.function.Function<Integer,C> collectionSupplier)
Deserialize the given bytes returned by
SerdeUtils.serializeSplitAssignments(Map,
SimpleVersionedSerializer) . |
static <SplitT extends SourceSplit,C extends Collection<SplitT>> |
SerdeUtils.serializeSplitAssignments(Map<Integer,C> splitAssignments,
SimpleVersionedSerializer<SplitT> splitSerializer)
Serialize a mapping from subtask ids to lists of assigned splits.
|
Modifier and Type | Class and Description |
---|---|
class |
FileSinkCommittableSerializer
Versioned serializer for
FileSinkCommittable . |
Modifier and Type | Method and Description |
---|---|
Optional<SimpleVersionedSerializer<FileSinkCommittable>> |
FileSink.getCommittableSerializer() |
Optional<SimpleVersionedSerializer<Void>> |
FileSink.getGlobalCommittableSerializer() |
Optional<SimpleVersionedSerializer<FileWriterBucketState>> |
FileSink.getWriterStateSerializer() |
Constructor and Description |
---|
FileSinkCommittableSerializer(SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileSerializer,
SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileSerializer) |
FileSinkCommittableSerializer(SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileSerializer,
SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileSerializer) |
Modifier and Type | Class and Description |
---|---|
class |
FileWriterBucketStateSerializer
A
SimpleVersionedSerializer used to serialize the BucketState . |
Constructor and Description |
---|
FileWriterBucketStateSerializer(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer) |
FileWriterBucketStateSerializer(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer) |
Modifier and Type | Class and Description |
---|---|
class |
FileSourceSplitSerializer
A serializer for the
FileSourceSplit . |
class |
PendingSplitsCheckpointSerializer<T extends FileSourceSplit>
A serializer for the
PendingSplitsCheckpoint . |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<PendingSplitsCheckpoint<SplitT>> |
AbstractFileSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<FileSourceSplit> |
FileSource.getSplitSerializer() |
abstract SimpleVersionedSerializer<SplitT> |
AbstractFileSource.getSplitSerializer() |
Constructor and Description |
---|
PendingSplitsCheckpointSerializer(SimpleVersionedSerializer<T> splitSerializer) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<KafkaSourceEnumState> |
KafkaSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<KafkaPartitionSplit> |
KafkaSource.getSplitSerializer() |
Modifier and Type | Class and Description |
---|---|
class |
KafkaSourceEnumStateSerializer
The
Serializer for the enumerator
state of Kafka source. |
Modifier and Type | Class and Description |
---|---|
class |
KafkaPartitionSplitSerializer
The
serializer for KafkaPartitionSplit . |
Modifier and Type | Class and Description |
---|---|
class |
ContinuousHivePendingSplitsCheckpointSerializer
SerDe for
ContinuousHivePendingSplitsCheckpoint . |
class |
HiveSourceSplitSerializer
SerDe for
HiveSourceSplit . |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<PendingSplitsCheckpoint<HiveSourceSplit>> |
HiveSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<HiveSourceSplit> |
HiveSource.getSplitSerializer() |
Constructor and Description |
---|
ContinuousHivePendingSplitsCheckpointSerializer(SimpleVersionedSerializer<HiveSourceSplit> splitSerDe) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
RecoverableWriter.getCommitRecoverableSerializer()
The serializer for the CommitRecoverable types created in this writer.
|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
RecoverableWriter.getResumeRecoverableSerializer()
The serializer for the ResumeRecoverable types created in this writer.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
LocalRecoverableWriter.getCommitRecoverableSerializer() |
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
LocalRecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
static <T> T |
SimpleVersionedSerialization.readVersionAndDeSerialize(SimpleVersionedSerializer<T> serializer,
byte[] bytes)
Deserializes the version and datum from a byte array.
|
static <T> T |
SimpleVersionedSerialization.readVersionAndDeSerialize(SimpleVersionedSerializer<T> serializer,
DataInputView in)
Deserializes the version and datum from a stream.
|
static <T> byte[] |
SimpleVersionedSerialization.writeVersionAndSerialize(SimpleVersionedSerializer<T> serializer,
T datum)
Serializes the version and datum into a byte array.
|
static <T> void |
SimpleVersionedSerialization.writeVersionAndSerialize(SimpleVersionedSerializer<T> serializer,
T datum,
DataOutputView out)
Serializes the version and datum into a stream.
|
Constructor and Description |
---|
SimpleVersionedSerializerTypeSerializerProxy(SerializableSupplier<SimpleVersionedSerializer<T>> serializerSupplier) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
S3RecoverableWriter.getCommitRecoverableSerializer() |
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
S3RecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<T> |
MasterTriggerRestoreHook.createCheckpointDataSerializer()
Creates a the serializer to (de)serializes the data stored by this hook.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
HadoopRecoverableWriter.getCommitRecoverableSerializer() |
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
HadoopRecoverableWriter.getResumeRecoverableSerializer() |
Constructor and Description |
---|
SourceCoordinatorContext(SourceCoordinatorProvider.CoordinatorExecutorThreadFactory coordinatorThreadFactory,
int numWorkerThreads,
OperatorCoordinator.Context operatorCoordinatorContext,
SimpleVersionedSerializer<SplitT> splitSerializer) |
Modifier and Type | Method and Description |
---|---|
List<SplitT> |
AddSplitEvent.splits(SimpleVersionedSerializer<SplitT> splitSerializer) |
Constructor and Description |
---|
AddSplitEvent(List<SplitT> splits,
SimpleVersionedSerializer<SplitT> splitSerializer) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<String> |
StreamSQLTestProgram.KeyBucketAssigner.getSerializer() |
Modifier and Type | Class and Description |
---|---|
static class |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer
The serializer for
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable . |
static class |
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer
The serializer for
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable . |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer.getCommitSerializer() |
SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> |
WriterProperties.getInProgressFileRecoverableSerializer() |
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> |
WriterProperties.getPendingFileRecoverableSerializer() |
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer.getResumeSerializer() |
SimpleVersionedSerializer<BucketID> |
BucketAssigner.getSerializer() |
Constructor and Description |
---|
WriterProperties(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer,
boolean supportsResume) |
WriterProperties(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer,
boolean supportsResume) |
Modifier and Type | Class and Description |
---|---|
class |
SimpleVersionedStringSerializer
A
SimpleVersionedSerializer implementation for Strings. |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<String> |
DateTimeBucketAssigner.getSerializer() |
SimpleVersionedSerializer<String> |
BasePathBucketAssigner.getSerializer() |
Constructor and Description |
---|
SourceOperator(FunctionWithException<SourceReaderContext,SourceReader<OUT,SplitT>,Exception> readerFactory,
OperatorEventGateway operatorEventGateway,
SimpleVersionedSerializer<SplitT> splitSerializer,
WatermarkStrategy<OUT> watermarkStrategy,
ProcessingTimeService timeService,
Configuration configuration,
String localHostname,
boolean emitProgressiveWatermarks) |
Constructor and Description |
---|
SimpleVersionedListState(ListState<byte[]> rawState,
SimpleVersionedSerializer<T> serializer)
Creates a new SimpleVersionedListState that reads and writes bytes from the given raw
ListState with the given serializer.
|
Constructor and Description |
---|
CommittableTypeInformation(Class<CommT> typeClazz,
SerializableSupplier<SimpleVersionedSerializer<CommT>> serializerSerializableSupplier) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<String> |
FileSystemTableSink.TableBucketAssigner.getSerializer() |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.