@Internal public class CacheTransformationTranslator<OUT,T extends CacheTransformation<OUT>> extends SimpleTransformationTranslator<OUT,T>
CacheTransformationTranslator
.Modifier and Type | Class and Description |
---|---|
static class |
CacheTransformationTranslator.IdentityStreamOperator<T>
The
CacheTransformationTranslator.IdentityStreamOperator acts as a dummy source to consume cached intermediate
dataset. |
static class |
CacheTransformationTranslator.NoOpStreamOperator<T>
The
CacheTransformationTranslator.NoOpStreamOperator acts as a dummy sink so that the upstream can produce the
intermediate dataset to be cached. |
TransformationTranslator.Context
Modifier and Type | Field and Description |
---|---|
static String |
CACHE_CONSUMER_OPERATOR_NAME |
static String |
CACHE_PRODUCER_OPERATOR_NAME |
Constructor and Description |
---|
CacheTransformationTranslator() |
Modifier and Type | Method and Description |
---|---|
protected Collection<Integer> |
translateForBatchInternal(T transformation,
TransformationTranslator.Context context)
Translates a given
Transformation to its runtime implementation for BATCH-style
execution. |
protected Collection<Integer> |
translateForStreamingInternal(T transformation,
TransformationTranslator.Context context)
Translates a given
Transformation to its runtime implementation for STREAMING-style
execution. |
translateForBatch, translateForStreaming
public static final String CACHE_CONSUMER_OPERATOR_NAME
public static final String CACHE_PRODUCER_OPERATOR_NAME
protected Collection<Integer> translateForBatchInternal(T transformation, TransformationTranslator.Context context)
SimpleTransformationTranslator
Transformation
to its runtime implementation for BATCH-style
execution.translateForBatchInternal
in class SimpleTransformationTranslator<OUT,T extends CacheTransformation<OUT>>
transformation
- The transformation to be translated.context
- The translation context.StreamNodes
in the transformation graph
corresponding to this transformation. These will be the nodes that a potential following
transformation will need to connect to.protected Collection<Integer> translateForStreamingInternal(T transformation, TransformationTranslator.Context context)
SimpleTransformationTranslator
Transformation
to its runtime implementation for STREAMING-style
execution.translateForStreamingInternal
in class SimpleTransformationTranslator<OUT,T extends CacheTransformation<OUT>>
transformation
- The transformation to be translated.context
- The translation context.StreamNodes
in the transformation graph
corresponding to this transformation. These will be the nodes that a potential following
transformation will need to connect to.Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.