Modifier and Type | Field and Description |
---|---|
protected HashMap<String,DistributedCache.DistributedCacheEntry> |
Plan.cacheFile
Hash map for files in the distributed cache: registered name to cache entry.
|
Modifier and Type | Method and Description |
---|---|
Set<Map.Entry<String,DistributedCache.DistributedCacheEntry>> |
Plan.getCachedFiles()
Return the registered cached files.
|
Modifier and Type | Method and Description |
---|---|
void |
Plan.registerCachedFile(String name,
DistributedCache.DistributedCacheEntry entry)
Register cache files at program level.
|
Modifier and Type | Method and Description |
---|---|
static List<Tuple2<String,DistributedCache.DistributedCacheEntry>> |
DistributedCache.parseCachedFilesFromString(List<String> files)
Parses a list of distributed cache entries encoded in a string.
|
static Set<Map.Entry<String,DistributedCache.DistributedCacheEntry>> |
DistributedCache.readFileInfoFromConfig(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static void |
DistributedCache.writeFileInfoToConfig(String name,
DistributedCache.DistributedCacheEntry e,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static List<String> |
DistributedCache.parseStringFromCachedFiles(List<Tuple2<String,DistributedCache.DistributedCacheEntry>> files) |
Constructor and Description |
---|
PlanGenerator(List<DataSink<?>> sinks,
ExecutionConfig config,
int defaultParallelism,
List<Tuple2<String,DistributedCache.DistributedCacheEntry>> cacheFile,
String jobName) |
Modifier and Type | Method and Description |
---|---|
Future<Path> |
FileCache.createTmpFile(String name,
DistributedCache.DistributedCacheEntry entry,
JobID jobID,
ExecutionAttemptID executionId)
If the file doesn't exists locally, retrieve the file from the blob-service.
|
Modifier and Type | Method and Description |
---|---|
Map<String,DistributedCache.DistributedCacheEntry> |
JobGraph.getUserArtifacts()
Gets the list of assigned user jar paths.
|
static Map<String,DistributedCache.DistributedCacheEntry> |
JobGraphUtils.prepareUserArtifactEntries(Map<String,DistributedCache.DistributedCacheEntry> userArtifacts,
JobID jobId) |
Modifier and Type | Method and Description |
---|---|
void |
JobGraph.addUserArtifact(String name,
DistributedCache.DistributedCacheEntry file)
Adds the path of a custom file required to run the job on a task manager.
|
Modifier and Type | Method and Description |
---|---|
JobGraphBuilder |
JobGraphBuilder.addUserArtifacts(Map<String,DistributedCache.DistributedCacheEntry> newUserArtifacts) |
static Map<String,DistributedCache.DistributedCacheEntry> |
JobGraphUtils.prepareUserArtifactEntries(Map<String,DistributedCache.DistributedCacheEntry> userArtifacts,
JobID jobId) |
Modifier and Type | Field and Description |
---|---|
protected List<Tuple2<String,DistributedCache.DistributedCacheEntry>> |
StreamExecutionEnvironment.cacheFile
Now we could not migrate this field to configuration.
|
Modifier and Type | Method and Description |
---|---|
List<Tuple2<String,DistributedCache.DistributedCacheEntry>> |
StreamExecutionEnvironment.getCachedFiles()
Get the list of cached files that were registered for distribution among the task managers.
|
Modifier and Type | Method and Description |
---|---|
Collection<Tuple2<String,DistributedCache.DistributedCacheEntry>> |
StreamGraph.getUserArtifacts() |
Modifier and Type | Method and Description |
---|---|
List<Tuple2<String,DistributedCache.DistributedCacheEntry>> |
DummyStreamExecutionEnvironment.getCachedFiles() |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.