Modifier and Type | Method and Description |
---|---|
PermanentBlobKey |
BlobServer.putPermanent(JobID jobId,
byte[] value) |
PermanentBlobKey |
VoidBlobWriter.putPermanent(JobID jobId,
byte[] value) |
PermanentBlobKey |
BlobWriter.putPermanent(JobID jobId,
byte[] value)
Uploads the data of the given byte array for the given job to the BLOB server and makes it a
permanent BLOB.
|
PermanentBlobKey |
BlobServer.putPermanent(JobID jobId,
InputStream inputStream) |
PermanentBlobKey |
VoidBlobWriter.putPermanent(JobID jobId,
InputStream inputStream) |
PermanentBlobKey |
BlobWriter.putPermanent(JobID jobId,
InputStream inputStream)
Uploads the data from the given input stream for the given job to the BLOB server and makes
it a permanent BLOB.
|
PermanentBlobKey |
BlobClient.uploadFile(JobID jobId,
Path file)
Uploads a single file to the
PermanentBlobService of the given BlobServer . |
Modifier and Type | Method and Description |
---|---|
static <T> Either<SerializedValue<T>,PermanentBlobKey> |
BlobWriter.serializeAndTryOffload(T value,
JobID jobId,
BlobWriter blobWriter)
Serializes the given value and offloads it to the BlobServer if its size exceeds the minimum
offloading size of the BlobServer.
|
static <T> Either<SerializedValue<T>,PermanentBlobKey> |
BlobWriter.tryOffload(SerializedValue<T> serializedValue,
JobID jobId,
BlobWriter blobWriter) |
static List<PermanentBlobKey> |
BlobClient.uploadFiles(InetSocketAddress serverAddress,
Configuration clientConfig,
JobID jobId,
List<Path> files)
Uploads the JAR files to the
PermanentBlobService of the BlobServer at the
given address with HA as configured. |
Modifier and Type | Method and Description |
---|---|
boolean |
BlobServer.deletePermanent(JobID jobId,
PermanentBlobKey key)
Delete the uploaded data with the given
JobID and PermanentBlobKey . |
boolean |
VoidBlobWriter.deletePermanent(JobID jobId,
PermanentBlobKey key) |
boolean |
BlobWriter.deletePermanent(JobID jobId,
PermanentBlobKey permanentBlobKey)
Delete the uploaded data with the given
JobID and PermanentBlobKey . |
File |
PermanentBlobCache.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
File |
BlobServer.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
File |
PermanentBlobService.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
byte[] |
PermanentBlobCache.readFile(JobID jobId,
PermanentBlobKey blobKey)
Returns the content of the file for the BLOB with the provided job ID the blob key.
|
default byte[] |
PermanentBlobService.readFile(JobID jobId,
PermanentBlobKey key)
Returns the content of the file for the BLOB with the provided job ID the blob key.
|
Modifier and Type | Field and Description |
---|---|
PermanentBlobKey |
TaskDeploymentDescriptor.Offloaded.serializedValueKey
The key of the offloaded value BLOB.
|
Constructor and Description |
---|
Offloaded(PermanentBlobKey serializedValueKey) |
Modifier and Type | Method and Description |
---|---|
UserCodeClassLoader |
LibraryCacheManager.ClassLoaderHandle.getOrResolveClassLoader(Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Gets or resolves the user code class loader for the associated job.
|
Modifier and Type | Method and Description |
---|---|
Either<SerializedValue<JobInformation>,PermanentBlobKey> |
DefaultExecutionGraph.getJobInformationOrBlobKey() |
Either<SerializedValue<JobInformation>,PermanentBlobKey> |
InternalExecutionGraphAccessor.getJobInformationOrBlobKey() |
Collection<PermanentBlobKey> |
JobInformation.getRequiredJarFileBlobKeys() |
Either<SerializedValue<TaskInformation>,PermanentBlobKey> |
ExecutionJobVertex.getTaskInformationOrBlobKey() |
Modifier and Type | Method and Description |
---|---|
void |
DefaultExecutionGraph.deleteBlobs(List<PermanentBlobKey> blobKeys) |
void |
InternalExecutionGraphAccessor.deleteBlobs(List<PermanentBlobKey> blobKeys) |
Constructor and Description |
---|
JobInformation(JobID jobId,
String jobName,
SerializedValue<ExecutionConfig> serializedExecutionConfig,
Configuration jobConfiguration,
Collection<PermanentBlobKey> requiredJarFileBlobKeys,
Collection<URL> requiredClasspathURLs) |
Modifier and Type | Method and Description |
---|---|
List<PermanentBlobKey> |
JobGraph.getUserJarBlobKeys()
Returns a set of BLOB keys referring to the JAR files required to run this job.
|
Modifier and Type | Method and Description |
---|---|
void |
JobGraph.addUserJarBlobKey(PermanentBlobKey key)
Adds the BLOB referenced by the key to the JobGraph's dependencies.
|
void |
JobGraph.setUserArtifactBlobKey(String entryName,
PermanentBlobKey blobKey) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.