@InterfaceAudience.LimitedPrivate(value="mapreduce")
@InterfaceStability.Unstable
public class AbfsManifestStoreOperations
extends org.apache.hadoop.mapreduce.lib.output.committer.manifest.impl.ManifestStoreOperationsThroughFileSystem
AzureManifestCommitterFactory will configure
this as the binding to the FS.
ADLS Gen2 stores support etag-recovery on renames, but not WASB
stores.| Modifier and Type | Field and Description |
|---|---|
static String |
NAME
Classname, which can be declared in jpb configurations.
|
| Constructor and Description |
|---|
AbfsManifestStoreOperations() |
| Modifier and Type | Method and Description |
|---|---|
void |
bindToFileSystem(org.apache.hadoop.fs.FileSystem filesystem,
org.apache.hadoop.fs.Path path)
Bind to the store.
|
org.apache.hadoop.mapreduce.lib.output.committer.manifest.impl.ManifestStoreOperations.CommitFileResult |
commitFile(org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.FileEntry entry)
Commit a file through an internal ABFS operation.
|
AzureBlobFileSystem |
getFileSystem() |
boolean |
storePreservesEtagsThroughRenames(org.apache.hadoop.fs.Path path)
Etags are preserved through Gen2 stores, but not wasb stores.
|
boolean |
storeSupportsResilientCommit()
Resilient commits available on hierarchical stores.
|
close, delete, deleteRecursive, getFileStatus, isFile, listStatusIterator, loadTaskManifest, mkdirs, msync, renameFile, savepublic static final String NAME
public AzureBlobFileSystem getFileSystem()
getFileSystem in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.impl.ManifestStoreOperationsThroughFileSystempublic void bindToFileSystem(org.apache.hadoop.fs.FileSystem filesystem,
org.apache.hadoop.fs.Path path)
throws IOException
bindToFileSystem in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.impl.ManifestStoreOperationsThroughFileSystemfilesystem - FS.path - path to work underIOException - binding problems.public boolean storePreservesEtagsThroughRenames(org.apache.hadoop.fs.Path path)
storePreservesEtagsThroughRenames in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.impl.ManifestStoreOperationsThroughFileSystempath - path to probe.public boolean storeSupportsResilientCommit()
storeSupportsResilientCommit in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.impl.ManifestStoreOperationspublic org.apache.hadoop.mapreduce.lib.output.committer.manifest.impl.ManifestStoreOperations.CommitFileResult commitFile(org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.FileEntry entry)
throws IOException
commitFile in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.impl.ManifestStoreOperationsentry - entry to commitIOException - any failure in resilient commit.UnsupportedOperationException - if not available.Copyright © 2008–2024 Apache Software Foundation. All rights reserved.