org.apache.hadoop.hbase.fs

类 HFileSystem

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.fs.FileSystem

org.apache.hadoop.fs.FilterFileSystem

org.apache.hadoop.hbase.fs.HFileSystem

所有已实现的接口:

Closeable, AutoCloseable, org.apache.hadoop.conf.Configurable

@InterfaceAudience.Private
public class HFileSystem
extends org.apache.hadoop.fs.FilterFileSystem

An encapsulation for the FileSystem object that hbase uses to access data. This class allows the flexibility of using separate filesystem objects for reading and writing hfiles and wals.

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.fs.FileSystem

org.apache.hadoop.fs.FileSystem.Statistics

字段概要

字段

限定符和类型	字段和说明
static org.slf4j.Logger	LOG

从类继承的字段 org.apache.hadoop.fs.FilterFileSystem

fs, swapScheme

从类继承的字段 org.apache.hadoop.fs.FileSystem

DEFAULT_FS, FS_DEFAULT_NAME_KEY, SHUTDOWN_HOOK_PRIORITY, statistics

构造器概要

构造器

构造器和说明
HFileSystem(org.apache.hadoop.conf.Configuration conf, boolean useHBaseChecksum) Create a FileSystem object for HBase regionservers.
HFileSystem(org.apache.hadoop.fs.FileSystem fs) Wrap a FileSystem object within a HFileSystem.

方法概要

限定符和类型	方法和说明
static boolean	addLocationsOrderInterceptor(org.apache.hadoop.conf.Configuration conf)
void	close() Close this filesystem object
org.apache.hadoop.fs.FSDataOutputStream	createNonRecursive(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress) The org.apache.hadoop.fs.FilterFileSystem does not yet support createNonRecursive.
static org.apache.hadoop.fs.FileSystem	get(org.apache.hadoop.conf.Configuration conf) Create a new HFileSystem object, similar to FileSystem.get().
org.apache.hadoop.fs.FileSystem	getBackingFs() Returns the underlying filesystem
static org.apache.hadoop.fs.FileSystem	getLocalFs(org.apache.hadoop.conf.Configuration conf) Wrap a LocalFileSystem within a HFileSystem.
org.apache.hadoop.fs.FileSystem	getNoChecksumFs() Returns the filesystem that is specially setup for doing reads from storage.
String	getStoragePolicyName(org.apache.hadoop.fs.Path path) Get the storage policy of the source path (directory/file).
void	setStoragePolicy(org.apache.hadoop.fs.Path path, String policyName) Set the source path (directory/file) to the specified storage policy.
boolean	useHBaseChecksum() Are we verifying checksums in HBase?

从类继承的方法 org.apache.hadoop.fs.FilterFileSystem

access, append, canonicalizeUri, checkPath, completeLocalOutput, concat, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, create, create, createNonRecursive, createSnapshot, createSymlink, delete, deleteSnapshot, getAclStatus, getCanonicalUri, getChildFileSystems, getConf, getDefaultBlockSize, getDefaultBlockSize, getDefaultReplication, getDefaultReplication, getFileBlockLocations, getFileChecksum, getFileChecksum, getFileLinkStatus, getFileStatus, getHomeDirectory, getInitialWorkingDirectory, getLinkTarget, getRawFileSystem, getServerDefaults, getServerDefaults, getStatus, getUri, getUsed, getWorkingDirectory, getXAttr, getXAttrs, getXAttrs, initialize, listCorruptFileBlocks, listLocatedStatus, listStatus, listStatusIterator, listXAttrs, makeQualified, mkdirs, modifyAclEntries, open, primitiveCreate, primitiveMkdir, removeAcl, removeAclEntries, removeDefaultAcl, removeXAttr, rename, rename, renameSnapshot, resolveLink, resolvePath, setAcl, setOwner, setPermission, setReplication, setTimes, setVerifyChecksum, setWorkingDirectory, setWriteChecksum, setXAttr, setXAttr, startLocalOutput, supportsSymlinks, truncate

从类继承的方法 org.apache.hadoop.fs.FileSystem

addDelegationTokens, append, append, areSymlinksEnabled, cancelDeleteOnExit, clearStatistics, closeAll, closeAllForUGI, copyFromLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, create, createNewFile, createNonRecursive, createSnapshot, delete, deleteOnExit, enableSymlinks, exists, fixRelativePart, get, get, getAllStatistics, getBlockSize, getCanonicalServiceName, getContentSummary, getDefaultPort, getDefaultUri, getDelegationToken, getFileBlockLocations, getFileSystemClass, getFSofPath, getLength, getLocal, getName, getNamed, getReplication, getScheme, getStatistics, getStatistics, getStatus, globStatus, globStatus, isDirectory, isFile, listFiles, listLocatedStatus, listStatus, listStatus, listStatus, mkdirs, mkdirs, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, newInstance, newInstance, newInstance, newInstanceLocal, open, primitiveMkdir, printStatistics, processDeleteOnExit, setDefaultUri, setDefaultUri

从类继承的方法 org.apache.hadoop.conf.Configured

setConf

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

LOG

public static final org.slf4j.Logger LOG

构造器详细资料

HFileSystem

public HFileSystem(org.apache.hadoop.conf.Configuration conf,
                   boolean useHBaseChecksum)
            throws IOException

Create a FileSystem object for HBase regionservers.

参数:

conf - The configuration to be used for the filesystem

useHBaseChecksum - if true, then use checksum verfication in hbase, otherwise delegate checksum verification to the FileSystem.

抛出:

IOException

HFileSystem

public HFileSystem(org.apache.hadoop.fs.FileSystem fs)

Wrap a FileSystem object within a HFileSystem. The noChecksumFs and writefs are both set to be the same specified fs. Do not verify hbase-checksums while reading data from filesystem.

参数:

fs - Set the noChecksumFs and writeFs to this specified filesystem.

方法详细资料

getNoChecksumFs

public org.apache.hadoop.fs.FileSystem getNoChecksumFs()

Returns the filesystem that is specially setup for doing reads from storage. This object avoids doing checksum verifications for reads.

返回:

The FileSystem object that can be used to read data from files.

getBackingFs

public org.apache.hadoop.fs.FileSystem getBackingFs()
                                             throws IOException

Returns the underlying filesystem

返回:

The underlying FileSystem for this FilterFileSystem object.

抛出:

IOException

setStoragePolicy

public void setStoragePolicy(org.apache.hadoop.fs.Path path,
                             String policyName)

Set the source path (directory/file) to the specified storage policy.

参数:

path - The source path (directory/file).

policyName - The name of the storage policy: 'HOT', 'COLD', etc. See see hadoop 2.6+ org.apache.hadoop.hdfs.protocol.HdfsConstants for possible list e.g 'COLD', 'WARM', 'HOT', 'ONE_SSD', 'ALL_SSD', 'LAZY_PERSIST'.

getStoragePolicyName

@Nullable
public String getStoragePolicyName(org.apache.hadoop.fs.Path path)

Get the storage policy of the source path (directory/file).

参数:

path - The source path (directory/file).

返回:

Storage policy name, or null if not using DistributedFileSystem or exception thrown when trying to get policy

useHBaseChecksum

public boolean useHBaseChecksum()

Are we verifying checksums in HBase?

返回:

True, if hbase is configured to verify checksums, otherwise false.

close

public void close()
           throws IOException

Close this filesystem object

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

覆盖:

close 在类中 org.apache.hadoop.fs.FilterFileSystem

抛出:

IOException

addLocationsOrderInterceptor

public static boolean addLocationsOrderInterceptor(org.apache.hadoop.conf.Configuration conf)
                                            throws IOException

抛出:

IOException

get

public static org.apache.hadoop.fs.FileSystem get(org.apache.hadoop.conf.Configuration conf)
                                           throws IOException

Create a new HFileSystem object, similar to FileSystem.get(). This returns a filesystem object that avoids checksum verification in the filesystem for hfileblock-reads. For these blocks, checksum verification is done by HBase.

抛出:

IOException

getLocalFs

public static org.apache.hadoop.fs.FileSystem getLocalFs(org.apache.hadoop.conf.Configuration conf)
                                                  throws IOException

Wrap a LocalFileSystem within a HFileSystem.

抛出:

IOException

createNonRecursive

public org.apache.hadoop.fs.FSDataOutputStream createNonRecursive(org.apache.hadoop.fs.Path f,
                                                                  boolean overwrite,
                                                                  int bufferSize,
                                                                  short replication,
                                                                  long blockSize,
                                                                  org.apache.hadoop.util.Progressable progress)
                                                           throws IOException

The org.apache.hadoop.fs.FilterFileSystem does not yet support createNonRecursive. This is a hadoop bug and when it is fixed in Hadoop, this definition will go away.

覆盖:

createNonRecursive 在类中 org.apache.hadoop.fs.FileSystem

抛出:

IOException