WebHdfsFileSystem (Apache Hadoop HDFS 2.4.1 API)

Overview

Package

Class

Use

Tree

Deprecated

Index

Help

PREV CLASS NEXT CLASS

FRAMES NO FRAMES

SUMMARY: NESTED | FIELD | CONSTR | METHOD

DETAIL: FIELD | CONSTR | METHOD

org.apache.hadoop.hdfs.web
Class WebHdfsFileSystem

java.lang.Object
  org.apache.hadoop.conf.Configured
      org.apache.hadoop.fs.FileSystem
          org.apache.hadoop.hdfs.web.WebHdfsFileSystem

All Implemented Interfaces:: Closeable, org.apache.hadoop.conf.Configurable, org.apache.hadoop.fs.DelegationTokenRenewer.Renewable

Direct Known Subclasses:: SWebHdfsFileSystem

public class WebHdfsFileSystem
extends org.apache.hadoop.fs.FileSystem
implements org.apache.hadoop.fs.DelegationTokenRenewer.Renewable
extends org.apache.hadoop.fs.FileSystem
implements org.apache.hadoop.fs.DelegationTokenRenewer.Renewable

A FileSystem for HDFS over the web.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.fs.FileSystem
`org.apache.hadoop.fs.FileSystem.Statistics`

Field Summary
`protected org.apache.hadoop.hdfs.web.URLConnectionFactory`	`connectionFactory` Default connection factory may be overridden in tests to use smaller timeout values
`static org.apache.commons.logging.Log`	`LOG`
`static String`	`PATH_PREFIX` Http URI: http://namenode:port/{PATH_PREFIX}/path/to/file
`static String`	`SCHEME` File System URI: {SCHEME}://namenode:port/path/to/file
`static org.apache.hadoop.io.Text`	`TOKEN_KIND` Delegation token kind
`protected org.apache.hadoop.hdfs.web.TokenAspect<? extends WebHdfsFileSystem>`	`tokenAspect`
`protected org.apache.hadoop.io.Text`	`tokenServiceName`
`static int`	`VERSION` WebHdfs version.

Fields inherited from class org.apache.hadoop.fs.FileSystem
`DEFAULT_FS, FS_DEFAULT_NAME_KEY, SHUTDOWN_HOOK_PRIORITY, statistics`

Constructor Summary
`WebHdfsFileSystem()`

Method Summary

org.apache.hadoop.fs.FSDataOutputStream append(org.apache.hadoop.fs.Path f, int bufferSize, org.apache.hadoop.util.Progressable progress)

void cancelDelegationToken(org.apache.hadoop.security.token.Token<?> token)

protected URI canonicalizeUri(URI uri)

void close()

void concat(org.apache.hadoop.fs.Path trg, org.apache.hadoop.fs.Path[] srcs)

org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress)

void createSymlink(org.apache.hadoop.fs.Path destination, org.apache.hadoop.fs.Path f, boolean createParent)
Create a symlink pointing to the destination path.

boolean delete(org.apache.hadoop.fs.Path f, boolean recursive)

org.apache.hadoop.fs.permission.AclStatus getAclStatus(org.apache.hadoop.fs.Path f)

String getCanonicalServiceName()

URI getCanonicalUri()

org.apache.hadoop.fs.ContentSummary getContentSummary(org.apache.hadoop.fs.Path p)

long getDefaultBlockSize()

protected int getDefaultPort()

short getDefaultReplication()

protected org.apache.hadoop.security.token.Token<?> getDelegationToken()

org.apache.hadoop.security.token.Token<org.apache.hadoop.hdfs.security.token.delegation.DelegationTokenIdentifier> getDelegationToken(String renewer)

org.apache.hadoop.fs.BlockLocation[] getFileBlockLocations(org.apache.hadoop.fs.FileStatus status, long offset, long length)

org.apache.hadoop.fs.BlockLocation[] getFileBlockLocations(org.apache.hadoop.fs.Path p, long offset, long length)

org.apache.hadoop.fs.MD5MD5CRC32FileChecksum getFileChecksum(org.apache.hadoop.fs.Path p)

org.apache.hadoop.fs.FileStatus getFileStatus(org.apache.hadoop.fs.Path f)

org.apache.hadoop.fs.Path getHomeDirectory()

static String getHomeDirectoryString(org.apache.hadoop.security.UserGroupInformation ugi)

org.apache.hadoop.security.token.Token<?> getRenewToken()

String getScheme()
Return the protocol scheme for the FileSystem.

protected String getTransportScheme()
return the underlying transport protocol (http / https).

URI getUri()

org.apache.hadoop.fs.Path getWorkingDirectory()

void initialize(URI uri, org.apache.hadoop.conf.Configuration conf)

protected void initializeTokenAspect()
Initialize tokenAspect.

static boolean isEnabled(org.apache.hadoop.conf.Configuration conf, org.apache.commons.logging.Log log)
Is WebHDFS enabled in conf?

org.apache.hadoop.fs.FileStatus[] listStatus(org.apache.hadoop.fs.Path f)

boolean mkdirs(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission)

void modifyAclEntries(org.apache.hadoop.fs.Path path, List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)

org.apache.hadoop.fs.FSDataInputStream open(org.apache.hadoop.fs.Path f, int buffersize)

void removeAcl(org.apache.hadoop.fs.Path path)

void removeAclEntries(org.apache.hadoop.fs.Path path, List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)

void removeDefaultAcl(org.apache.hadoop.fs.Path path)

boolean rename(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)

void rename(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst, org.apache.hadoop.fs.Options.Rename... options)

long renewDelegationToken(org.apache.hadoop.security.token.Token<?> token)

void setAcl(org.apache.hadoop.fs.Path p, List<org.apache.hadoop.fs.permission.AclEntry> aclSpec)





<T extends org.apache.hadoop.security.token.TokenIdentifier> 


void

setDelegationToken(org.apache.hadoop.security.token.Token<T> token)

void setOwner(org.apache.hadoop.fs.Path p, String owner, String group)

void setPermission(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission)

boolean setReplication(org.apache.hadoop.fs.Path p, short replication)

void setTimes(org.apache.hadoop.fs.Path p, long mtime, long atime)

void setWorkingDirectory(org.apache.hadoop.fs.Path dir)

Methods inherited from class org.apache.hadoop.fs.FileSystem
append, append, areSymlinksEnabled, cancelDeleteOnExit, checkPath, clearStatistics, closeAll, closeAllForUGI, completeLocalOutput, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, create, create, createNewFile, createNonRecursive, createNonRecursive, createNonRecursive, createSnapshot, createSnapshot, delete, deleteOnExit, deleteSnapshot, enableSymlinks, exists, fixRelativePart, get, get, get, getAllStatistics, getBlockSize, getDefaultBlockSize, getDefaultReplication, getDefaultUri, getFileLinkStatus, getFileSystemClass, getFSofPath, getInitialWorkingDirectory, getLength, getLinkTarget, getLocal, getName, getNamed, getReplication, getServerDefaults, getServerDefaults, getStatistics, getStatistics, getStatus, getStatus, getUsed, globStatus, globStatus, isDirectory, isFile, listCorruptFileBlocks, listFiles, listLocatedStatus, listLocatedStatus, listStatus, listStatus, listStatus, makeQualified, mkdirs, mkdirs, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, newInstance, newInstance, newInstance, newInstanceLocal, open, primitiveCreate, primitiveMkdir, primitiveMkdir, printStatistics, processDeleteOnExit, renameSnapshot, resolveLink, resolvePath, setDefaultUri, setDefaultUri, setVerifyChecksum, setWriteChecksum, startLocalOutput, supportsSymlinks

Methods inherited from class org.apache.hadoop.fs.FileSystem

append, append, areSymlinksEnabled, cancelDeleteOnExit, checkPath, clearStatistics, closeAll, closeAllForUGI, completeLocalOutput, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, create, create, createNewFile, createNonRecursive, createNonRecursive, createNonRecursive, createSnapshot, createSnapshot, delete, deleteOnExit, deleteSnapshot, enableSymlinks, exists, fixRelativePart, get, get, get, getAllStatistics, getBlockSize, getDefaultBlockSize, getDefaultReplication, getDefaultUri, getFileLinkStatus, getFileSystemClass, getFSofPath, getInitialWorkingDirectory, getLength, getLinkTarget, getLocal, getName, getNamed, getReplication, getServerDefaults, getServerDefaults, getStatistics, getStatistics, getStatus, getStatus, getUsed, globStatus, globStatus, isDirectory, isFile, listCorruptFileBlocks, listFiles, listLocatedStatus, listLocatedStatus, listStatus, listStatus, listStatus, makeQualified, mkdirs, mkdirs, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, newInstance, newInstance, newInstance, newInstanceLocal, open, primitiveCreate, primitiveMkdir, primitiveMkdir, printStatistics, processDeleteOnExit, renameSnapshot, resolveLink, resolvePath, setDefaultUri, setDefaultUri, setVerifyChecksum, setWriteChecksum, startLocalOutput, supportsSymlinks

Methods inherited from class org.apache.hadoop.conf.Configured
`getConf, setConf`

Methods inherited from class java.lang.Object
`clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

Field Detail

LOG

public static final org.apache.commons.logging.Log LOG

SCHEME

public static final String SCHEME

File System URI: {SCHEME}://namenode:port/path/to/file

See Also:: Constant Field Values

VERSION

public static final int VERSION

WebHdfs version.

See Also:: Constant Field Values

PATH_PREFIX

public static final String PATH_PREFIX

Http URI: http://namenode:port/{PATH_PREFIX}/path/to/file

See Also:: Constant Field Values

connectionFactory

protected org.apache.hadoop.hdfs.web.URLConnectionFactory connectionFactory

Default connection factory may be overridden in tests to use smaller timeout values

TOKEN_KIND

public static final org.apache.hadoop.io.Text TOKEN_KIND

Delegation token kind

tokenAspect

protected org.apache.hadoop.hdfs.web.TokenAspect<? extends WebHdfsFileSystem> tokenAspect

tokenServiceName

protected org.apache.hadoop.io.Text tokenServiceName

Constructor Detail