WebHdfsFileSystem (Apache Hadoop HDFS 2.2.0 API)

Overview

Package

Class

Use

Tree

Deprecated

Index

Help

PREV CLASS NEXT CLASS

FRAMES NO FRAMES

SUMMARY: NESTED | FIELD | CONSTR | METHOD

DETAIL: FIELD | CONSTR | METHOD

org.apache.hadoop.hdfs.web
Class WebHdfsFileSystem

java.lang.Object
  org.apache.hadoop.conf.Configured
      org.apache.hadoop.fs.FileSystem
          org.apache.hadoop.hdfs.web.WebHdfsFileSystem

All Implemented Interfaces:: Closeable, org.apache.hadoop.conf.Configurable, org.apache.hadoop.fs.DelegationTokenRenewer.Renewable

public class WebHdfsFileSystem
extends org.apache.hadoop.fs.FileSystem
implements org.apache.hadoop.fs.DelegationTokenRenewer.Renewable
extends org.apache.hadoop.fs.FileSystem
implements org.apache.hadoop.fs.DelegationTokenRenewer.Renewable

A FileSystem for HDFS over the web.

Nested Class Summary
`static class`	`WebHdfsFileSystem.DtRenewer` Delegation token renewer.

Nested classes/interfaces inherited from class org.apache.hadoop.fs.FileSystem
`org.apache.hadoop.fs.FileSystem.Statistics`

Field Summary
`static org.apache.hadoop.hdfs.web.WebHdfsFileSystem.WebHdfsDelegationTokenSelector`	`DT_SELECTOR` Token selector
`static org.apache.commons.logging.Log`	`LOG`
`static String`	`PATH_PREFIX` Http URI: http://namenode:port/{PATH_PREFIX}/path/to/file
`static String`	`SCHEME` File System URI: {SCHEME}://namenode:port/path/to/file
`static org.apache.hadoop.io.Text`	`TOKEN_KIND` Delegation token kind
`static int`	`VERSION` WebHdfs version.

Fields inherited from class org.apache.hadoop.fs.FileSystem
`DEFAULT_FS, FS_DEFAULT_NAME_KEY, SHUTDOWN_HOOK_PRIORITY, statistics`

Constructor Summary
`WebHdfsFileSystem()`

Method Summary

protected void addRenewAction(WebHdfsFileSystem webhdfs)

org.apache.hadoop.fs.FSDataOutputStream append(org.apache.hadoop.fs.Path f, int bufferSize, org.apache.hadoop.util.Progressable progress)

protected URI canonicalizeUri(URI uri)

void close()

void concat(org.apache.hadoop.fs.Path trg, org.apache.hadoop.fs.Path[] srcs)

org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress)

void createSymlink(org.apache.hadoop.fs.Path destination, org.apache.hadoop.fs.Path f, boolean createParent)
Create a symlink pointing to the destination path.

boolean delete(org.apache.hadoop.fs.Path f)

boolean delete(org.apache.hadoop.fs.Path f, boolean recursive)

org.apache.hadoop.fs.ContentSummary getContentSummary(org.apache.hadoop.fs.Path p)

long getDefaultBlockSize()

protected int getDefaultPort()

short getDefaultReplication()

protected org.apache.hadoop.security.token.Token<?> getDelegationToken()

org.apache.hadoop.security.token.Token<org.apache.hadoop.hdfs.security.token.delegation.DelegationTokenIdentifier> getDelegationToken(String renewer)

org.apache.hadoop.fs.BlockLocation[] getFileBlockLocations(org.apache.hadoop.fs.FileStatus status, long offset, long length)

org.apache.hadoop.fs.BlockLocation[] getFileBlockLocations(org.apache.hadoop.fs.Path p, long offset, long length)

org.apache.hadoop.fs.MD5MD5CRC32FileChecksum getFileChecksum(org.apache.hadoop.fs.Path p)

org.apache.hadoop.fs.FileStatus getFileStatus(org.apache.hadoop.fs.Path f)

org.apache.hadoop.fs.Path getHomeDirectory()

static String getHomeDirectoryString(org.apache.hadoop.security.UserGroupInformation ugi)

org.apache.hadoop.security.token.Token<?> getRenewToken()

String getScheme()
Return the protocol scheme for the FileSystem.

URI getUri()

org.apache.hadoop.fs.Path getWorkingDirectory()

protected void initDelegationToken()

void initialize(URI uri, org.apache.hadoop.conf.Configuration conf)

static boolean isEnabled(org.apache.hadoop.conf.Configuration conf, org.apache.commons.logging.Log log)
Is WebHDFS enabled in conf?

org.apache.hadoop.fs.FileStatus[] listStatus(org.apache.hadoop.fs.Path f)

boolean mkdirs(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission)

org.apache.hadoop.fs.FSDataInputStream open(org.apache.hadoop.fs.Path f, int buffersize)

boolean rename(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)

void rename(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst, org.apache.hadoop.fs.Options.Rename... options)

protected org.apache.hadoop.security.token.Token<org.apache.hadoop.hdfs.security.token.delegation.DelegationTokenIdentifier> selectDelegationToken(org.apache.hadoop.security.UserGroupInformation ugi)





<T extends org.apache.hadoop.security.token.TokenIdentifier> 


void

setDelegationToken(org.apache.hadoop.security.token.Token<T> token)

void setOwner(org.apache.hadoop.fs.Path p, String owner, String group)

void setPermission(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission)

boolean setReplication(org.apache.hadoop.fs.Path p, short replication)

void setTimes(org.apache.hadoop.fs.Path p, long mtime, long atime)

void setWorkingDirectory(org.apache.hadoop.fs.Path dir)

Methods inherited from class org.apache.hadoop.fs.FileSystem
append, append, cancelDeleteOnExit, checkPath, clearStatistics, closeAll, closeAllForUGI, completeLocalOutput, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, create, create, createNewFile, createNonRecursive, createNonRecursive, createNonRecursive, createSnapshot, createSnapshot, deleteOnExit, deleteSnapshot, enableSymlinks, exists, fixRelativePart, get, get, get, getAllStatistics, getBlockSize, getCanonicalUri, getDefaultBlockSize, getDefaultReplication, getDefaultUri, getFileLinkStatus, getFileSystemClass, getFSofPath, getInitialWorkingDirectory, getLength, getLinkTarget, getLocal, getName, getNamed, getReplication, getServerDefaults, getServerDefaults, getStatistics, getStatistics, getStatus, getStatus, getUsed, globStatus, globStatus, isDirectory, isFile, isSymlinksEnabled, listCorruptFileBlocks, listFiles, listLocatedStatus, listLocatedStatus, listStatus, listStatus, listStatus, makeQualified, mkdirs, mkdirs, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, newInstance, newInstance, newInstance, newInstanceLocal, open, primitiveCreate, primitiveMkdir, primitiveMkdir, printStatistics, processDeleteOnExit, renameSnapshot, resolveLink, resolvePath, setDefaultUri, setDefaultUri, setVerifyChecksum, setWriteChecksum, startLocalOutput, supportsSymlinks

Methods inherited from class org.apache.hadoop.fs.FileSystem

append, append, cancelDeleteOnExit, checkPath, clearStatistics, closeAll, closeAllForUGI, completeLocalOutput, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, create, create, createNewFile, createNonRecursive, createNonRecursive, createNonRecursive, createSnapshot, createSnapshot, deleteOnExit, deleteSnapshot, enableSymlinks, exists, fixRelativePart, get, get, get, getAllStatistics, getBlockSize, getCanonicalUri, getDefaultBlockSize, getDefaultReplication, getDefaultUri, getFileLinkStatus, getFileSystemClass, getFSofPath, getInitialWorkingDirectory, getLength, getLinkTarget, getLocal, getName, getNamed, getReplication, getServerDefaults, getServerDefaults, getStatistics, getStatistics, getStatus, getStatus, getUsed, globStatus, globStatus, isDirectory, isFile, isSymlinksEnabled, listCorruptFileBlocks, listFiles, listLocatedStatus, listLocatedStatus, listStatus, listStatus, listStatus, makeQualified, mkdirs, mkdirs, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, newInstance, newInstance, newInstance, newInstanceLocal, open, primitiveCreate, primitiveMkdir, primitiveMkdir, printStatistics, processDeleteOnExit, renameSnapshot, resolveLink, resolvePath, setDefaultUri, setDefaultUri, setVerifyChecksum, setWriteChecksum, startLocalOutput, supportsSymlinks

Methods inherited from class org.apache.hadoop.conf.Configured
`getConf, setConf`

Methods inherited from class java.lang.Object
`clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

Field Detail

LOG

public static final org.apache.commons.logging.Log LOG

SCHEME

public static final String SCHEME

File System URI: {SCHEME}://namenode:port/path/to/file

See Also:: Constant Field Values

VERSION

public static final int VERSION

WebHdfs version.

See Also:: Constant Field Values

PATH_PREFIX

public static final String PATH_PREFIX

Http URI: http://namenode:port/{PATH_PREFIX}/path/to/file

See Also:: Constant Field Values

TOKEN_KIND

public static final org.apache.hadoop.io.Text TOKEN_KIND

Delegation token kind

DT_SELECTOR

public static final org.apache.hadoop.hdfs.web.WebHdfsFileSystem.WebHdfsDelegationTokenSelector DT_SELECTOR

Token selector

Constructor Detail