org.apache.hadoop.hbase.io

类 FSDataInputStreamWrapper

java.lang.Object

org.apache.hadoop.hbase.io.FSDataInputStreamWrapper

public class FSDataInputStreamWrapper
extends Object

Wrapper for input stream(s) that takes care of the interaction of FS and HBase checksums, as well as closing streams. Initialization is not thread-safe, but normal operation is; see method comments.

构造器概要

构造器

构造器和说明
FSDataInputStreamWrapper(org.apache.hadoop.fs.FileSystem fs, FileLink link)
FSDataInputStreamWrapper(org.apache.hadoop.fs.FileSystem fs, FileLink link, boolean dropBehind)
FSDataInputStreamWrapper(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path)
FSDataInputStreamWrapper(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, boolean dropBehind)
FSDataInputStreamWrapper(org.apache.hadoop.fs.FSDataInputStream fsdis) For use in tests.
FSDataInputStreamWrapper(org.apache.hadoop.fs.FSDataInputStream fsdis, org.apache.hadoop.fs.FSDataInputStream noChecksum) For use in tests.

方法概要

方法

限定符和类型	方法和说明
void	checksumOk() Report that checksum was ok, so we may ponder going back to HBase checksum.
void	close() Close stream(s) if necessary.
org.apache.hadoop.fs.FSDataInputStream	fallbackToFsChecksum(int offCount) Read from non-checksum stream failed, fall back to FS checksum.
HFileSystem	getHfs()
org.apache.hadoop.fs.FSDataInputStream	getStream(boolean useHBaseChecksum) Get the stream to use.
void	prepareForBlockReader(boolean forceNoHBaseChecksum) Prepares the streams for block reader.
boolean	shouldUseHBaseChecksum()
void	unbuffer() This will free sockets and file descriptors held by the stream only when the stream implements org.apache.hadoop.fs.CanUnbuffer.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

FSDataInputStreamWrapper

public FSDataInputStreamWrapper(org.apache.hadoop.fs.FileSystem fs,
                        org.apache.hadoop.fs.Path path)
                         throws IOException

抛出:

IOException

FSDataInputStreamWrapper

public FSDataInputStreamWrapper(org.apache.hadoop.fs.FileSystem fs,
                        org.apache.hadoop.fs.Path path,
                        boolean dropBehind)
                         throws IOException

抛出:

IOException

FSDataInputStreamWrapper

public FSDataInputStreamWrapper(org.apache.hadoop.fs.FileSystem fs,
                        FileLink link)
                         throws IOException

抛出:

IOException

FSDataInputStreamWrapper

public FSDataInputStreamWrapper(org.apache.hadoop.fs.FileSystem fs,
                        FileLink link,
                        boolean dropBehind)
                         throws IOException

抛出:

IOException

FSDataInputStreamWrapper

public FSDataInputStreamWrapper(org.apache.hadoop.fs.FSDataInputStream fsdis)

For use in tests.

FSDataInputStreamWrapper

public FSDataInputStreamWrapper(org.apache.hadoop.fs.FSDataInputStream fsdis,
                        org.apache.hadoop.fs.FSDataInputStream noChecksum)

For use in tests.

方法详细资料

prepareForBlockReader

public void prepareForBlockReader(boolean forceNoHBaseChecksum)
                           throws IOException

Prepares the streams for block reader. NOT THREAD SAFE. Must be called once, after any reads finish and before any other reads start (what happens in reality is we read the tail, then call this based on what's in the tail, then read blocks).

参数:

forceNoHBaseChecksum - Force not using HBase checksum.

抛出:

IOException

shouldUseHBaseChecksum

public boolean shouldUseHBaseChecksum()

返回:

Whether we are presently using HBase checksum.

getStream

public org.apache.hadoop.fs.FSDataInputStream getStream(boolean useHBaseChecksum)

Get the stream to use. Thread-safe.

参数:

useHBaseChecksum - must be the value that shouldUseHBaseChecksum has returned at some point in the past, otherwise the result is undefined.

fallbackToFsChecksum

public org.apache.hadoop.fs.FSDataInputStream fallbackToFsChecksum(int offCount)
                                                            throws IOException

Read from non-checksum stream failed, fall back to FS checksum. Thread-safe.

参数:

offCount - For how many checksumOk calls to turn off the HBase checksum.

抛出:

IOException

checksumOk

public void checksumOk()

Report that checksum was ok, so we may ponder going back to HBase checksum.

close

public void close()
           throws IOException

Close stream(s) if necessary.

抛出:

IOException

getHfs

public HFileSystem getHfs()

unbuffer

public void unbuffer()

This will free sockets and file descriptors held by the stream only when the stream implements org.apache.hadoop.fs.CanUnbuffer. NOT THREAD SAFE. Must be called only when all the clients using this stream to read the blocks have finished reading. If by chance the stream is unbuffered and there are clients still holding this stream for read then on next client read request a new socket will be opened by Datanode without client knowing about it and will serve its read request. Note: If this socket is idle for some time then the DataNode will close the socket and the socket will move into CLOSE_WAIT state and on the next client request on this stream, the current socket will be closed and a new socket will be opened to serve the requests.