A B C D E F G H I L N O P R S T W

A

ASYNC_DFS_OUTPUT_CREATE_MAX_RETRIES - Static variable in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper

AsyncFSOutput - Interface in org.apache.hadoop.hbase.io.asyncfs

Interface for asynchronous filesystem output stream.

AsyncFSOutputHelper - Class in org.apache.hadoop.hbase.io.asyncfs

Helper class for creating AsyncFSOutput.

B

buffered() - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Return the current size of buffered data.

buffered() - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

buffered() - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

C

CancelableProgressable - Interface in org.apache.hadoop.hbase.util

Similar interface as Progressable but returns a boolean to support canceling the operation.

checkProcessTimeAndSpeed(DatanodeInfo, long, long, long, int) - Method in class org.apache.hadoop.hbase.io.asyncfs.monitor.StreamSlowMonitor

Check if the packet process time shows that the relevant datanode is a slow node.

close() - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Close the file.

close() - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

End the current block and complete file at namenode.

close() - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

create(Configuration, String) - Static method in class org.apache.hadoop.hbase.io.asyncfs.monitor.StreamSlowMonitor

createOutput(FileSystem, Path, boolean, boolean, short, long, EventLoopGroup, Class<? extends Channel>, StreamSlowMonitor, boolean) - Static method in class org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper

Create FanOutOneBlockAsyncDFSOutput for DistributedFileSystem, and a simple implementation for other FileSystem which wraps around a FSDataOutputStream.

createOutput(DistributedFileSystem, Path, boolean, boolean, short, long, EventLoopGroup, Class<? extends Channel>, StreamSlowMonitor, boolean) - Static method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper

Create a FanOutOneBlockAsyncDFSOutput.

D

DATANODE_SLOW_PACKET_PROCESS_TIME_KEY - Static variable in class org.apache.hadoop.hbase.io.asyncfs.monitor.StreamSlowMonitor

Configure for the slow packet process time, a duration from send to ACK.

decode(ChannelHandlerContext, ByteBuf, List<Object>) - Method in class org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder

DEFAULT_ASYNC_DFS_OUTPUT_CREATE_MAX_RETRIES - Static variable in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper

DEFAULT_WAL_EXCLUDE_DATANODE_TTL - Static variable in class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

DEFAULT_WAL_MAX_EXCLUDE_SLOW_DATANODE_COUNT - Static variable in class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

E

ExcludeDatanodeManager - Class in org.apache.hadoop.hbase.io.asyncfs.monitor

The class to manage the excluded datanodes of the WALs on the regionserver.

ExcludeDatanodeManager(Configuration) - Constructor for class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

F

FanOutOneBlockAsyncDFSOutput - Class in org.apache.hadoop.hbase.io.asyncfs

An asynchronous HDFS output stream implementation which fans out data to datanode and only supports writing file with only one block.

FanOutOneBlockAsyncDFSOutputHelper - Class in org.apache.hadoop.hbase.io.asyncfs

Helper class for implementing FanOutOneBlockAsyncDFSOutput.

FanOutOneBlockAsyncDFSOutputHelper.NameNodeException - Exception in org.apache.hadoop.hbase.io.asyncfs

Exception other than RemoteException thrown when calling create on namenode

FanOutOneBlockAsyncDFSOutputSaslHelper - Class in org.apache.hadoop.hbase.io.asyncfs

Helper class for adding sasl support for FanOutOneBlockAsyncDFSOutput.

flush(boolean) - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Flush the buffer out.

flush(boolean) - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

Flush the buffer out to datanodes.

flush(boolean) - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

G

getDataNodeInfo(Collection<DatanodeInfo>) - Static method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper

getExcludeDatanodeManager() - Method in class org.apache.hadoop.hbase.io.asyncfs.monitor.StreamSlowMonitor

getExcludeDNs() - Method in class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

getLocatedBlockLocations(LocatedBlock) - Static method in class org.apache.hadoop.hbase.util.LocatedBlockHelper

getPipeline() - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Return current pipeline.

getPipeline() - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

getPipeline() - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

getStreamSlowMonitor(String) - Method in class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

getSyncedLength() - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Returns byteSize success synced to underlying filesystem.

getSyncedLength() - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

getSyncedLength() - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

H

HEART_BEAT_SEQNO - Static variable in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper

I

isBroken() - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Whether the stream is broken.

isBroken() - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

isBroken() - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

L

LocatedBlockHelper - Class in org.apache.hadoop.hbase.util

hadoop 3.3.1 changed the return value of this method from DatanodeInfo[] to DatanodeInfoWithStorage[], which causes the JVM can not locate the method if we are compiled with hadoop 3.2 and then link with hadoop 3.3+, so here we need to use reflection to make it work for both hadoop versions, otherwise we need to publish more artifacts for different hadoop versions...

N

NameNodeException(Throwable) - Constructor for exception org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.NameNodeException

O

onConfigurationChange(Configuration) - Method in class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

onConfigurationChange(Configuration) - Method in class org.apache.hadoop.hbase.io.asyncfs.monitor.StreamSlowMonitor

org.apache.hadoop.hbase.io.asyncfs - package org.apache.hadoop.hbase.io.asyncfs

org.apache.hadoop.hbase.io.asyncfs.monitor - package org.apache.hadoop.hbase.io.asyncfs.monitor

org.apache.hadoop.hbase.util - package org.apache.hadoop.hbase.util

P

progress() - Method in interface org.apache.hadoop.hbase.util.CancelableProgressable

Report progress.

ProtobufDecoder - Class in org.apache.hadoop.hbase.io.asyncfs

Modified based on io.netty.handler.codec.protobuf.ProtobufDecoder.

ProtobufDecoder(Object) - Constructor for class org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder

R

READ_TIMEOUT - Static variable in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper

recoverAndClose(CancelableProgressable) - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

The close method when error occurred.

recoverAndClose(CancelableProgressable) - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

The close method when error occurred.

recoverAndClose(CancelableProgressable) - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

recoverFileLease(FileSystem, Path, Configuration) - Static method in class org.apache.hadoop.hbase.util.RecoverLeaseFSUtils

recoverFileLease(FileSystem, Path, Configuration, CancelableProgressable) - Static method in class org.apache.hadoop.hbase.util.RecoverLeaseFSUtils

Recover the lease from HDFS, retrying multiple times.

RecoverLeaseFSUtils - Class in org.apache.hadoop.hbase.util

Utility methods for recovering file lease for hdfs.

S

shouldRetryCreate(RemoteException) - Static method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper

StreamSlowMonitor - Class in org.apache.hadoop.hbase.io.asyncfs.monitor

Class for monitor the wal file flush performance.

StreamSlowMonitor(Configuration, String, ExcludeDatanodeManager) - Constructor for class org.apache.hadoop.hbase.io.asyncfs.monitor.StreamSlowMonitor

T

tryAddExcludeDN(DatanodeInfo, String) - Method in class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

Try to add a datanode to the regionserver excluding cache

W

WAL_EXCLUDE_DATANODE_TTL_KEY - Static variable in class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

Configure for the TTL time of the datanodes excluded

WAL_MAX_EXCLUDE_SLOW_DATANODE_COUNT_KEY - Static variable in class org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

Configure for the max count the excluded datanodes.

WrapperAsyncFSOutput - Class in org.apache.hadoop.hbase.io.asyncfs

An AsyncFSOutput wraps a FSDataOutputStream.

WrapperAsyncFSOutput(Path, FSDataOutputStream) - Constructor for class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

write(byte[]) - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Just call write(b, 0, b.length).

write(byte[], int, int) - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Copy the data into the buffer.

write(ByteBuffer) - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Copy the data in the given bb into the buffer.

write(ByteBuffer) - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

write(byte[]) - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

write(byte[], int, int) - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

write(byte[]) - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

write(byte[], int, int) - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

write(ByteBuffer) - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

writeInt(int) - Method in interface org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutput

Write an int to the buffer.

writeInt(int) - Method in class org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput

writeInt(int) - Method in class org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

A B C D E F G H I L N O P R S T W