org.apache.hadoop.hbase.io.asyncfs.monitor

Class StreamSlowMonitor

java.lang.Object

org.apache.hadoop.hbase.io.asyncfs.monitor.StreamSlowMonitor

All Implemented Interfaces:

ConfigurationObserver

@InterfaceAudience.Private
public class StreamSlowMonitor
extends Object
implements ConfigurationObserver

Class for monitor the wal file flush performance. Each active wal file has a StreamSlowMonitor.

Field Summary

Fields

Modifier and Type	Field and Description
static String	DATANODE_SLOW_PACKET_PROCESS_TIME_KEY Configure for the slow packet process time, a duration from send to ACK.

Constructor Summary

Constructors

Constructor and Description
StreamSlowMonitor(org.apache.hadoop.conf.Configuration conf, String name, ExcludeDatanodeManager excludeDatanodeManager)

Method Summary

Modifier and Type	Method and Description
void	checkProcessTimeAndSpeed(org.apache.hadoop.hdfs.protocol.DatanodeInfo datanodeInfo, long packetDataLen, long processTimeMs, long lastAckTimestamp, int unfinished) Check if the packet process time shows that the relevant datanode is a slow node.
static StreamSlowMonitor	create(org.apache.hadoop.conf.Configuration conf, String name)
ExcludeDatanodeManager	getExcludeDatanodeManager()
void	onConfigurationChange(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DATANODE_SLOW_PACKET_PROCESS_TIME_KEY

public static final String DATANODE_SLOW_PACKET_PROCESS_TIME_KEY

Configure for the slow packet process time, a duration from send to ACK. The processing time check is for packets that data length smaller than DATANODE_PACKET_FLUSH_CHECK_SPEED_MIN_DATA_LENGTH_KEY

See Also:

Constant Field Values

Constructor Detail

StreamSlowMonitor

public StreamSlowMonitor(org.apache.hadoop.conf.Configuration conf,
                         String name,
                         ExcludeDatanodeManager excludeDatanodeManager)

Method Detail

create

public static StreamSlowMonitor create(org.apache.hadoop.conf.Configuration conf,
                                       String name)

checkProcessTimeAndSpeed

public void checkProcessTimeAndSpeed(org.apache.hadoop.hdfs.protocol.DatanodeInfo datanodeInfo,
                                     long packetDataLen,
                                     long processTimeMs,
                                     long lastAckTimestamp,
                                     int unfinished)

Check if the packet process time shows that the relevant datanode is a slow node.

Parameters:

datanodeInfo - the datanode that processed the packet

packetDataLen - the data length of the packet (in bytes)

processTimeMs - the process time (in ms) of the packet on the datanode,

lastAckTimestamp - the last acked timestamp of the packet on another datanode

unfinished - if the packet is unfinished flushed to the datanode replicas

onConfigurationChange

public void onConfigurationChange(org.apache.hadoop.conf.Configuration conf)

Specified by:

onConfigurationChange in interface ConfigurationObserver

getExcludeDatanodeManager

public ExcludeDatanodeManager getExcludeDatanodeManager()