org.apache.hadoop.metrics2.sink

Class KafkaSink

java.lang.Object

org.apache.hadoop.metrics2.sink.KafkaSink

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.metrics2.MetricsPlugin, org.apache.hadoop.metrics2.MetricsSink

@InterfaceAudience.Public
 @InterfaceStability.Evolving
public class KafkaSink
extends Object
implements org.apache.hadoop.metrics2.MetricsSink, Closeable

A metrics sink that writes to a Kafka broker. This requires you to configure a broker_list and a topic in the metrics2 configuration file. The broker_list must contain a comma-separated list of kafka broker host and ports. The topic will contain only one topic.

Field Summary

Fields

Modifier and Type	Field and Description
static String	BROKER_LIST
static String	TOPIC

Constructor Summary

Constructors

Constructor and Description
KafkaSink()

Method Summary

Modifier and Type	Method and Description
void	close()
void	flush()
void	init(org.apache.commons.configuration2.SubsetConfiguration conf)
void	putMetrics(org.apache.hadoop.metrics2.MetricsRecord record)
void	setProducer(org.apache.kafka.clients.producer.Producer<Integer,byte[]> p)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

BROKER_LIST

public static final String BROKER_LIST

See Also:

Constant Field Values

TOPIC

public static final String TOPIC

See Also:

Constant Field Values

Constructor Detail

KafkaSink

public KafkaSink()

Method Detail

setProducer

public void setProducer(org.apache.kafka.clients.producer.Producer<Integer,byte[]> p)

init

public void init(org.apache.commons.configuration2.SubsetConfiguration conf)

Specified by:

init in interface org.apache.hadoop.metrics2.MetricsPlugin

putMetrics

public void putMetrics(org.apache.hadoop.metrics2.MetricsRecord record)

Specified by:

putMetrics in interface org.apache.hadoop.metrics2.MetricsSink

flush

public void flush()

Specified by:

flush in interface org.apache.hadoop.metrics2.MetricsSink

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException