org.apache.hadoop.hive.kafka

Class KafkaOutputFormat

java.lang.Object

org.apache.hadoop.hive.kafka.KafkaOutputFormat

All Implemented Interfaces:

HiveOutputFormat<org.apache.hadoop.io.NullWritable,KafkaWritable>, org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.NullWritable,KafkaWritable>

public class KafkaOutputFormat
extends Object
implements HiveOutputFormat<org.apache.hadoop.io.NullWritable,KafkaWritable>

Kafka Hive Output Format class used to write Hive Rows to a Kafka Queue.

Constructor Summary

Constructors

Constructor and Description
KafkaOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.mapred.JobConf jobConf)
FileSinkOperator.RecordWriter	getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc, org.apache.hadoop.fs.Path finalOutPath, Class<? extends org.apache.hadoop.io.Writable> valueClass, boolean isCompressed, Properties tableProperties, org.apache.hadoop.util.Progressable progress)
org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.NullWritable,KafkaWritable>	getRecordWriter(org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.mapred.JobConf jobConf, String s, org.apache.hadoop.util.Progressable progressable)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KafkaOutputFormat

public KafkaOutputFormat()

Method Detail

getHiveRecordWriter

public FileSinkOperator.RecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc,
                                                         org.apache.hadoop.fs.Path finalOutPath,
                                                         Class<? extends org.apache.hadoop.io.Writable> valueClass,
                                                         boolean isCompressed,
                                                         Properties tableProperties,
                                                         org.apache.hadoop.util.Progressable progress)

Specified by:

getHiveRecordWriter in interface HiveOutputFormat<org.apache.hadoop.io.NullWritable,KafkaWritable>

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.NullWritable,KafkaWritable> getRecordWriter(org.apache.hadoop.fs.FileSystem fileSystem,
                                                                                                              org.apache.hadoop.mapred.JobConf jobConf,
                                                                                                              String s,
                                                                                                              org.apache.hadoop.util.Progressable progressable)

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.NullWritable,KafkaWritable>

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem fileSystem,
                             org.apache.hadoop.mapred.JobConf jobConf)

Specified by:

checkOutputSpecs in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.NullWritable,KafkaWritable>