org.apache.hadoop.hive.ql.io.protobuf

Class ProtobufSerDe

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.ql.io.protobuf.ProtobufSerDe

All Implemented Interfaces:

Deserializer, SerDe, Serializer

Direct Known Subclasses:

ProtobufBytesWritableSerDe, ProtobufMessageSerDe

public abstract class ProtobufSerDe
extends AbstractSerDe

SerDe to convert ProtoWritable messages to Hive formats. The serde supports the following properties:

• proto.class: This is required and specifies the class to be used to read the messages.
• proto.maptypes: This is optional it declares set of protobuf types that have to be converted to map objects instead of struct type. It is applied only on a repeated struct field. The message should have 2 fields, first is used as key and second is used as value.

Field Summary

Fields

Modifier and Type	Field and Description
protected Class<? extends com.google.protobuf.Message>	protoMessageClass

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configuration, log, partitionProperties, properties, tableProperties

Constructor Summary

Constructors

Constructor and Description
ProtobufSerDe()

Method Summary

Modifier and Type	Method and Description
Object	deserialize(org.apache.hadoop.io.Writable blob)
ObjectInspector	getObjectInspector()
void	initialize(org.apache.hadoop.conf.Configuration configuration, Properties tableProperties, Properties partitionProperties)
org.apache.hadoop.io.Writable	serialize(Object obj, ObjectInspector objInspector)
protected abstract com.google.protobuf.Message	toMessage(org.apache.hadoop.io.Writable writable) Convert the given writable to a message.

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getColumnComments, getColumnNames, getColumnTypes, getConfiguration, getPartitionColumnComments, getPartitionColumnNames, getPartitionColumnTypes, getSerDeStats, getSerializedClass, parseColumnComments, parseColumnNames, parseColumnNames, parseColumnTypes, parseColumnTypes, shouldStoreFieldsInMetastore, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.serde2.SerDe

handleJobLevelConfiguration

Field Detail

protoMessageClass

protected Class<? extends com.google.protobuf.Message> protoMessageClass

Constructor Detail

ProtobufSerDe

public ProtobufSerDe()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration configuration,
                       Properties tableProperties,
                       Properties partitionProperties)
                throws SerDeException

Overrides:

initialize in class AbstractSerDe

Throws:

SerDeException

serialize

public org.apache.hadoop.io.Writable serialize(Object obj,
                                               ObjectInspector objInspector)
                                        throws SerDeException

Specified by:

serialize in interface Serializer

Overrides:

serialize in class AbstractSerDe

Throws:

SerDeException

deserialize

public Object deserialize(org.apache.hadoop.io.Writable blob)
                   throws SerDeException

Specified by:

deserialize in interface Deserializer

Overrides:

deserialize in class AbstractSerDe

Throws:

SerDeException

toMessage

protected abstract com.google.protobuf.Message toMessage(org.apache.hadoop.io.Writable writable)
                                                  throws SerDeException

Convert the given writable to a message.

Parameters:

writable - The writable object containing the message.

Returns:

The converted message object.

Throws:

SerDeException

getObjectInspector

public ObjectInspector getObjectInspector()
                                   throws SerDeException

Throws:

SerDeException