org.apache.hadoop.hive.serde2

Class AbstractEncodingAwareSerDe

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.serde2.AbstractEncodingAwareSerDe

All Implemented Interfaces:

Deserializer, SerDe, Serializer

Direct Known Subclasses:

LazySimpleSerDe, MultiDelimitSerDe

public abstract class AbstractEncodingAwareSerDe
extends AbstractSerDe

AbstractEncodingAwareSerDe aware the encoding from table properties, transform data from specified charset to UTF-8 during serialize, and transform data from UTF-8 to specified charset during deserialize.

Field Summary

Fields

Modifier and Type	Field and Description
protected Charset	charset

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configuration, log, partitionProperties, properties, tableProperties

Constructor Summary

Constructors

Constructor and Description
AbstractEncodingAwareSerDe()

Method Summary

Modifier and Type	Method and Description
Object	deserialize(org.apache.hadoop.io.Writable blob) Deserialize an object out of a Writable blob.
protected abstract Object	doDeserialize(org.apache.hadoop.io.Writable blob)
protected abstract org.apache.hadoop.io.Writable	doSerialize(Object obj, ObjectInspector objInspector)
void	initialize(org.apache.hadoop.conf.Configuration configuration, Properties tableProperties, Properties partitionProperties) Initialize the SerDe.
org.apache.hadoop.io.Writable	serialize(Object obj, ObjectInspector objInspector) Serialize an object by navigating inside the Object with the ObjectInspector.
protected abstract org.apache.hadoop.io.Writable	transformFromUTF8(org.apache.hadoop.io.Writable blob) transform Writable data from UTF-8 to charset before serialize.
protected abstract org.apache.hadoop.io.Writable	transformToUTF8(org.apache.hadoop.io.Writable blob) transform Writable data from charset to UTF-8 before doDeserialize.

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getColumnComments, getColumnNames, getColumnTypes, getConfiguration, getPartitionColumnComments, getPartitionColumnNames, getPartitionColumnTypes, getSerDeStats, getSerializedClass, parseColumnComments, parseColumnNames, parseColumnNames, parseColumnTypes, parseColumnTypes, shouldStoreFieldsInMetastore, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.serde2.Deserializer

getObjectInspector

Methods inherited from interface org.apache.hadoop.hive.serde2.SerDe

handleJobLevelConfiguration

Field Detail

charset

protected Charset charset

Constructor Detail

AbstractEncodingAwareSerDe

public AbstractEncodingAwareSerDe()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration configuration,
                       Properties tableProperties,
                       Properties partitionProperties)
                throws SerDeException

Description copied from class: AbstractSerDe

Initialize the SerDe. By default, this will use one set of properties, either the table properties or the partition properties. If a SerDe needs access to both sets, it should override this method. Eventually, once all SerDes have implemented this method, we should convert it to an abstract method.

Overrides:

initialize in class AbstractSerDe

Parameters:

configuration - Hadoop configuration

tableProperties - Table properties

partitionProperties - Partition properties (may be null if table has no partitions)

Throws:

SerDeException - if SerDe fails to initialize

serialize

public final org.apache.hadoop.io.Writable serialize(Object obj,
                                                     ObjectInspector objInspector)
                                              throws SerDeException

Description copied from interface: Serializer

Serialize an object by navigating inside the Object with the ObjectInspector. In most cases, the return value of this function will be constant since the function will reuse the Writable object. If the client wants to keep a copy of the Writable, the client needs to clone the returned value.

Specified by:

serialize in interface Serializer

Overrides:

serialize in class AbstractSerDe

Throws:

SerDeException

transformFromUTF8

protected abstract org.apache.hadoop.io.Writable transformFromUTF8(org.apache.hadoop.io.Writable blob)

transform Writable data from UTF-8 to charset before serialize.

Parameters:

blob -

Returns:

doSerialize

protected abstract org.apache.hadoop.io.Writable doSerialize(Object obj,
                                                             ObjectInspector objInspector)
                                                      throws SerDeException

Throws:

SerDeException

deserialize

public final Object deserialize(org.apache.hadoop.io.Writable blob)
                         throws SerDeException

Description copied from interface: Deserializer

Deserialize an object out of a Writable blob. In most cases, the return value of this function will be constant since the function will reuse the returned object. If the client wants to keep a copy of the object, the client needs to clone the returned deserialized value by calling ObjectInspectorUtils.getStandardObject().

Specified by:

deserialize in interface Deserializer

Overrides:

deserialize in class AbstractSerDe

Parameters:

blob - The Writable object containing a serialized object

Returns:

A Java object representing the contents in the blob.

Throws:

SerDeException

transformToUTF8

protected abstract org.apache.hadoop.io.Writable transformToUTF8(org.apache.hadoop.io.Writable blob)

transform Writable data from charset to UTF-8 before doDeserialize.

Parameters:

blob -

Returns:

doDeserialize

protected abstract Object doDeserialize(org.apache.hadoop.io.Writable blob)
                                 throws SerDeException

Throws:

SerDeException