org.apache.hadoop.hive.serde2.columnar

Class ColumnarSerDe

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.serde2.columnar.ColumnarSerDeBase

org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe

All Implemented Interfaces:

Deserializer, SerDe, Serializer

public class ColumnarSerDe
extends ColumnarSerDeBase

ColumnarSerDe is used for columnar based storage supported by RCFile. ColumnarSerDe differentiate from LazySimpleSerDe in:
(1) ColumnarSerDe uses a ColumnarStruct as its lazy Object
(2) ColumnarSerDe initialize ColumnarStruct's field directly. But under the field level, it works like LazySimpleSerDe

Field Summary

Fields

Modifier and Type	Field and Description
protected LazySerDeParameters	serdeParams

Fields inherited from class org.apache.hadoop.hive.serde2.columnar.ColumnarSerDeBase

cachedObjectInspector, lastOperationDeserialize, lastOperationSerialize, serializedSize, stats

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configuration, log, partitionProperties, properties, tableProperties

Constructor Summary

Constructors

Constructor and Description
ColumnarSerDe()

Method Summary

Modifier and Type	Method and Description
void	initialize(org.apache.hadoop.conf.Configuration configuration, Properties tableProperties, Properties partitionProperties) Initialize the SerDe.
org.apache.hadoop.io.Writable	serialize(Object obj, ObjectInspector objInspector) Serialize a row of data.
String	toString()

Methods inherited from class org.apache.hadoop.hive.serde2.columnar.ColumnarSerDeBase

deserialize, getObjectInspector, getSerDeStats, getSerializedClass, initialize

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getColumnComments, getColumnNames, getColumnTypes, getConfiguration, getPartitionColumnComments, getPartitionColumnNames, getPartitionColumnTypes, parseColumnComments, parseColumnNames, parseColumnNames, parseColumnTypes, parseColumnTypes, shouldStoreFieldsInMetastore

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.serde2.SerDe

handleJobLevelConfiguration

Field Detail

serdeParams

protected LazySerDeParameters serdeParams

Constructor Detail

ColumnarSerDe

public ColumnarSerDe()
              throws SerDeException

Throws:

SerDeException

Method Detail

toString

public String toString()

Overrides:

toString in class AbstractSerDe

initialize

public void initialize(org.apache.hadoop.conf.Configuration configuration,
                       Properties tableProperties,
                       Properties partitionProperties)
                throws SerDeException

Description copied from class: AbstractSerDe

Initialize the SerDe. By default, this will use one set of properties, either the table properties or the partition properties. If a SerDe needs access to both sets, it should override this method. Eventually, once all SerDes have implemented this method, we should convert it to an abstract method.

Overrides:

initialize in class AbstractSerDe

Parameters:

configuration - Hadoop configuration

tableProperties - Table properties

partitionProperties - Partition properties (may be null if table has no partitions)

Throws:

SerDeException - if SerDe fails to initialize

serialize

public org.apache.hadoop.io.Writable serialize(Object obj,
                                               ObjectInspector objInspector)
                                        throws SerDeException

Serialize a row of data.

Specified by:

serialize in interface Serializer

Overrides:

serialize in class AbstractSerDe

Parameters:

obj - The row object

objInspector - The ObjectInspector for the row object

Returns:

The serialized Writable object

Throws:

SerDeException

See Also:

AbstractSerDe.serialize(Object, ObjectInspector)