org.apache.hadoop.hive.serde2.lazybinary

Class LazyBinarySerDe2

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe

org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe2

All Implemented Interfaces:

Deserializer, SerDe, Serializer

public class LazyBinarySerDe2
extends LazyBinarySerDe

Subclass of LazyBinarySerDe with faster serialization, initializing a serializer based on the row columns rather than checking the ObjectInspector category/primitiveType for every value. This appears to be around 3x faster than the LazyBinarySerDe serialization.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe

LazyBinarySerDe.BooleanRef, LazyBinarySerDe.StringWrapper

Field Summary

Fields inherited from class org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe

LOG

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configuration, log, partitionProperties, properties, tableProperties

Constructor Summary

Constructors

Constructor and Description
LazyBinarySerDe2()

Method Summary

Modifier and Type	Method and Description
void	initialize(org.apache.hadoop.conf.Configuration configuration, Properties tableProperties, Properties partitionProperties) Initialize the SerDe with configuration and table information.
org.apache.hadoop.io.Writable	serialize(Object obj, ObjectInspector objInspector) Serialize an object to a byte buffer in a binary compact way.

Methods inherited from class org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe

deserialize, getObjectInspector, getSerDeStats, getSerializedClass, serialize, serializeStruct, serializeText, setFromBigIntegerBytesAndScale, writeDateToByteStream, writeSizeAtOffset, writeToByteStream, writeToByteStream, writeToByteStream, writeToByteStream

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getColumnComments, getColumnNames, getColumnTypes, getConfiguration, getPartitionColumnComments, getPartitionColumnNames, getPartitionColumnTypes, parseColumnComments, parseColumnNames, parseColumnNames, parseColumnTypes, parseColumnTypes, shouldStoreFieldsInMetastore, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.serde2.SerDe

handleJobLevelConfiguration

Constructor Detail

LazyBinarySerDe2

public LazyBinarySerDe2()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration configuration,
                       Properties tableProperties,
                       Properties partitionProperties)
                throws SerDeException

Description copied from class: LazyBinarySerDe

Initialize the SerDe with configuration and table information.

Overrides:

initialize in class LazyBinarySerDe

Parameters:

configuration - Hadoop configuration

tableProperties - Table properties

partitionProperties - Partition properties (may be null if table has no partitions)

Throws:

SerDeException - if SerDe fails to initialize

serialize

public org.apache.hadoop.io.Writable serialize(Object obj,
                                               ObjectInspector objInspector)
                                        throws SerDeException

Description copied from class: LazyBinarySerDe

Serialize an object to a byte buffer in a binary compact way.

Specified by:

serialize in interface Serializer

Overrides:

serialize in class LazyBinarySerDe

Throws:

SerDeException