org.apache.hadoop.hive.serde2.teradata

Class TeradataBinarySerde

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.serde2.teradata.TeradataBinarySerde

All Implemented Interfaces:

Deserializer, SerDe, Serializer

public class TeradataBinarySerde
extends AbstractSerDe

https://cwiki.apache.org/confluence/display/Hive/TeradataBinarySerde. TeradataBinarySerde handles the serialization and deserialization of Teradata Binary Record passed from TeradataBinaryRecordReader. The Teradata Binary Record uses little-endian to handle the SHORT, INT, LONG, DOUBLE... We extend SwappedDataInputStream to handle these types and extend to handle the Teradata specific types like VARCHAR, CHAR, TIMESTAMP, DATE... Currently we support 11 Teradata data types: VARCHAR ,INTEGER, TIMESTAMP, FLOAT, DATE, BYTEINT, BIGINT, CHARACTER, DECIMAL, SMALLINT, VARBYTE. The mapping between Teradata data type and Hive data type is Teradata Data Type: Hive Data Type VARCHAR: VARCHAR, INTEGER: INT, TIMESTAMP: TIMESTAMP, FLOAT: DOUBLE, DATE: DATE, BYTEINT: TINYINT , BIGINT: BIGINT, CHAR: CHAR, DECIMAL: DECIMAL, SMALLINT: SMALLINT, VARBYTE: BINARY. TeradataBinarySerde currently doesn't support complex types like MAP, ARRAY and STRUCT.

Field Summary

Fields

Modifier and Type	Field and Description
static String	TD_CHAR_SET
static String	TD_SCHEMA_LITERAL
static String	TD_TIMESTAMP_PRECISION

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configuration, log, partitionProperties, properties, tableProperties

Constructor Summary

Constructors

Constructor and Description
TeradataBinarySerde()

Method Summary

Modifier and Type	Method and Description
Object	deserialize(org.apache.hadoop.io.Writable blob) Deserialize an object out of a Writable blob.
ObjectInspector	getObjectInspector() Get the object inspector that can be used to navigate through the internal structure of the Object returned from deserialize(...).
Class<? extends org.apache.hadoop.io.Writable>	getSerializedClass() Returns the Writable class that would be returned by the serialize method.
void	initialize(org.apache.hadoop.conf.Configuration configuration, Properties tableProperties, Properties partitionProperties) Initialize the SerDe.
org.apache.hadoop.io.Writable	serialize(Object obj, ObjectInspector objInspector) Serialize an object by navigating inside the Object with the ObjectInspector.

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getColumnComments, getColumnNames, getColumnTypes, getConfiguration, getPartitionColumnComments, getPartitionColumnNames, getPartitionColumnTypes, getSerDeStats, parseColumnComments, parseColumnNames, parseColumnNames, parseColumnTypes, parseColumnTypes, shouldStoreFieldsInMetastore, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.serde2.SerDe

handleJobLevelConfiguration

Field Detail

TD_SCHEMA_LITERAL

public static final String TD_SCHEMA_LITERAL

See Also:

Constant Field Values

TD_TIMESTAMP_PRECISION

public static final String TD_TIMESTAMP_PRECISION

See Also:

Constant Field Values

TD_CHAR_SET

public static final String TD_CHAR_SET

See Also:

Constant Field Values

Constructor Detail

TeradataBinarySerde

public TeradataBinarySerde()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration configuration,
                       Properties tableProperties,
                       Properties partitionProperties)
                throws SerDeException

Description copied from class: AbstractSerDe

Initialize the SerDe. By default, this will use one set of properties, either the table properties or the partition properties. If a SerDe needs access to both sets, it should override this method. Eventually, once all SerDes have implemented this method, we should convert it to an abstract method.

Overrides:

initialize in class AbstractSerDe

Parameters:

configuration - Hadoop configuration

tableProperties - Table properties

partitionProperties - Partition properties (may be null if table has no partitions)

Throws:

SerDeException - if SerDe fails to initialize

getSerializedClass

public Class<? extends org.apache.hadoop.io.Writable> getSerializedClass()

Returns the Writable class that would be returned by the serialize method. This is used to initialize SequenceFile header.

Specified by:

getSerializedClass in interface Serializer

Specified by:

getSerializedClass in class AbstractSerDe

serialize

public org.apache.hadoop.io.Writable serialize(Object obj,
                                               ObjectInspector objInspector)
                                        throws SerDeException

Serialize an object by navigating inside the Object with the ObjectInspector. In most cases, the return value of this function will be constant since the function will reuse the Writable object. If the client wants to keep a copy of the Writable, the client needs to clone the returned value.

Specified by:

serialize in interface Serializer

Overrides:

serialize in class AbstractSerDe

Parameters:

obj -

objInspector -

Throws:

SerDeException

deserialize

public Object deserialize(org.apache.hadoop.io.Writable blob)
                   throws SerDeException

Deserialize an object out of a Writable blob. In most cases, the return value of this function will be constant since the function will reuse the returned object. If the client wants to keep a copy of the object, the client needs to clone the returned value by calling ObjectInspectorUtils.getStandardObject().

Specified by:

deserialize in interface Deserializer

Overrides:

deserialize in class AbstractSerDe

Parameters:

blob - The Writable object containing a serialized object

Returns:

A Java object representing the contents in the blob.

Throws:

SerDeException

getObjectInspector

public ObjectInspector getObjectInspector()
                                   throws SerDeException

Get the object inspector that can be used to navigate through the internal structure of the Object returned from deserialize(...).

Throws:

SerDeException