org.apache.hadoop.hive.ql.io.parquet.serde

Class ParquetHiveSerDe

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe

All Implemented Interfaces:

Deserializer, SchemaInference, SerDe, Serializer

public class ParquetHiveSerDe
extends AbstractSerDe
implements SchemaInference

A ParquetHiveSerDe for Hive (with the deprecated package mapred). Parquet format and stats is collected in ParquetRecordWriterWrapper when writer gets closed.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.hadoop.io.Text	ARRAY
static org.apache.hadoop.io.Text	LIST
static org.apache.hadoop.io.Text	MAP
static org.apache.hadoop.io.Text	MAP_KEY
static org.apache.hadoop.io.Text	MAP_VALUE
static int[]	PRECISION_TO_BYTE_COUNT

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configuration, log, partitionProperties, properties, tableProperties

Constructor Summary

Constructors

Constructor and Description
ParquetHiveSerDe()

Method Summary

Modifier and Type	Method and Description
Object	deserialize(org.apache.hadoop.io.Writable blob)
ObjectInspector	getObjectInspector()
Class<? extends org.apache.hadoop.io.Writable>	getSerializedClass()
void	initialize(org.apache.hadoop.conf.Configuration configuration, Properties tableProperties, Properties partitionProperties)
static boolean	isParquetTable(Table table)
List<org.apache.hadoop.hive.metastore.api.FieldSchema>	readSchema(org.apache.hadoop.conf.Configuration conf, String file)
org.apache.hadoop.io.Writable	serialize(Object obj, ObjectInspector objInspector)

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getColumnComments, getColumnNames, getColumnTypes, getConfiguration, getPartitionColumnComments, getPartitionColumnNames, getPartitionColumnTypes, getSerDeStats, parseColumnComments, parseColumnNames, parseColumnNames, parseColumnTypes, parseColumnTypes, shouldStoreFieldsInMetastore, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.serde2.SerDe

handleJobLevelConfiguration

Field Detail

MAP_KEY

public static final org.apache.hadoop.io.Text MAP_KEY

MAP_VALUE

public static final org.apache.hadoop.io.Text MAP_VALUE

MAP

public static final org.apache.hadoop.io.Text MAP

ARRAY

public static final org.apache.hadoop.io.Text ARRAY

LIST

public static final org.apache.hadoop.io.Text LIST

PRECISION_TO_BYTE_COUNT

public static final int[] PRECISION_TO_BYTE_COUNT

Constructor Detail

ParquetHiveSerDe

public ParquetHiveSerDe()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration configuration,
                       Properties tableProperties,
                       Properties partitionProperties)
                throws SerDeException

Overrides:

initialize in class AbstractSerDe

Throws:

SerDeException

deserialize

public Object deserialize(org.apache.hadoop.io.Writable blob)
                   throws SerDeException

Specified by:

deserialize in interface Deserializer

Overrides:

deserialize in class AbstractSerDe

Throws:

SerDeException

getObjectInspector

public ObjectInspector getObjectInspector()
                                   throws SerDeException

Specified by:

getObjectInspector in interface Deserializer

Throws:

SerDeException

getSerializedClass

public Class<? extends org.apache.hadoop.io.Writable> getSerializedClass()

Specified by:

getSerializedClass in interface Serializer

Specified by:

getSerializedClass in class AbstractSerDe

serialize

public org.apache.hadoop.io.Writable serialize(Object obj,
                                               ObjectInspector objInspector)
                                        throws SerDeException

Specified by:

serialize in interface Serializer

Overrides:

serialize in class AbstractSerDe

Throws:

SerDeException

isParquetTable

public static boolean isParquetTable(Table table)

Parameters:

table -

Returns:

true if the table has the parquet serde defined

readSchema

public List<org.apache.hadoop.hive.metastore.api.FieldSchema> readSchema(org.apache.hadoop.conf.Configuration conf,
                                                                         String file)
                                                                  throws SerDeException

Specified by:

readSchema in interface SchemaInference

Throws:

SerDeException