org.apache.hadoop.hive.ql.io.parquet.vector

Class ParquetDataColumnReaderFactory.TypesFromDoublePageReader

java.lang.Object

org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.TypesFromDoublePageReader

All Implemented Interfaces:

ParquetDataColumnReader

Enclosing class:

ParquetDataColumnReaderFactory

public static class ParquetDataColumnReaderFactory.TypesFromDoublePageReader
extends ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

The reader who reads from the underlying double value value. The data is read as double from the reader, then validated, converted and returned as per the type defined in HMS.

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

dict, hiveDecimalWritable, hivePrecision, hiveScale, length, valuesReader

Constructor Summary

Constructors

Constructor and Description
TypesFromDoublePageReader(org.apache.parquet.column.Dictionary dict, int length, int precision, int scale)
TypesFromDoublePageReader(org.apache.parquet.column.values.ValuesReader realReader, int length, int precision, int scale)

Method Summary

Modifier and Type	Method and Description
byte[]	readChar()
byte[]	readChar(int id)
byte[]	readDecimal()
byte[]	readDecimal(int id)
float	readFloat()
float	readFloat(int id)
long	readInteger()
long	readInteger(int id)
long	readLong()
long	readLong(int id)
long	readSmallInt()
long	readSmallInt(int id)
byte[]	readString()
byte[]	readString(int id)
long	readTinyInt()
long	readTinyInt(int id)
byte[]	readVarchar()
byte[]	readVarchar(int id)

Methods inherited from class org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

convertToBytes, enforceMaxLength, getDictionary, getPaddedString, initFromPage, isValid, readBoolean, readBoolean, readBytes, readBytes, readDouble, readDouble, readTimestamp, readTimestamp, readValueDictionaryId, skip

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TypesFromDoublePageReader

public TypesFromDoublePageReader(org.apache.parquet.column.values.ValuesReader realReader,
                                 int length,
                                 int precision,
                                 int scale)

TypesFromDoublePageReader

public TypesFromDoublePageReader(org.apache.parquet.column.Dictionary dict,
                                 int length,
                                 int precision,
                                 int scale)

Method Detail

readString

public byte[] readString()

Specified by:

readString in interface ParquetDataColumnReader

Overrides:

readString in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next String from the page

readString

public byte[] readString(int id)

Specified by:

readString in interface ParquetDataColumnReader

Overrides:

readString in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the String from the dictionary by id

readVarchar

public byte[] readVarchar()

Specified by:

readVarchar in interface ParquetDataColumnReader

Overrides:

readVarchar in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Varchar from the page

readVarchar

public byte[] readVarchar(int id)

Specified by:

readVarchar in interface ParquetDataColumnReader

Overrides:

readVarchar in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Varchar from the dictionary by id

readChar

public byte[] readChar()

Specified by:

readChar in interface ParquetDataColumnReader

Overrides:

readChar in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Char from the page

readChar

public byte[] readChar(int id)

Specified by:

readChar in interface ParquetDataColumnReader

Overrides:

readChar in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Char from the dictionary by id

readLong

public long readLong()

Specified by:

readLong in interface ParquetDataColumnReader

Overrides:

readLong in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Long from the page

readLong

public long readLong(int id)

Specified by:

readLong in interface ParquetDataColumnReader

Overrides:

readLong in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Long from the dictionary by id

readInteger

public long readInteger()

Specified by:

readInteger in interface ParquetDataColumnReader

Overrides:

readInteger in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Integer from the page Though the function is looking for an integer, it will return the value through long. The type of data saved as long can be changed to be int or smallint or tinyint. In that case the value returned to the user will depend on the data. If the data value is within the valid range accommodated by the read type, the data will be returned as is. When data is not within the valid range, a NULL will be returned. A long value saved in parquet files will be returned asis to facilitate the validity check. Also, the vectorized representation uses a LongColumnVector to store integer values.

readInteger

public long readInteger(int id)

Specified by:

readInteger in interface ParquetDataColumnReader

Overrides:

readInteger in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Integer from the dictionary by id Though the function is looking for an integer, it will return the value through long. The type of data saved as long can be changed to be int or smallint or tinyint. In that case the value returned to the user will depend on the data. If the data value is within the valid range accommodated by the read type, the data will be returned as is. When data is not within the valid range, a NULL will be returned. A long value saved in parquet files will be returned asis to facilitate the validity check. Also, the vectorized representation uses a LongColumnVector to store integer values.

readSmallInt

public long readSmallInt()

Specified by:

readSmallInt in interface ParquetDataColumnReader

Overrides:

readSmallInt in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next SmallInt from the page

readSmallInt

public long readSmallInt(int id)

Specified by:

readSmallInt in interface ParquetDataColumnReader

Overrides:

readSmallInt in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Small Int from the dictionary by id

readTinyInt

public long readTinyInt()

Specified by:

readTinyInt in interface ParquetDataColumnReader

Overrides:

readTinyInt in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next TinyInt from the page

readTinyInt

public long readTinyInt(int id)

Specified by:

readTinyInt in interface ParquetDataColumnReader

Overrides:

readTinyInt in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the tiny int from the dictionary by id

readFloat

public float readFloat()

Specified by:

readFloat in interface ParquetDataColumnReader

Overrides:

readFloat in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Float from the page

readFloat

public float readFloat(int id)

Specified by:

readFloat in interface ParquetDataColumnReader

Overrides:

readFloat in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Float from the dictionary by id

readDecimal

public byte[] readDecimal()

Specified by:

readDecimal in interface ParquetDataColumnReader

Overrides:

readDecimal in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Decimal from the page

readDecimal

public byte[] readDecimal(int id)

Specified by:

readDecimal in interface ParquetDataColumnReader

Overrides:

readDecimal in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Decimal from the dictionary by id