org.apache.hadoop.hive.ql.io.parquet.vector

Class ParquetDataColumnReaderFactory.TypesFromUInt64PageReader

java.lang.Object

org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.TypesFromInt64PageReader

org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.TypesFromUInt64PageReader

All Implemented Interfaces:

ParquetDataColumnReader

Enclosing class:

ParquetDataColumnReaderFactory

public static class ParquetDataColumnReaderFactory.TypesFromUInt64PageReader
extends ParquetDataColumnReaderFactory.TypesFromInt64PageReader

The reader who reads unsigned long data. The data is read as long from the reader, then validated, converted and returned as per the type defined in HMS. The data is unsigned long hence when read back it can't be negative. The call to validate will indicate that the data is unsigned to do the appropriate validation.

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

dict, hiveDecimalWritable, hivePrecision, hiveScale, length, valuesReader

Constructor Summary

Constructors

Constructor and Description
TypesFromUInt64PageReader(org.apache.parquet.column.Dictionary dict, int length, int precision, int scale)
TypesFromUInt64PageReader(org.apache.parquet.column.values.ValuesReader realReader, int length, int precision, int scale)

Method Summary

Modifier and Type	Method and Description
byte[]	readDecimal()
byte[]	readDecimal(int id)
double	readDouble()
double	readDouble(int id)
float	readFloat()
float	readFloat(int id)
long	readInteger()
long	readInteger(int id)
long	readLong()
long	readLong(int id)
long	readSmallInt()
long	readSmallInt(int id)
long	readTinyInt()
long	readTinyInt(int id)

Methods inherited from class org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.TypesFromInt64PageReader

readChar, readChar, readString, readString, readTimestamp, readTimestamp, readVarchar, readVarchar

Methods inherited from class org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

convertToBytes, enforceMaxLength, getDictionary, getPaddedString, initFromPage, isValid, readBoolean, readBoolean, readBytes, readBytes, readValueDictionaryId, skip

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TypesFromUInt64PageReader

public TypesFromUInt64PageReader(org.apache.parquet.column.values.ValuesReader realReader,
                                 int length,
                                 int precision,
                                 int scale)

TypesFromUInt64PageReader

public TypesFromUInt64PageReader(org.apache.parquet.column.Dictionary dict,
                                 int length,
                                 int precision,
                                 int scale)

Method Detail

readLong

public long readLong()

Specified by:

readLong in interface ParquetDataColumnReader

Overrides:

readLong in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Long from the page

readLong

public long readLong(int id)

Specified by:

readLong in interface ParquetDataColumnReader

Overrides:

readLong in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Long from the dictionary by id

readInteger

public long readInteger()

Specified by:

readInteger in interface ParquetDataColumnReader

Overrides:

readInteger in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Returns:

the next Integer from the page Though the function is looking for an integer, it will return the value through long. The type of data saved as long can be changed to be int or smallint or tinyint. In that case the value returned to the user will depend on the data. If the data value is within the valid range accommodated by the read type, the data will be returned as is. When data is not within the valid range, a NULL will be returned. A long value saved in parquet files will be returned asis to facilitate the validity check. Also, the vectorized representation uses a LongColumnVector to store integer values.

readInteger

public long readInteger(int id)

Specified by:

readInteger in interface ParquetDataColumnReader

Overrides:

readInteger in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Parameters:

id - in dictionary

Returns:

the Integer from the dictionary by id Though the function is looking for an integer, it will return the value through long. The type of data saved as long can be changed to be int or smallint or tinyint. In that case the value returned to the user will depend on the data. If the data value is within the valid range accommodated by the read type, the data will be returned as is. When data is not within the valid range, a NULL will be returned. A long value saved in parquet files will be returned asis to facilitate the validity check. Also, the vectorized representation uses a LongColumnVector to store integer values.

readSmallInt

public long readSmallInt()

Specified by:

readSmallInt in interface ParquetDataColumnReader

Overrides:

readSmallInt in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Returns:

the next SmallInt from the page

readSmallInt

public long readSmallInt(int id)

Specified by:

readSmallInt in interface ParquetDataColumnReader

Overrides:

readSmallInt in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Parameters:

id - in dictionary

Returns:

the Small Int from the dictionary by id

readTinyInt

public long readTinyInt()

Specified by:

readTinyInt in interface ParquetDataColumnReader

Overrides:

readTinyInt in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Returns:

the next TinyInt from the page

readTinyInt

public long readTinyInt(int id)

Specified by:

readTinyInt in interface ParquetDataColumnReader

Overrides:

readTinyInt in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Parameters:

id - in dictionary

Returns:

the tiny int from the dictionary by id

readFloat

public float readFloat()

Specified by:

readFloat in interface ParquetDataColumnReader

Overrides:

readFloat in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Returns:

the next Float from the page

readFloat

public float readFloat(int id)

Specified by:

readFloat in interface ParquetDataColumnReader

Overrides:

readFloat in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Parameters:

id - in dictionary

Returns:

the Float from the dictionary by id

readDouble

public double readDouble()

Specified by:

readDouble in interface ParquetDataColumnReader

Overrides:

readDouble in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Returns:

the next Double from the page

readDouble

public double readDouble(int id)

Specified by:

readDouble in interface ParquetDataColumnReader

Overrides:

readDouble in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Parameters:

id - in dictionary

Returns:

the Double from the dictionary by id

readDecimal

public byte[] readDecimal()

Specified by:

readDecimal in interface ParquetDataColumnReader

Overrides:

readDecimal in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Returns:

the next Decimal from the page

readDecimal

public byte[] readDecimal(int id)

Specified by:

readDecimal in interface ParquetDataColumnReader

Overrides:

readDecimal in class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

Parameters:

id - in dictionary

Returns:

the Decimal from the dictionary by id