org.apache.hadoop.hive.ql.io.parquet.vector

Class ParquetDataColumnReaderFactory.TypesFromInt64PageReader

java.lang.Object

org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.TypesFromInt64PageReader

All Implemented Interfaces:

ParquetDataColumnReader

Direct Known Subclasses:

ParquetDataColumnReaderFactory.TypesFromUInt64PageReader

Enclosing class:

ParquetDataColumnReaderFactory

public static class ParquetDataColumnReaderFactory.TypesFromInt64PageReader
extends ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

The reader who reads from the underlying int64 value value. Implementation is in consist with ETypeConverter EINT64_CONVERTER The data is read as long from the reader, then validated, converted and returned as per the type defined in HMS.

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

dict, hiveDecimalWritable, hivePrecision, hiveScale, length, valuesReader

Constructor Summary

Constructors

Constructor and Description
TypesFromInt64PageReader(org.apache.parquet.column.Dictionary dict, int length, boolean isAdjustedToUTC, org.apache.parquet.schema.LogicalTypeAnnotation.TimeUnit timeUnit)
TypesFromInt64PageReader(org.apache.parquet.column.Dictionary dict, int length, int precision, int scale)
TypesFromInt64PageReader(org.apache.parquet.column.values.ValuesReader realReader, int length, boolean isAdjustedToUTC, org.apache.parquet.schema.LogicalTypeAnnotation.TimeUnit timeUnit)
TypesFromInt64PageReader(org.apache.parquet.column.values.ValuesReader realReader, int length, int precision, int scale)

Method Summary

Modifier and Type	Method and Description
byte[]	readChar()
byte[]	readChar(int id)
byte[]	readDecimal()
byte[]	readDecimal(int id)
double	readDouble()
double	readDouble(int id)
float	readFloat()
float	readFloat(int id)
long	readInteger()
long	readInteger(int id)
long	readSmallInt()
long	readSmallInt(int id)
byte[]	readString()
byte[]	readString(int id)
Timestamp	readTimestamp()
Timestamp	readTimestamp(int id)
long	readTinyInt()
long	readTinyInt(int id)
byte[]	readVarchar()
byte[]	readVarchar(int id)

Methods inherited from class org.apache.hadoop.hive.ql.io.parquet.vector.ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

convertToBytes, enforceMaxLength, getDictionary, getPaddedString, initFromPage, isValid, readBoolean, readBoolean, readBytes, readBytes, readLong, readLong, readValueDictionaryId, skip

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TypesFromInt64PageReader

public TypesFromInt64PageReader(org.apache.parquet.column.values.ValuesReader realReader,
                                int length,
                                int precision,
                                int scale)

TypesFromInt64PageReader

public TypesFromInt64PageReader(org.apache.parquet.column.Dictionary dict,
                                int length,
                                int precision,
                                int scale)

TypesFromInt64PageReader

public TypesFromInt64PageReader(org.apache.parquet.column.values.ValuesReader realReader,
                                int length,
                                boolean isAdjustedToUTC,
                                org.apache.parquet.schema.LogicalTypeAnnotation.TimeUnit timeUnit)

TypesFromInt64PageReader

public TypesFromInt64PageReader(org.apache.parquet.column.Dictionary dict,
                                int length,
                                boolean isAdjustedToUTC,
                                org.apache.parquet.schema.LogicalTypeAnnotation.TimeUnit timeUnit)

Method Detail

readInteger

public long readInteger()

Specified by:

readInteger in interface ParquetDataColumnReader

Overrides:

readInteger in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Integer from the page Though the function is looking for an integer, it will return the value through long. The type of data saved as long can be changed to be int or smallint or tinyint. In that case the value returned to the user will depend on the data. If the data value is within the valid range accommodated by the read type, the data will be returned as is. When data is not within the valid range, a NULL will be returned. A long value saved in parquet files will be returned asis to facilitate the validity check. Also, the vectorized representation uses a LongColumnVector to store integer values.

readInteger

public long readInteger(int id)

Specified by:

readInteger in interface ParquetDataColumnReader

Overrides:

readInteger in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Integer from the dictionary by id Though the function is looking for an integer, it will return the value through long. The type of data saved as long can be changed to be int or smallint or tinyint. In that case the value returned to the user will depend on the data. If the data value is within the valid range accommodated by the read type, the data will be returned as is. When data is not within the valid range, a NULL will be returned. A long value saved in parquet files will be returned asis to facilitate the validity check. Also, the vectorized representation uses a LongColumnVector to store integer values.

readSmallInt

public long readSmallInt()

Specified by:

readSmallInt in interface ParquetDataColumnReader

Overrides:

readSmallInt in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next SmallInt from the page

readSmallInt

public long readSmallInt(int id)

Specified by:

readSmallInt in interface ParquetDataColumnReader

Overrides:

readSmallInt in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Small Int from the dictionary by id

readTinyInt

public long readTinyInt()

Specified by:

readTinyInt in interface ParquetDataColumnReader

Overrides:

readTinyInt in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next TinyInt from the page

readTinyInt

public long readTinyInt(int id)

Specified by:

readTinyInt in interface ParquetDataColumnReader

Overrides:

readTinyInt in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the tiny int from the dictionary by id

readFloat

public float readFloat()

Specified by:

readFloat in interface ParquetDataColumnReader

Overrides:

readFloat in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Float from the page

readFloat

public float readFloat(int id)

Specified by:

readFloat in interface ParquetDataColumnReader

Overrides:

readFloat in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Float from the dictionary by id

readDouble

public double readDouble()

Specified by:

readDouble in interface ParquetDataColumnReader

Overrides:

readDouble in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Double from the page

readDouble

public double readDouble(int id)

Specified by:

readDouble in interface ParquetDataColumnReader

Overrides:

readDouble in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Double from the dictionary by id

readDecimal

public byte[] readDecimal()

Specified by:

readDecimal in interface ParquetDataColumnReader

Overrides:

readDecimal in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Decimal from the page

readDecimal

public byte[] readDecimal(int id)

Specified by:

readDecimal in interface ParquetDataColumnReader

Overrides:

readDecimal in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Decimal from the dictionary by id

readString

public byte[] readString()

Specified by:

readString in interface ParquetDataColumnReader

Overrides:

readString in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next String from the page

readString

public byte[] readString(int id)

Specified by:

readString in interface ParquetDataColumnReader

Overrides:

readString in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the String from the dictionary by id

readVarchar

public byte[] readVarchar()

Specified by:

readVarchar in interface ParquetDataColumnReader

Overrides:

readVarchar in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Varchar from the page

readVarchar

public byte[] readVarchar(int id)

Specified by:

readVarchar in interface ParquetDataColumnReader

Overrides:

readVarchar in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Varchar from the dictionary by id

readChar

public byte[] readChar()

Specified by:

readChar in interface ParquetDataColumnReader

Overrides:

readChar in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Char from the page

readChar

public byte[] readChar(int id)

Specified by:

readChar in interface ParquetDataColumnReader

Overrides:

readChar in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Char from the dictionary by id

readTimestamp

public Timestamp readTimestamp(int id)

Specified by:

readTimestamp in interface ParquetDataColumnReader

Overrides:

readTimestamp in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Parameters:

id - in dictionary

Returns:

the Timestamp from the dictionary by id

readTimestamp

public Timestamp readTimestamp()

Specified by:

readTimestamp in interface ParquetDataColumnReader

Overrides:

readTimestamp in class ParquetDataColumnReaderFactory.DefaultParquetDataColumnReader

Returns:

the next Timestamp from the page