org.apache.hadoop.hive.ql.io.parquet.read

Class ParquetRecordReaderWrapper

java.lang.Object

org.apache.hadoop.hive.ql.io.parquet.ParquetRecordReaderBase

org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper

All Implemented Interfaces:

Closeable, AutoCloseable, StatsProvidingRecordReader, org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.ArrayWritable>

public class ParquetRecordReaderWrapper
extends ParquetRecordReaderBase
implements org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.ArrayWritable>, StatsProvidingRecordReader

Field Summary

Fields

Modifier and Type	Field and Description
static org.slf4j.Logger	LOG

Fields inherited from class org.apache.hadoop.hive.ql.io.parquet.ParquetRecordReaderBase

filePath, fileSplit, filteredBlocks, jobConf, legacyConversionEnabled, parquetInputSplit, parquetMetadata, projectionPusher, reader, schemaSize, serDeStats, skipProlepticConversion, skipTimestampConversion

Constructor Summary

Constructors

Constructor and Description
ParquetRecordReaderWrapper(org.apache.parquet.hadoop.ParquetInputFormat<org.apache.hadoop.io.ArrayWritable> newInputFormat, org.apache.hadoop.mapred.InputSplit oldSplit, org.apache.hadoop.mapred.JobConf oldJobConf, org.apache.hadoop.mapred.Reporter reporter)

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.io.NullWritable	createKey()
org.apache.hadoop.io.ArrayWritable	createValue()
long	getPos()
float	getProgress()
boolean	next(org.apache.hadoop.io.NullWritable key, org.apache.hadoop.io.ArrayWritable value)

Methods inherited from class org.apache.hadoop.hive.ql.io.parquet.ParquetRecordReaderBase

getFilteredBlocks, getParquetMetadata, getSplit, getStats, setFilter, setupMetadataAndParquetSplit

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.ql.io.StatsProvidingRecordReader

getStats

Field Detail

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

ParquetRecordReaderWrapper

public ParquetRecordReaderWrapper(org.apache.parquet.hadoop.ParquetInputFormat<org.apache.hadoop.io.ArrayWritable> newInputFormat,
                                  org.apache.hadoop.mapred.InputSplit oldSplit,
                                  org.apache.hadoop.mapred.JobConf oldJobConf,
                                  org.apache.hadoop.mapred.Reporter reporter)
                           throws IOException,
                                  InterruptedException

Throws:

IOException

InterruptedException

Method Detail

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.ArrayWritable>

Throws:

IOException

createKey

public org.apache.hadoop.io.NullWritable createKey()

Specified by:

createKey in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.ArrayWritable>

createValue

public org.apache.hadoop.io.ArrayWritable createValue()

Specified by:

createValue in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.ArrayWritable>

getPos

public long getPos()
            throws IOException

Specified by:

getPos in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.ArrayWritable>

Throws:

IOException

getProgress

public float getProgress()
                  throws IOException

Specified by:

getProgress in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.ArrayWritable>

Throws:

IOException

next

public boolean next(org.apache.hadoop.io.NullWritable key,
                    org.apache.hadoop.io.ArrayWritable value)
             throws IOException

Specified by:

next in interface org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.ArrayWritable>

Throws:

IOException