org.apache.hadoop.hive.ql.io.orc.encoded

Interface LlapDataReader

All Superinterfaces:

AutoCloseable, Cloneable

public interface LlapDataReader
extends AutoCloseable, Cloneable

An abstract data reader that IO formats can use to read bytes from underlying storage.

Method Summary

Modifier and Type	Method and Description
LlapDataReader	clone() Clone the entire state of the DataReader with the assumption that the clone will be closed at a different time.
void	close()
org.apache.orc.CompressionCodec	getCompressionCodec() Returns the compression codec used by this datareader.
boolean	isTrackingDiskRanges() Whether the user should release buffers created by readFileData.
void	open() Opens the DataReader, making it ready to use.
DiskRangeList	readFileData(DiskRangeList range, long baseOffset, boolean doForceDirect) Reads the data.
org.apache.orc.impl.OrcIndex	readRowIndex(org.apache.orc.StripeInformation stripe, org.apache.orc.TypeDescription fileSchema, org.apache.orc.OrcProto.StripeFooter footer, boolean ignoreNonUtf8BloomFilter, boolean[] included, org.apache.orc.OrcProto.RowIndex[] indexes, boolean[] sargColumns, org.apache.orc.OrcFile.WriterVersion version, org.apache.orc.OrcProto.Stream.Kind[] bloomFilterKinds, org.apache.orc.OrcProto.BloomFilterIndex[] bloomFilterIndices)
org.apache.orc.OrcProto.StripeFooter	readStripeFooter(org.apache.orc.StripeInformation stripe)
void	releaseBuffer(ByteBuffer toRelease) Releases buffers created by readFileData.

Method Detail

open

void open()
   throws IOException

Opens the DataReader, making it ready to use.

Throws:

IOException

readRowIndex

org.apache.orc.impl.OrcIndex readRowIndex(org.apache.orc.StripeInformation stripe,
                                          org.apache.orc.TypeDescription fileSchema,
                                          org.apache.orc.OrcProto.StripeFooter footer,
                                          boolean ignoreNonUtf8BloomFilter,
                                          boolean[] included,
                                          org.apache.orc.OrcProto.RowIndex[] indexes,
                                          boolean[] sargColumns,
                                          org.apache.orc.OrcFile.WriterVersion version,
                                          org.apache.orc.OrcProto.Stream.Kind[] bloomFilterKinds,
                                          org.apache.orc.OrcProto.BloomFilterIndex[] bloomFilterIndices)
                                   throws IOException

Throws:

IOException

readStripeFooter

org.apache.orc.OrcProto.StripeFooter readStripeFooter(org.apache.orc.StripeInformation stripe)
                                               throws IOException

Throws:

IOException

readFileData

DiskRangeList readFileData(DiskRangeList range,
                           long baseOffset,
                           boolean doForceDirect)
                    throws IOException

Reads the data. Note that for the cases such as zero-copy read, caller must release the disk ranges produced after being done with them. Call isTrackingDiskRanges to find out if this is needed.

Parameters:

range - List if disk ranges to read. Ranges with data will be ignored.

baseOffset - Base offset from the start of the file of the ranges in disk range list.

doForceDirect - Whether the data should be read into direct buffers.

Returns:

New or modified list of DiskRange-s, where all the ranges are filled with data.

Throws:

IOException

isTrackingDiskRanges

boolean isTrackingDiskRanges()

Whether the user should release buffers created by readFileData. See readFileData javadoc.

releaseBuffer

void releaseBuffer(ByteBuffer toRelease)

Releases buffers created by readFileData. See readFileData javadoc.

Parameters:

toRelease - The buffer to release.

clone

LlapDataReader clone()

Clone the entire state of the DataReader with the assumption that the clone will be closed at a different time. Thus, any file handles in the implementation need to be cloned.

Returns:

a new instance

close

void close()
    throws IOException

Specified by:

close in interface AutoCloseable

Throws:

IOException

getCompressionCodec

org.apache.orc.CompressionCodec getCompressionCodec()

Returns the compression codec used by this datareader. We should consider removing this from the interface.

Returns:

the compression codec