Package io.trino.parquet.reader

Class ChunkedInputStream

java.lang.Object

java.io.InputStream

io.trino.parquet.reader.ChunkedInputStream

All Implemented Interfaces:

Closeable, AutoCloseable

public final class ChunkedInputStream
extends InputStream

A single continuous InputStream over multiple Slices read on demand using given collection of ChunkReaders. It is used to read parquet column chunk in limited (small) byte chunks (8MB by default, controlled by ParquetReaderOptions.getMaxReadBlockSize()). Column chunks consists of multiple pages. This abstraction is used because the page size is unknown until the page header is read and page header and page data can be split between two or more byte chunks.

Constructor Summary

Constructors

Constructor	Description
ChunkedInputStream(Collection<? extends ChunkReader> chunks)

Method Summary

Modifier and Type	Method	Description
int	available()
void	close()
io.airlift.slice.Slice	getSlice(int length)
int	read()
int	read(byte[] b, int off, int len)

Methods inherited from class java.io.InputStream

mark, markSupported, nullInputStream, read, readAllBytes, readNBytes, readNBytes, reset, skip, skipNBytes, transferTo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ChunkedInputStream

public ChunkedInputStream(Collection<? extends ChunkReader> chunks)

Method Details

getSlice

public io.airlift.slice.Slice getSlice(int length)
                                throws IOException

Throws:

IOException

read

public int read(byte[] b,
 int off,
 int len)
         throws IOException

Overrides:

read in class InputStream

Throws:

IOException

read

public int read()
         throws IOException

Specified by:

read in class InputStream

Throws:

IOException

available

public int available()
              throws IOException

Overrides:

available in class InputStream

Throws:

IOException

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Overrides:

close in class InputStream