Package org.apache.iceberg.parquet

Interface VectorizedReader<T>

  • public interface VectorizedReader<T>
    Interface for vectorized Iceberg readers.

    • Method Summary

      All Methods Instance Methods Abstract Methods Default Methods Deprecated Methods 
      Modifier and Type Method Description
      void close()
      Release any resources allocated.
      T read​(T reuse, int numRows)
      Reads a batch of type @param <T> and of size numRows
      void setBatchSize​(int batchSize)  
      default void setRowGroupInfo​(org.apache.parquet.column.page.PageReadStore pages, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,​org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata)
      Sets the row group information to be used with this reader
      void setRowGroupInfo​(org.apache.parquet.column.page.PageReadStore pages, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,​org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata, long rowPosition)
      Deprecated.
      since 1.8.0, will be removed in 1.9.0; use setRowGroupInfo(PageReadStore, Map) instead.

    • Method Detail

      • read

        T read​(T reuse,
       int numRows)
        Reads a batch of type @param <T> and of size numRows
        Parameters:
        reuse - container for the last batch to be reused for next batch
        numRows - number of rows to read
        Returns:
        batch of records of type @param <T>

      • setBatchSize

        void setBatchSize​(int batchSize)

      • setRowGroupInfo

        @Deprecated
void setRowGroupInfo​(org.apache.parquet.column.page.PageReadStore pages,
                     java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,​org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata,
                     long rowPosition)
        Deprecated.
        since 1.8.0, will be removed in 1.9.0; use setRowGroupInfo(PageReadStore, Map) instead.
        Sets the row group information to be used with this reader
        Parameters:
        pages - row group information for all the columns
        metadata - map of ColumnPath -> ColumnChunkMetaData for the row group
        rowPosition - the row group's row offset in the parquet file

      • setRowGroupInfo

        default void setRowGroupInfo​(org.apache.parquet.column.page.PageReadStore pages,
                             java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,​org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata)
        Sets the row group information to be used with this reader
        Parameters:
        pages - row group information for all the columns
        metadata - map of ColumnPath -> ColumnChunkMetaData for the row group

      • close

        void close()
        Release any resources allocated.