io.prestosql.plugin.hive.parquet

Class ParquetPageSourceFactory

java.lang.Object

io.prestosql.plugin.hive.parquet.ParquetPageSourceFactory

All Implemented Interfaces:

HivePageSourceFactory

public class ParquetPageSourceFactory
extends Object
implements HivePageSourceFactory

Nested Class Summary

Nested classes/interfaces inherited from interface io.prestosql.plugin.hive.HivePageSourceFactory

HivePageSourceFactory.ReaderPageSourceWithProjections

Constructor Summary

Constructors

Constructor and Description
ParquetPageSourceFactory(HdfsEnvironment hdfsEnvironment, FileFormatDataSourceStats stats, ParquetReaderConfig config)

Method Summary

Modifier and Type	Method and Description
Optional<HivePageSourceFactory.ReaderPageSourceWithProjections>	createPageSource(org.apache.hadoop.conf.Configuration configuration, ConnectorSession session, org.apache.hadoop.fs.Path path, long start, long length, long fileSize, Properties schema, List<HiveColumnHandle> columns, TupleDomain<HiveColumnHandle> effectivePredicate, org.joda.time.DateTimeZone hiveStorageTimeZone, Optional<DeleteDeltaLocations> deleteDeltaLocations)
static HivePageSourceFactory.ReaderPageSourceWithProjections	createPageSource(org.apache.hadoop.fs.Path path, long start, long length, long fileSize, List<HiveColumnHandle> columns, TupleDomain<HiveColumnHandle> effectivePredicate, boolean useColumnNames, HdfsEnvironment hdfsEnvironment, org.apache.hadoop.conf.Configuration configuration, String user, FileFormatDataSourceStats stats, ParquetReaderOptions options) This method is available for other callers to use directly.
static Optional<org.apache.parquet.schema.Type>	getColumnType(HiveColumnHandle column, org.apache.parquet.schema.MessageType messageType, boolean useParquetColumnNames)
static TupleDomain<org.apache.parquet.column.ColumnDescriptor>	getParquetTupleDomain(Map<List<String>,RichColumnDescriptor> descriptorsByPath, TupleDomain<HiveColumnHandle> effectivePredicate)
static Optional<org.apache.parquet.schema.Type>	getParquetType(org.apache.parquet.schema.GroupType groupType, boolean useParquetColumnNames, HiveColumnHandle column)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetPageSourceFactory

@Inject
public ParquetPageSourceFactory(HdfsEnvironment hdfsEnvironment,
                                        FileFormatDataSourceStats stats,
                                        ParquetReaderConfig config)

Method Detail

createPageSource

public Optional<HivePageSourceFactory.ReaderPageSourceWithProjections> createPageSource(org.apache.hadoop.conf.Configuration configuration,
                                                                                        ConnectorSession session,
                                                                                        org.apache.hadoop.fs.Path path,
                                                                                        long start,
                                                                                        long length,
                                                                                        long fileSize,
                                                                                        Properties schema,
                                                                                        List<HiveColumnHandle> columns,
                                                                                        TupleDomain<HiveColumnHandle> effectivePredicate,
                                                                                        org.joda.time.DateTimeZone hiveStorageTimeZone,
                                                                                        Optional<DeleteDeltaLocations> deleteDeltaLocations)

Specified by:

createPageSource in interface HivePageSourceFactory

createPageSource

public static HivePageSourceFactory.ReaderPageSourceWithProjections createPageSource(org.apache.hadoop.fs.Path path,
                                                                                     long start,
                                                                                     long length,
                                                                                     long fileSize,
                                                                                     List<HiveColumnHandle> columns,
                                                                                     TupleDomain<HiveColumnHandle> effectivePredicate,
                                                                                     boolean useColumnNames,
                                                                                     HdfsEnvironment hdfsEnvironment,
                                                                                     org.apache.hadoop.conf.Configuration configuration,
                                                                                     String user,
                                                                                     FileFormatDataSourceStats stats,
                                                                                     ParquetReaderOptions options)

This method is available for other callers to use directly.

getParquetType

public static Optional<org.apache.parquet.schema.Type> getParquetType(org.apache.parquet.schema.GroupType groupType,
                                                                      boolean useParquetColumnNames,
                                                                      HiveColumnHandle column)

getColumnType

public static Optional<org.apache.parquet.schema.Type> getColumnType(HiveColumnHandle column,
                                                                     org.apache.parquet.schema.MessageType messageType,
                                                                     boolean useParquetColumnNames)

getParquetTupleDomain

public static TupleDomain<org.apache.parquet.column.ColumnDescriptor> getParquetTupleDomain(Map<List<String>,RichColumnDescriptor> descriptorsByPath,
                                                                                            TupleDomain<HiveColumnHandle> effectivePredicate)