Package io.trino.plugin.hive

Class HivePageSourceProvider

java.lang.Object

io.trino.plugin.hive.HivePageSourceProvider

All Implemented Interfaces:

ConnectorPageSourceProvider

public class HivePageSourceProvider
extends Object
implements ConnectorPageSourceProvider

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	HivePageSourceProvider.BucketAdaptation
static class	HivePageSourceProvider.ColumnMapping
static enum	HivePageSourceProvider.ColumnMappingKind

Constructor Summary

Constructors

Constructor	Description
HivePageSourceProvider(TypeManager typeManager, HdfsEnvironment hdfsEnvironment, HiveConfig hiveConfig, Set<HivePageSourceFactory> pageSourceFactories, Set<HiveRecordCursorProvider> cursorProviders, GenericHiveRecordCursorProvider genericCursorProvider)

Method Summary

Modifier and Type	Method	Description
static Optional<ConnectorPageSource>	createHivePageSource(Set<HivePageSourceFactory> pageSourceFactories, Set<HiveRecordCursorProvider> cursorProviders, org.apache.hadoop.conf.Configuration configuration, ConnectorSession session, Location path, OptionalInt tableBucketNumber, long start, long length, long estimatedFileSize, Properties schema, TupleDomain<HiveColumnHandle> effectivePredicate, List<HiveColumnHandle> columns, TypeManager typeManager, Optional<HiveSplit.BucketConversion> bucketConversion, Optional<HiveSplit.BucketValidation> bucketValidation, boolean s3SelectPushdownEnabled, Optional<AcidInfo> acidInfo, boolean originalFile, AcidTransaction transaction, List<HivePageSourceProvider.ColumnMapping> columnMappings)
ConnectorPageSource	createPageSource(ConnectorTransactionHandle transaction, ConnectorSession session, ConnectorSplit split, ConnectorTableHandle tableHandle, List<ColumnHandle> columns, DynamicFilter dynamicFilter)
static List<Integer>	getProjection(ColumnHandle expected, ColumnHandle read)
static Optional<ReaderColumns>	projectBaseColumns(List<HiveColumnHandle> columns)	Creates a mapping between the input and base columns based on baseHiveColumnIndex if required.
static Optional<ReaderColumns>	projectBaseColumns(List<HiveColumnHandle> columns, boolean useColumnNames)	Creates a mapping between the input and base columns based on baseHiveColumnIndex or baseColumnName if required.
static Optional<ReaderColumns>	projectSufficientColumns(List<HiveColumnHandle> columns)	Creates a set of sufficient columns for the input projected columns and prepares a mapping between the two.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

HivePageSourceProvider

@Inject
public HivePageSourceProvider(TypeManager typeManager,
 HdfsEnvironment hdfsEnvironment,
 HiveConfig hiveConfig,
 Set<HivePageSourceFactory> pageSourceFactories,
 Set<HiveRecordCursorProvider> cursorProviders,
 GenericHiveRecordCursorProvider genericCursorProvider)

Method Details

createPageSource

public ConnectorPageSource createPageSource(ConnectorTransactionHandle transaction,
 ConnectorSession session,
 ConnectorSplit split,
 ConnectorTableHandle tableHandle,
 List<ColumnHandle> columns,
 DynamicFilter dynamicFilter)

Specified by:

createPageSource in interface ConnectorPageSourceProvider

createHivePageSource

public static Optional<ConnectorPageSource> createHivePageSource(Set<HivePageSourceFactory> pageSourceFactories,
 Set<HiveRecordCursorProvider> cursorProviders,
 org.apache.hadoop.conf.Configuration configuration,
 ConnectorSession session,
 Location path,
 OptionalInt tableBucketNumber,
 long start,
 long length,
 long estimatedFileSize,
 Properties schema,
 TupleDomain<HiveColumnHandle> effectivePredicate,
 List<HiveColumnHandle> columns,
 TypeManager typeManager,
 Optional<HiveSplit.BucketConversion> bucketConversion,
 Optional<HiveSplit.BucketValidation> bucketValidation,
 boolean s3SelectPushdownEnabled,
 Optional<AcidInfo> acidInfo,
 boolean originalFile,
 AcidTransaction transaction,
 List<HivePageSourceProvider.ColumnMapping> columnMappings)

getProjection

public static List<Integer> getProjection(ColumnHandle expected,
 ColumnHandle read)

projectBaseColumns

public static Optional<ReaderColumns> projectBaseColumns(List<HiveColumnHandle> columns)

Creates a mapping between the input and base columns based on baseHiveColumnIndex if required.

projectBaseColumns

public static Optional<ReaderColumns> projectBaseColumns(List<HiveColumnHandle> columns,
 boolean useColumnNames)

Creates a mapping between the input and base columns based on baseHiveColumnIndex or baseColumnName if required.

projectSufficientColumns

public static Optional<ReaderColumns> projectSufficientColumns(List<HiveColumnHandle> columns)

Creates a set of sufficient columns for the input projected columns and prepares a mapping between the two. For example, if input include columns "a.b" and "a.b.c", then they will be projected from a single column "a.b".