com.facebook.presto.hive.rule

Class HiveFilterPushdown

java.lang.Object

com.facebook.presto.hive.rule.HiveFilterPushdown

All Implemented Interfaces:

com.facebook.presto.spi.ConnectorPlanOptimizer

public class HiveFilterPushdown
extends Object
implements com.facebook.presto.spi.ConnectorPlanOptimizer

Runs during both logical and physical phases of connector-aided plan optimization. In most cases filter pushdown will occur during logical phase. However, in cases when new filter is added between logical and physical phases, e.g. a filter on a join key from one side of a join is added to the other side, the new filter will get merged with the one already pushed down.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HiveFilterPushdown.ConnectorPushdownFilterResult

Field Summary

Fields

Modifier and Type	Field and Description
protected com.facebook.presto.spi.function.FunctionMetadataManager	functionMetadataManager
protected com.facebook.presto.spi.function.StandardFunctionResolution	functionResolution
protected HivePartitionManager	partitionManager
protected com.facebook.presto.spi.relation.RowExpressionService	rowExpressionService
protected HiveTransactionManager	transactionManager

Constructor Summary

Constructors

Constructor and Description
HiveFilterPushdown(HiveTransactionManager transactionManager, com.facebook.presto.spi.relation.RowExpressionService rowExpressionService, com.facebook.presto.spi.function.StandardFunctionResolution functionResolution, HivePartitionManager partitionManager, com.facebook.presto.spi.function.FunctionMetadataManager functionMetadataManager)

Method Summary

Modifier and Type	Method and Description
static Set<com.facebook.presto.spi.relation.VariableReferenceExpression>	extractVariableExpressions(com.facebook.presto.spi.relation.RowExpression expression)
protected HiveMetadata	getMetadata(com.facebook.presto.spi.TableHandle tableHandle)
protected boolean	isPushdownFilterSupported(com.facebook.presto.spi.ConnectorSession session, com.facebook.presto.spi.TableHandle tableHandle)
com.facebook.presto.spi.plan.PlanNode	optimize(com.facebook.presto.spi.plan.PlanNode maxSubplan, com.facebook.presto.spi.ConnectorSession session, com.facebook.presto.spi.VariableAllocator variableAllocator, com.facebook.presto.spi.plan.PlanNodeIdAllocator idAllocator)
HiveFilterPushdown.ConnectorPushdownFilterResult	pushdownFilter(com.facebook.presto.spi.ConnectorSession session, com.facebook.presto.spi.connector.ConnectorMetadata metadata, com.facebook.presto.hive.metastore.SemiTransactionalHiveMetastore metastore, com.facebook.presto.spi.ConnectorTableHandle tableHandle, com.facebook.presto.spi.relation.RowExpression filter, Optional<com.facebook.presto.spi.ConnectorTableLayoutHandle> currentLayoutHandle)
protected HiveFilterPushdown.ConnectorPushdownFilterResult	pushdownFilter(com.facebook.presto.spi.ConnectorSession session, HiveMetadata metadata, com.facebook.presto.spi.ConnectorTableHandle tableHandle, com.facebook.presto.spi.relation.RowExpression filter, Optional<com.facebook.presto.spi.ConnectorTableLayoutHandle> currentLayoutHandle)
protected boolean	useDynamicFilter(com.facebook.presto.spi.relation.RowExpression expression, com.facebook.presto.spi.ConnectorTableHandle tableHandle, Map<String,com.facebook.presto.spi.ColumnHandle> columnHandleMap) If this method returns true, the expression will not be pushed inside the TableScan node.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

transactionManager

protected final HiveTransactionManager transactionManager

rowExpressionService

protected final com.facebook.presto.spi.relation.RowExpressionService rowExpressionService

functionResolution

protected final com.facebook.presto.spi.function.StandardFunctionResolution functionResolution

partitionManager

protected final HivePartitionManager partitionManager

functionMetadataManager

protected final com.facebook.presto.spi.function.FunctionMetadataManager functionMetadataManager

Constructor Detail

HiveFilterPushdown

public HiveFilterPushdown(HiveTransactionManager transactionManager,
                          com.facebook.presto.spi.relation.RowExpressionService rowExpressionService,
                          com.facebook.presto.spi.function.StandardFunctionResolution functionResolution,
                          HivePartitionManager partitionManager,
                          com.facebook.presto.spi.function.FunctionMetadataManager functionMetadataManager)

Method Detail

optimize

public com.facebook.presto.spi.plan.PlanNode optimize(com.facebook.presto.spi.plan.PlanNode maxSubplan,
                                                      com.facebook.presto.spi.ConnectorSession session,
                                                      com.facebook.presto.spi.VariableAllocator variableAllocator,
                                                      com.facebook.presto.spi.plan.PlanNodeIdAllocator idAllocator)

Specified by:

optimize in interface com.facebook.presto.spi.ConnectorPlanOptimizer

useDynamicFilter

protected boolean useDynamicFilter(com.facebook.presto.spi.relation.RowExpression expression,
                                   com.facebook.presto.spi.ConnectorTableHandle tableHandle,
                                   Map<String,com.facebook.presto.spi.ColumnHandle> columnHandleMap)

If this method returns true, the expression will not be pushed inside the TableScan node. This is exposed for dynamic or computed column functionality support. Consider the following case: Read a base row from the file. Modify the row to add a new column or update an existing column all inside the TableScan. If filters are pushed down inside the TableScan, it would try to apply it on base row. In these cases, override this method and return true. This will prevent the expression from being pushed into the TableScan but will wrap the TableScanNode in a FilterNode.

Parameters:

expression - expression to be evaluated.

tableHandle - tableHandler where the expression to be evaluated.

columnHandleMap - column name to column handle Map for all columns in the table.

Returns:

true, if this expression should not be pushed inside the table scan, else false.

pushdownFilter

protected HiveFilterPushdown.ConnectorPushdownFilterResult pushdownFilter(com.facebook.presto.spi.ConnectorSession session,
                                                                          HiveMetadata metadata,
                                                                          com.facebook.presto.spi.ConnectorTableHandle tableHandle,
                                                                          com.facebook.presto.spi.relation.RowExpression filter,
                                                                          Optional<com.facebook.presto.spi.ConnectorTableLayoutHandle> currentLayoutHandle)

pushdownFilter

public HiveFilterPushdown.ConnectorPushdownFilterResult pushdownFilter(com.facebook.presto.spi.ConnectorSession session,
                                                                       com.facebook.presto.spi.connector.ConnectorMetadata metadata,
                                                                       com.facebook.presto.hive.metastore.SemiTransactionalHiveMetastore metastore,
                                                                       com.facebook.presto.spi.ConnectorTableHandle tableHandle,
                                                                       com.facebook.presto.spi.relation.RowExpression filter,
                                                                       Optional<com.facebook.presto.spi.ConnectorTableLayoutHandle> currentLayoutHandle)

getMetadata

protected HiveMetadata getMetadata(com.facebook.presto.spi.TableHandle tableHandle)

isPushdownFilterSupported

protected boolean isPushdownFilterSupported(com.facebook.presto.spi.ConnectorSession session,
                                            com.facebook.presto.spi.TableHandle tableHandle)

extractVariableExpressions

public static Set<com.facebook.presto.spi.relation.VariableReferenceExpression> extractVariableExpressions(com.facebook.presto.spi.relation.RowExpression expression)