io.prestosql.plugin.hive

Class HiveSplitManager

java.lang.Object

io.prestosql.plugin.hive.HiveSplitManager

All Implemented Interfaces:

ConnectorSplitManager

public class HiveSplitManager
extends Object
implements ConnectorSplitManager

Nested Class Summary

Nested classes/interfaces inherited from interface io.prestosql.spi.connector.ConnectorSplitManager

ConnectorSplitManager.SplitSchedulingStrategy

Field Summary

Fields

Modifier and Type	Field and Description
static String	OBJECT_NOT_READABLE
static String	PRESTO_OFFLINE

Constructor Summary

Constructors

Constructor and Description
HiveSplitManager(Function<HiveTransactionHandle,SemiTransactionalHiveMetastore> metastoreProvider, NamenodeStats namenodeStats, HdfsEnvironment hdfsEnvironment, DirectoryLister directoryLister, Executor executor, CoercionPolicy coercionPolicy, io.airlift.stats.CounterStat highMemorySplitSourceCounter, int maxOutstandingSplits, io.airlift.units.DataSize maxOutstandingSplitsSize, int minPartitionBatchSize, int maxPartitionBatchSize, int maxInitialSplits, int splitLoaderConcurrency, boolean recursiveDfsWalkerEnabled)
HiveSplitManager(HiveConfig hiveConfig, Function<HiveTransactionHandle,SemiTransactionalHiveMetastore> metastoreProvider, NamenodeStats namenodeStats, HdfsEnvironment hdfsEnvironment, DirectoryLister directoryLister, ExecutorService executorService, CoercionPolicy coercionPolicy)

Method Summary

Modifier and Type	Method and Description
io.airlift.stats.CounterStat	getHighMemorySplitSource()
ConnectorSplitSource	getSplits(ConnectorTransactionHandle transaction, ConnectorSession session, ConnectorTableLayoutHandle layoutHandle, ConnectorSplitManager.SplitSchedulingStrategy splitSchedulingStrategy)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.prestosql.spi.connector.ConnectorSplitManager

getSplits

Field Detail

PRESTO_OFFLINE

public static final String PRESTO_OFFLINE

See Also:

Constant Field Values

OBJECT_NOT_READABLE

public static final String OBJECT_NOT_READABLE

See Also:

Constant Field Values

Constructor Detail

HiveSplitManager

@Inject
public HiveSplitManager(HiveConfig hiveConfig,
                                Function<HiveTransactionHandle,SemiTransactionalHiveMetastore> metastoreProvider,
                                NamenodeStats namenodeStats,
                                HdfsEnvironment hdfsEnvironment,
                                DirectoryLister directoryLister,
                                ExecutorService executorService,
                                CoercionPolicy coercionPolicy)

HiveSplitManager

public HiveSplitManager(Function<HiveTransactionHandle,SemiTransactionalHiveMetastore> metastoreProvider,
                        NamenodeStats namenodeStats,
                        HdfsEnvironment hdfsEnvironment,
                        DirectoryLister directoryLister,
                        Executor executor,
                        CoercionPolicy coercionPolicy,
                        io.airlift.stats.CounterStat highMemorySplitSourceCounter,
                        int maxOutstandingSplits,
                        io.airlift.units.DataSize maxOutstandingSplitsSize,
                        int minPartitionBatchSize,
                        int maxPartitionBatchSize,
                        int maxInitialSplits,
                        int splitLoaderConcurrency,
                        boolean recursiveDfsWalkerEnabled)

Method Detail

getSplits

public ConnectorSplitSource getSplits(ConnectorTransactionHandle transaction,
                                      ConnectorSession session,
                                      ConnectorTableLayoutHandle layoutHandle,
                                      ConnectorSplitManager.SplitSchedulingStrategy splitSchedulingStrategy)

Specified by:

getSplits in interface ConnectorSplitManager

getHighMemorySplitSource

public io.airlift.stats.CounterStat getHighMemorySplitSource()