io.prestosql.plugin.hive

Class HiveSplitManager

java.lang.Object

io.prestosql.plugin.hive.HiveSplitManager

All Implemented Interfaces:

ConnectorSplitManager

public class HiveSplitManager
extends Object
implements ConnectorSplitManager

Nested Class Summary

Nested classes/interfaces inherited from interface io.prestosql.spi.connector.ConnectorSplitManager

ConnectorSplitManager.SplitSchedulingStrategy

Field Summary

Fields

Modifier and Type	Field and Description
static String	OBJECT_NOT_READABLE
static String	PRESTO_OFFLINE

Constructor Summary

Constructors

Constructor and Description
HiveSplitManager(Function<HiveTransactionHandle,SemiTransactionalHiveMetastore> metastoreProvider, HivePartitionManager partitionManager, NamenodeStats namenodeStats, HdfsEnvironment hdfsEnvironment, DirectoryLister directoryLister, Executor executor, CoercionPolicy coercionPolicy, io.airlift.stats.CounterStat highMemorySplitSourceCounter, int maxOutstandingSplits, io.airlift.units.DataSize maxOutstandingSplitsSize, int minPartitionBatchSize, int maxPartitionBatchSize, int maxInitialSplits, int splitLoaderConcurrency, Integer maxSplitsPerSecond, boolean recursiveDfsWalkerEnabled)
HiveSplitManager(HiveConfig hiveConfig, Function<HiveTransactionHandle,SemiTransactionalHiveMetastore> metastoreProvider, HivePartitionManager partitionManager, NamenodeStats namenodeStats, HdfsEnvironment hdfsEnvironment, DirectoryLister directoryLister, ExecutorService executorService, VersionEmbedder versionEmbedder, CoercionPolicy coercionPolicy)

Method Summary

Modifier and Type	Method and Description
io.airlift.stats.CounterStat	getHighMemorySplitSource()
ConnectorSplitSource	getSplits(ConnectorTransactionHandle transaction, ConnectorSession session, ConnectorTableHandle tableHandle, ConnectorSplitManager.SplitSchedulingStrategy splitSchedulingStrategy)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.prestosql.spi.connector.ConnectorSplitManager

getSplits

Field Detail

PRESTO_OFFLINE

public static final String PRESTO_OFFLINE

See Also:

Constant Field Values

OBJECT_NOT_READABLE

public static final String OBJECT_NOT_READABLE

See Also:

Constant Field Values

Constructor Detail

HiveSplitManager

@Inject
public HiveSplitManager(HiveConfig hiveConfig,
                                Function<HiveTransactionHandle,SemiTransactionalHiveMetastore> metastoreProvider,
                                HivePartitionManager partitionManager,
                                NamenodeStats namenodeStats,
                                HdfsEnvironment hdfsEnvironment,
                                DirectoryLister directoryLister,
                                ExecutorService executorService,
                                VersionEmbedder versionEmbedder,
                                CoercionPolicy coercionPolicy)

HiveSplitManager

public HiveSplitManager(Function<HiveTransactionHandle,SemiTransactionalHiveMetastore> metastoreProvider,
                        HivePartitionManager partitionManager,
                        NamenodeStats namenodeStats,
                        HdfsEnvironment hdfsEnvironment,
                        DirectoryLister directoryLister,
                        Executor executor,
                        CoercionPolicy coercionPolicy,
                        io.airlift.stats.CounterStat highMemorySplitSourceCounter,
                        int maxOutstandingSplits,
                        io.airlift.units.DataSize maxOutstandingSplitsSize,
                        int minPartitionBatchSize,
                        int maxPartitionBatchSize,
                        int maxInitialSplits,
                        int splitLoaderConcurrency,
                        @Nullable
                        Integer maxSplitsPerSecond,
                        boolean recursiveDfsWalkerEnabled)

Method Detail

getSplits

public ConnectorSplitSource getSplits(ConnectorTransactionHandle transaction,
                                      ConnectorSession session,
                                      ConnectorTableHandle tableHandle,
                                      ConnectorSplitManager.SplitSchedulingStrategy splitSchedulingStrategy)

Specified by:

getSplits in interface ConnectorSplitManager

getHighMemorySplitSource

public io.airlift.stats.CounterStat getHighMemorySplitSource()