org.apache.hadoop.hive.llap

Class LlapUtil

java.lang.Object

org.apache.hadoop.hive.llap.LlapUtil

public class LlapUtil
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LlapUtil.StatisticsData

Constructor Summary

Constructors

Constructor and Description
LlapUtil()

Method Summary

Modifier and Type	Method and Description
static List<LlapUtil.StatisticsData>	cloneThreadLocalFileSystemStatistics()
static org.apache.hadoop.ipc.RPC.Server	createRpcServer(Class<?> pbProtocol, InetSocketAddress addr, org.apache.hadoop.conf.Configuration conf, int numHandlers, com.google.protobuf.BlockingService blockingService, org.apache.hadoop.security.token.SecretManager<?> secretManager, org.apache.hadoop.security.authorize.PolicyProvider provider, HiveConf.ConfVars... aclVars)
static org.apache.hadoop.security.Credentials	credentialsFromByteArray(byte[] binaryCredentials) transform a byte of crendetials to a hadoop Credentials object.
static String	generateClusterName(org.apache.hadoop.conf.Configuration conf)
static String	getAmHostNameFromAddress(InetSocketAddress address, org.apache.hadoop.conf.Configuration conf)
static Map<String,org.apache.hadoop.fs.FileSystem.Statistics>	getCombinedFileSystemStatistics()
static String	getDaemonLocalDirString(org.apache.hadoop.conf.Configuration conf, String workDirsEnvString)
static String	getDbAndTableNameForMetrics(org.apache.hadoop.fs.Path path, boolean includeParts) Deprecated.
static String	getPublicHostname()
static List<LlapUtil.StatisticsData>	getStatisticsForScheme(String scheme, List<LlapUtil.StatisticsData> stats)
static String	getUserNameFromPrincipal(String principal)
static String	humanReadableByteCount(long bytes)
static ThreadMXBean	initThreadMxBean()
static boolean	isCloudDeployment(org.apache.hadoop.conf.Configuration conf)
static org.apache.hadoop.security.UserGroupInformation	loginWithKerberos(String principal, String keytabFile) Login using kerberos.
static void	loginWithKerberosAndUpdateCurrentUser(String principal, String keytabFile) Login using kerberos and also updates the current logged in user
static org.apache.hadoop.ipc.RPC.Server	startProtocolServer(int srvPort, int numHandlers, AtomicReference<InetSocketAddress> bindAddress, org.apache.hadoop.conf.Configuration conf, com.google.protobuf.BlockingService impl, Class<?> protocolClass, org.apache.hadoop.security.token.SecretManager<?> secretManager, org.apache.hadoop.security.authorize.PolicyProvider provider, HiveConf.ConfVars... aclVars)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LlapUtil

public LlapUtil()

Method Detail

getDaemonLocalDirString

public static String getDaemonLocalDirString(org.apache.hadoop.conf.Configuration conf,
                                             String workDirsEnvString)

loginWithKerberos

public static org.apache.hadoop.security.UserGroupInformation loginWithKerberos(String principal,
                                                                                String keytabFile)
                                                                         throws IOException

Login using kerberos. But does not change the current logged in user.

Parameters:

principal - - kerberos principal

keytabFile - - keytab file

Returns:

UGI

Throws:

IOException - - if keytab file cannot be found

loginWithKerberosAndUpdateCurrentUser

public static void loginWithKerberosAndUpdateCurrentUser(String principal,
                                                         String keytabFile)
                                                  throws IOException

Login using kerberos and also updates the current logged in user

Parameters:

principal - - kerberos principal

keytabFile - - keytab file

Throws:

IOException - - if keytab file cannot be found

generateClusterName

public static String generateClusterName(org.apache.hadoop.conf.Configuration conf)

getUserNameFromPrincipal

public static String getUserNameFromPrincipal(String principal)

getStatisticsForScheme

public static List<LlapUtil.StatisticsData> getStatisticsForScheme(String scheme,
                                                                   List<LlapUtil.StatisticsData> stats)

getCombinedFileSystemStatistics

public static Map<String,org.apache.hadoop.fs.FileSystem.Statistics> getCombinedFileSystemStatistics()

cloneThreadLocalFileSystemStatistics

public static List<LlapUtil.StatisticsData> cloneThreadLocalFileSystemStatistics()

getAmHostNameFromAddress

public static String getAmHostNameFromAddress(InetSocketAddress address,
                                              org.apache.hadoop.conf.Configuration conf)

humanReadableByteCount

public static String humanReadableByteCount(long bytes)

createRpcServer

public static org.apache.hadoop.ipc.RPC.Server createRpcServer(Class<?> pbProtocol,
                                                               InetSocketAddress addr,
                                                               org.apache.hadoop.conf.Configuration conf,
                                                               int numHandlers,
                                                               com.google.protobuf.BlockingService blockingService,
                                                               org.apache.hadoop.security.token.SecretManager<?> secretManager,
                                                               org.apache.hadoop.security.authorize.PolicyProvider provider,
                                                               HiveConf.ConfVars... aclVars)
                                                        throws IOException

Throws:

IOException

startProtocolServer

public static org.apache.hadoop.ipc.RPC.Server startProtocolServer(int srvPort,
                                                                   int numHandlers,
                                                                   AtomicReference<InetSocketAddress> bindAddress,
                                                                   org.apache.hadoop.conf.Configuration conf,
                                                                   com.google.protobuf.BlockingService impl,
                                                                   Class<?> protocolClass,
                                                                   org.apache.hadoop.security.token.SecretManager<?> secretManager,
                                                                   org.apache.hadoop.security.authorize.PolicyProvider provider,
                                                                   HiveConf.ConfVars... aclVars)

getDbAndTableNameForMetrics

@Deprecated
public static String getDbAndTableNameForMetrics(org.apache.hadoop.fs.Path path,
                                                             boolean includeParts)

Deprecated.

initThreadMxBean

@Nullable
public static ThreadMXBean initThreadMxBean()

credentialsFromByteArray

public static org.apache.hadoop.security.Credentials credentialsFromByteArray(byte[] binaryCredentials)
                                                                       throws IOException

transform a byte of crendetials to a hadoop Credentials object.

Parameters:

binaryCredentials - credentials in byte format as they would usually be when received from protobuffers

Returns:

a hadoop Credentials object

Throws:

IOException

isCloudDeployment

public static boolean isCloudDeployment(org.apache.hadoop.conf.Configuration conf)

Parameters:

conf -

Returns:

returns the value of LLAP_EXTERNAL_CLIENT_CLOUD_DEPLOYMENT_SETUP_ENABLED

getPublicHostname

public static String getPublicHostname()

Returns:

returns the value of PUBLIC_HOSTNAME from either environment variable or system properties