org.apache.hadoop.hive.dynamodb.util

Class HiveDynamoDBUtil

java.lang.Object

org.apache.hadoop.hive.dynamodb.util.HiveDynamoDBUtil

public final class HiveDynamoDBUtil
extends Object

Method Summary

Modifier and Type	Method and Description
static Map<String,String>	extractHiveTypeMapping(org.apache.hadoop.mapred.JobConf jobConf) Extracts column to type mapping for the hive table from the job configuration It uses 2 standard Hive Job parameters: LIST_COLUMNS ("columns") and LIST_COLUMN_TYPES LIST_COLUMN_TYPES ("columns.types").
static Map<String,String>	fromJsonString(String jsonString)
static String	getDynamoDBTableName(String tablePropertyDefinedTableName, String hiveTableName)
static Map<String,String>	getHiveToDynamoDBColumnMapping(Properties props)
static Map<String,String>	getHiveToDynamoDBMapping(String mapping) Please note that this method converts the hive column names (map keys) to lower case for consistency with other Hive code
static boolean	getHiveToDynamoDBNullSerialization(Properties tbl)
static Map<String,HiveDynamoDBType>	getHiveToDynamoDBTypeMapping(List<String> columnNames, List<org.apache.hadoop.hive.serde2.typeinfo.TypeInfo> columnTypes, Properties props)
static String	toJsonString(Map<String,String> dynamoDBTypeMapping)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getDynamoDBTableName

public static String getDynamoDBTableName(String tablePropertyDefinedTableName,
                                          String hiveTableName)

getHiveToDynamoDBColumnMapping

public static Map<String,String> getHiveToDynamoDBColumnMapping(Properties props)

getHiveToDynamoDBTypeMapping

public static Map<String,HiveDynamoDBType> getHiveToDynamoDBTypeMapping(List<String> columnNames,
                                                                        List<org.apache.hadoop.hive.serde2.typeinfo.TypeInfo> columnTypes,
                                                                        Properties props)

getHiveToDynamoDBNullSerialization

public static boolean getHiveToDynamoDBNullSerialization(Properties tbl)

toJsonString

public static String toJsonString(Map<String,String> dynamoDBTypeMapping)

fromJsonString

public static Map<String,String> fromJsonString(String jsonString)

getHiveToDynamoDBMapping

public static Map<String,String> getHiveToDynamoDBMapping(String mapping)

Please note that this method converts the hive column names (map keys) to lower case for consistency with other Hive code

extractHiveTypeMapping

public static Map<String,String> extractHiveTypeMapping(org.apache.hadoop.mapred.JobConf jobConf)

Extracts column to type mapping for the hive table from the job configuration It uses 2 standard Hive Job parameters: LIST_COLUMNS ("columns") and LIST_COLUMN_TYPES LIST_COLUMN_TYPES ("columns.types").

Parameters:

jobConf - a job configuration

Returns:

mapping between column names and column types

See Also:

serdeConstants.LIST_COLUMNS, serdeConstants.LIST_COLUMN_TYPES