org.apache.hudi.hive

Class HoodieHiveClient

java.lang.Object

org.apache.hudi.hive.HoodieHiveClient

public class HoodieHiveClient
extends Object

Constructor Summary

Constructors

Constructor and Description
HoodieHiveClient(HiveSyncConfig cfg, org.apache.hadoop.hive.conf.HiveConf configuration, org.apache.hadoop.fs.FileSystem fs)

Method Summary

Modifier and Type	Method and Description
void	close()
boolean	doesTableExist()
HoodieTimeline	getActiveTimeline()
String	getBasePath()
org.apache.parquet.schema.MessageType	getDataSchema() Gets the schema for a hoodie dataset.
org.apache.hadoop.fs.FileSystem	getFs()
Option<String>	getLastCommitTimeSynced()
Map<String,String>	getTableSchema() Get the table schema
Map<String,String>	getTableSchemaUsingMetastoreClient()
List<org.apache.hadoop.hive.metastore.api.Partition>	scanTablePartitions() Scan table partitions
void	updateHiveSQL(String s) Execute a update in hive metastore with this SQL
org.apache.hadoop.hive.ql.processors.CommandProcessorResponse	updateHiveSQLUsingHiveDriver(String sql) Execute a update in hive using Hive Driver

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieHiveClient

public HoodieHiveClient(HiveSyncConfig cfg,
                        org.apache.hadoop.hive.conf.HiveConf configuration,
                        org.apache.hadoop.fs.FileSystem fs)

Method Detail

getActiveTimeline

public HoodieTimeline getActiveTimeline()

scanTablePartitions

public List<org.apache.hadoop.hive.metastore.api.Partition> scanTablePartitions()
                                                                         throws org.apache.thrift.TException

Scan table partitions

Throws:

org.apache.thrift.TException

getTableSchema

public Map<String,String> getTableSchema()

Get the table schema

getTableSchemaUsingMetastoreClient

public Map<String,String> getTableSchemaUsingMetastoreClient()

getDataSchema

public org.apache.parquet.schema.MessageType getDataSchema()

Gets the schema for a hoodie dataset. Depending on the type of table, read from any file written in the latest commit. We will assume that the schema has not changed within a single atomic write.

Returns:

Parquet schema for this dataset

doesTableExist

public boolean doesTableExist()

Returns:

true if the configured table exists

updateHiveSQL

public void updateHiveSQL(String s)

Execute a update in hive metastore with this SQL

Parameters:

s - SQL to execute

updateHiveSQLUsingHiveDriver

public org.apache.hadoop.hive.ql.processors.CommandProcessorResponse updateHiveSQLUsingHiveDriver(String sql)
                                                                                           throws HoodieHiveSyncException

Execute a update in hive using Hive Driver

Parameters:

sql - SQL statement to execute

Throws:

HoodieHiveSyncException

getBasePath

public String getBasePath()

getFs

public org.apache.hadoop.fs.FileSystem getFs()

getLastCommitTimeSynced

public Option<String> getLastCommitTimeSynced()

close

public void close()