com.klarna.hiverunner.data

Class InsertIntoTable

java.lang.Object

com.klarna.hiverunner.data.InsertIntoTable

public final class InsertIntoTable
extends Object

A class for fluently creating a list of rows and inserting them into a table.

Method Summary

Modifier and Type	Method and Description
InsertIntoTable	addRow(Object... values) Flushes the current row and creates a new row with the values specified.
InsertIntoTable	addRowsFrom(File file, FileParser fileParser) Adds all rows from the file specified, using the provided parser.
InsertIntoTable	addRowsFromDelimited(File file, String delimiter, Object nullValue) Adds all rows from the TSV file specified, using the provided delimiter and null value.
InsertIntoTable	addRowsFromTsv(File file) Adds all rows from the TSV file specified.
void	commit() Inserts the data into the table.
InsertIntoTable	copyRow() Flushes the current row and creates a new row with the same values.
static InsertIntoTable	newInstance(String databaseName, String tableName, org.apache.hadoop.hive.conf.HiveConf conf) Factory method for creating an InsertIntoTable.
InsertIntoTable	newRow() Flushes the current row and creates a new row with null values for all columns.
InsertIntoTable	set(String name, Object value) Set the given column name to the given value.
InsertIntoTable	setRow(Object... values) Sets the current row with the values specified.
InsertIntoTable	withAllColumns() Resets the column name mask to all the columns in the table.
InsertIntoTable	withColumns(String... names) Defines a subset of columns (a column name mask) so that only pertinent columns can be set.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

newInstance

public static InsertIntoTable newInstance(String databaseName,
                                          String tableName,
                                          org.apache.hadoop.hive.conf.HiveConf conf)

Factory method for creating an InsertIntoTable.

This method is intended to be called via HiveShell.insertInto(String, String).

Parameters:

databaseName - The database name.

tableName - The table name.

conf - The HiveConf.

Returns:

InsertIntoTable

withColumns

public InsertIntoTable withColumns(String... names)

Defines a subset of columns (a column name mask) so that only pertinent columns can be set.

e.g.

 
 tableDataBuilder
     .withColumns("col1", "col3")
     .addRow("value1", "value3")
 
 

Parameters:

names - The column names.

Returns:

this

Throws:

IllegalArgumentException - if a column name does not exist in the table.

withAllColumns

public InsertIntoTable withAllColumns()

Resets the column name mask to all the columns in the table.

Returns:

this

newRow

public InsertIntoTable newRow()

Flushes the current row and creates a new row with null values for all columns.

Returns:

this

addRow

public InsertIntoTable addRow(Object... values)

Flushes the current row and creates a new row with the values specified.

Parameters:

values - The values to set.

Returns:

this

setRow

public InsertIntoTable setRow(Object... values)

Sets the current row with the values specified.

Parameters:

values - The values to set.

Returns:

this

addRowsFromTsv

public InsertIntoTable addRowsFromTsv(File file)

Adds all rows from the TSV file specified. The default delimiter is tab and the default null value is an empty string.

Parameters:

file - The file to read the data from.

Returns:

this

addRowsFromDelimited

public InsertIntoTable addRowsFromDelimited(File file,
                                            String delimiter,
                                            Object nullValue)

Adds all rows from the TSV file specified, using the provided delimiter and null value.

Parameters:

file - The file to read the data from.

delimiter - A column delimiter.

nullValue - Value to be treated as null in the source data.

Returns:

this

addRowsFrom

public InsertIntoTable addRowsFrom(File file,
                                   FileParser fileParser)

Adds all rows from the file specified, using the provided parser.

Parameters:

file - File to read the data from.

fileParser - Parser to be used to parse the file.

Returns:

this

copyRow

public InsertIntoTable copyRow()

Flushes the current row and creates a new row with the same values.

Returns:

this

set

public InsertIntoTable set(String name,
                           Object value)

Set the given column name to the given value.

Parameters:

name - The column name to set.

value - the value to set.

Returns:

this

Throws:

IllegalArgumentException - if a column name does not exist in the table.

commit

public void commit()

Inserts the data into the table. This does not replace any existing data, but appends new part files to the table/partition location(s).