com.klarna.hiverunner.data

Class TsvFileParser

java.lang.Object

com.klarna.hiverunner.data.TsvFileParser

All Implemented Interfaces:

FileParser

public class TsvFileParser
extends Object
implements FileParser

A FileParser for parsing data out of a TSV file.

Constructor Summary

Constructors

Constructor and Description
TsvFileParser()

Method Summary

Modifier and Type	Method and Description
List<String>	getColumnNames(File file) Parses the given file and returns the column names that are available in the file.
boolean	hasColumnNames() Method that checks if the parser has access to column names.
List<Object[]>	parse(File file, org.apache.hive.hcatalog.data.schema.HCatSchema schema, List<String> names) Parses the given file and returns the rows with the requested columns.
TsvFileParser	withCharset(Charset charset) Use the provided Charset.
TsvFileParser	withDelimiter(String delimiter) Use the provided delimiter.
TsvFileParser	withHeader() Enable if TSV file has header row.
TsvFileParser	withNullValue(Object nullValue) Use the provided null value.
TsvFileParser	withoutHeader() Enable if TSV file has header row.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TsvFileParser

public TsvFileParser()

Method Detail

withDelimiter

public TsvFileParser withDelimiter(String delimiter)

Use the provided delimiter. The default is a tab.

withNullValue

public TsvFileParser withNullValue(Object nullValue)

Use the provided null value. When a column's value equals the null value it will be replaced with null. The default is an empty string.

withCharset

public TsvFileParser withCharset(Charset charset)

Use the provided Charset. The default is UTF-8.

withHeader

public TsvFileParser withHeader()

Enable if TSV file has header row. Default is false.

withoutHeader

public TsvFileParser withoutHeader()

Enable if TSV file has header row. Default is false.

parse

public List<Object[]> parse(File file,
                            org.apache.hive.hcatalog.data.schema.HCatSchema schema,
                            List<String> names)

Description copied from interface: FileParser

Parses the given file and returns the rows with the requested columns.

Specified by:

parse in interface FileParser

Parameters:

file - The file to be parsed.

schema - The full schema of the Hive table.

names - The requested field names.

Returns:

A List of rows, each represented by an Object array.

hasColumnNames

public boolean hasColumnNames()

Description copied from interface: FileParser

Method that checks if the parser has access to column names.

Specified by:

hasColumnNames in interface FileParser

Returns:

getColumnNames

public List<String> getColumnNames(File file)

Description copied from interface: FileParser

Parses the given file and returns the column names that are available in the file.

Specified by:

getColumnNames in interface FileParser

Parameters:

file - The file to be parsed

Returns:

A List of column names as Strings