water.parser.orc

Class OrcParserProvider

java.lang.Object

water.parser.ParserProvider

water.parser.orc.OrcParserProvider

public class OrcParserProvider
extends water.parser.ParserProvider

Orc parser provider.

Constructor Summary

Constructors

Constructor and Description
OrcParserProvider()

Method Summary

Methods

Modifier and Type	Method and Description
water.parser.Parser	createParser(water.parser.ParseSetup setup, water.Key<water.Job> jobKey)
water.parser.ParseSetup	createParserSetup(water.Key[] inputs, water.parser.ParseSetup requiredSetup) Use only the first file to setup everything.
water.parser.ParseSetup	guessSetup(water.fvec.ByteVec bv, byte[] bits, byte sep, int ncols, boolean singleQuotes, int checkHeader, java.lang.String[] columnNames, byte[] columnTypes, java.lang.String[][] domains, java.lang.String[][] naStrings)
water.parser.ParserInfo	info()
water.parser.ParseSetup	readSetup(water.fvec.FileVec f, java.lang.String[] columnNames, byte[] columnTypes) This method will create the readers and others info needed to parse an orc file.
water.parser.ParseSetup	setupLocal(water.fvec.Vec v, water.parser.ParseSetup setup)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

OrcParserProvider

public OrcParserProvider()

Method Detail

info

public water.parser.ParserInfo info()

Specified by:

info in class water.parser.ParserProvider

createParser

public water.parser.Parser createParser(water.parser.ParseSetup setup,
                               water.Key<water.Job> jobKey)

Specified by:

createParser in class water.parser.ParserProvider

guessSetup

public water.parser.ParseSetup guessSetup(water.fvec.ByteVec bv,
                                 byte[] bits,
                                 byte sep,
                                 int ncols,
                                 boolean singleQuotes,
                                 int checkHeader,
                                 java.lang.String[] columnNames,
                                 byte[] columnTypes,
                                 java.lang.String[][] domains,
                                 java.lang.String[][] naStrings)

Specified by:

guessSetup in class water.parser.ParserProvider

createParserSetup

public water.parser.ParseSetup createParserSetup(water.Key[] inputs,
                                        water.parser.ParseSetup requiredSetup)

Use only the first file to setup everything.

Specified by:

createParserSetup in class water.parser.ParserProvider

Parameters:

inputs - input keys

requiredSetup - user given parser setup

Returns:

readSetup

public water.parser.ParseSetup readSetup(water.fvec.FileVec f,
                                java.lang.String[] columnNames,
                                byte[] columnTypes)

This method will create the readers and others info needed to parse an orc file. In addition, it will not over-ride the columnNames, columnTypes that the user may want to force upon it. However, we only allow users to set column types to enum at this point and ignore all the other requests.

Parameters:

f -

columnNames -

columnTypes -

Returns:

setupLocal

public water.parser.ParseSetup setupLocal(water.fvec.Vec v,
                                 water.parser.ParseSetup setup)

Overrides:

setupLocal in class water.parser.ParserProvider