org.datavec.api.records.reader.impl.csv

Class CSVRegexRecordReader

java.lang.Object

org.datavec.api.records.reader.BaseRecordReader

org.datavec.api.records.reader.impl.LineRecordReader

org.datavec.api.records.reader.impl.csv.CSVRecordReader

org.datavec.api.records.reader.impl.csv.CSVRegexRecordReader

All Implemented Interfaces:

Closeable, Serializable, AutoCloseable, Configurable, RecordReader

public class CSVRegexRecordReader
extends CSVRecordReader

A CSVRecordReader that can split each column into additional columns using regexs.

Author:

saudet

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected Pattern[]	patterns
protected String[]	regexs

Fields inherited from class org.datavec.api.records.reader.impl.csv.CSVRecordReader

DEFAULT_DELIMITER, delimiter, DELIMITER, quote, QUOTE, QUOTE_HANDLING_DELIMITER, SKIP_NUM_LINES, skipNumLines

Fields inherited from class org.datavec.api.records.reader.impl.LineRecordReader

conf, inputSplit, lineIndex, locations, splitIndex

Fields inherited from class org.datavec.api.records.reader.BaseRecordReader

listeners

Fields inherited from interface org.datavec.api.records.reader.RecordReader

APPEND_LABEL, LABELS, NAME_SPACE

Constructor Summary

Constructors

Constructor and Description
CSVRegexRecordReader(int skipNumLines, String delimiter, String quote, String[] regexs) Skip lines, use delimiter, strip quotes, and parse each column with a regex

Method Summary

Modifier and Type	Method and Description
protected List<Writable>	parseLine(String line)

Methods inherited from class org.datavec.api.records.reader.impl.csv.CSVRecordReader

initialize, loadFromMetaData, loadFromMetaData, next, nextRecord, onLocationOpen, record, reset

Methods inherited from class org.datavec.api.records.reader.impl.LineRecordReader

close, closeIfRequired, getConf, getIterator, getLabels, hasNext, initialize, setConf

Methods inherited from class org.datavec.api.records.reader.BaseRecordReader

getListeners, invokeListeners, setListeners, setListeners

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

regexs

protected String[] regexs

patterns

protected Pattern[] patterns

Constructor Detail

CSVRegexRecordReader

public CSVRegexRecordReader(int skipNumLines,
                            String delimiter,
                            String quote,
                            String[] regexs)

Skip lines, use delimiter, strip quotes, and parse each column with a regex

Parameters:

skipNumLines - the number of lines to skip

delimiter - the delimiter

quote - the quote to strip

regexs - the regexs to parse columns with

Method Detail

parseLine

protected List<Writable> parseLine(String line)

Overrides:

parseLine in class CSVRecordReader