com.aliyun.odps.udf

Interface InputFormat

public interface InputFormat

TODO: see if we can remove this

Method Summary

Modifier and Type	Method and Description
RecordReader	getRecordReader(InputSplit split, Configuration conf, Reporter reporter) Get the RecordReader for the given InputSplit.
InputSplit[]	getSplits(Configuration conf, int numSplits) Logically split the set of input files for the job.

Method Detail

getSplits

InputSplit[] getSplits(Configuration conf,
                       int numSplits)
                throws IOException

Logically split the set of input files for the job. Each InputSplit is then assigned to an individual mapper for processing. Note: The split is a logical split of the inputs and the input files are not physically split into chunks. For e.g. a split could be input-file-path, start, offset tuple.

Parameters:

numSplits - the desired number of splits, a hint.

Returns:

an array of InputSplits for the job.

Throws:

IOException

getRecordReader

RecordReader getRecordReader(InputSplit split,
                             Configuration conf,
                             Reporter reporter)
                      throws IOException

Get the RecordReader for the given InputSplit. It is the responsibility of the RecordReader to respect record boundaries while processing the logical split to present a record-oriented view to the individual task.

Throws:

IOException