parquet.hadoop.example

Class GroupReadSupport

java.lang.Object

parquet.hadoop.api.ReadSupport<Group>

parquet.hadoop.example.GroupReadSupport

public class GroupReadSupport
extends ReadSupport<Group>

Nested Class Summary

Nested classes/interfaces inherited from class parquet.hadoop.api.ReadSupport

ReadSupport.ReadContext

Field Summary

Fields inherited from class parquet.hadoop.api.ReadSupport

PARQUET_READ_SCHEMA

Constructor Summary

Constructors

Constructor and Description
GroupReadSupport()

Method Summary

Methods

Modifier and Type	Method and Description
ReadSupport.ReadContext	init(org.apache.hadoop.conf.Configuration configuration, Map<String,String> keyValueMetaData, MessageType fileSchema) called in InputFormat.getSplits(org.apache.hadoop.mapreduce.JobContext) in the front end
RecordMaterializer<Group>	prepareForRead(org.apache.hadoop.conf.Configuration configuration, Map<String,String> keyValueMetaData, MessageType fileSchema, ReadSupport.ReadContext readContext) called in RecordReader.initialize(org.apache.hadoop.mapreduce.InputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext) in the back end the returned RecordConsumer will materialize the records and add them to the destination

Methods inherited from class parquet.hadoop.api.ReadSupport

getSchemaForRead, getSchemaForRead, init

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GroupReadSupport

public GroupReadSupport()

Method Detail

init

public ReadSupport.ReadContext init(org.apache.hadoop.conf.Configuration configuration,
                           Map<String,String> keyValueMetaData,
                           MessageType fileSchema)

Description copied from class: ReadSupport

called in InputFormat.getSplits(org.apache.hadoop.mapreduce.JobContext) in the front end

Overrides:

init in class ReadSupport<Group>

Parameters:

configuration - the job configuration

keyValueMetaData - the app specific metadata from the file

fileSchema - the schema of the file

Returns:

the readContext that defines how to read the file

prepareForRead

public RecordMaterializer<Group> prepareForRead(org.apache.hadoop.conf.Configuration configuration,
                                       Map<String,String> keyValueMetaData,
                                       MessageType fileSchema,
                                       ReadSupport.ReadContext readContext)

Description copied from class: ReadSupport

called in RecordReader.initialize(org.apache.hadoop.mapreduce.InputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext) in the back end the returned RecordConsumer will materialize the records and add them to the destination

Specified by:

prepareForRead in class ReadSupport<Group>

Parameters:

configuration - the job configuration

keyValueMetaData - the app specific metadata from the file

fileSchema - the schema of the file

readContext - returned by the init method

Returns:

the recordConsumer that will receive the events