org.apache.hadoop.hbase.mapreduce

类 TsvImporterMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,Put>

org.apache.hadoop.hbase.mapreduce.TsvImporterMapper

@InterfaceAudience.Public
@InterfaceStability.Stable
public class TsvImporterMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,Put>

Write table content out to files in hdfs.

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

字段概要

字段

限定符和类型	字段和说明
protected String	cellVisibilityExpr
protected org.apache.hadoop.conf.Configuration	conf
protected CellCreator	kvCreator
protected ImportTsv.TsvParser	parser
protected long	ts Timestamp for all inserted rows
protected long	ttl

构造器概要

构造器

构造器和说明
TsvImporterMapper()

方法概要

方法

限定符和类型	方法和说明
protected void	doSetup(org.apache.hadoop.mapreduce.Mapper.Context context) Handles common parameter initialization that a subclass might want to leverage.
org.apache.hadoop.mapreduce.Counter	getBadLineCount()
boolean	getSkipBadLines()
long	getTs()
void	incrementBadLineCount(int count)
void	map(org.apache.hadoop.io.LongWritable offset, org.apache.hadoop.io.Text value, org.apache.hadoop.mapreduce.Mapper.Context context) Convert a line of TSV text into an HBase table row.
protected void	populatePut(byte[] lineBytes, org.apache.hadoop.hbase.mapreduce.ImportTsv.TsvParser.ParsedLine parsed, Put put, int i)
protected void	setup(org.apache.hadoop.mapreduce.Mapper.Context context) Handles initializing this class with objects specific to it (i.e., the parser).

从类继承的方法 org.apache.hadoop.mapreduce.Mapper

cleanup, run

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

ts

protected long ts

Timestamp for all inserted rows

parser

protected ImportTsv.TsvParser parser

conf

protected org.apache.hadoop.conf.Configuration conf

cellVisibilityExpr

protected String cellVisibilityExpr

ttl

protected long ttl

kvCreator

protected CellCreator kvCreator

构造器详细资料

TsvImporterMapper

public TsvImporterMapper()

方法详细资料

getTs

public long getTs()

getSkipBadLines

public boolean getSkipBadLines()

getBadLineCount

public org.apache.hadoop.mapreduce.Counter getBadLineCount()

incrementBadLineCount

public void incrementBadLineCount(int count)

setup

protected void setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Handles initializing this class with objects specific to it (i.e., the parser). Common initialization that might be leveraged by a subsclass is done in doSetup. Hence a subclass may choose to override this method and call doSetup as well before handling it's own custom params.

覆盖:

setup 在类中 org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,Put>

参数:

context -

doSetup

protected void doSetup(org.apache.hadoop.mapreduce.Mapper.Context context)

Handles common parameter initialization that a subclass might want to leverage.

参数:

context -

map

public void map(org.apache.hadoop.io.LongWritable offset,
       org.apache.hadoop.io.Text value,
       org.apache.hadoop.mapreduce.Mapper.Context context)
         throws IOException

Convert a line of TSV text into an HBase table row.

覆盖:

map 在类中 org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,Put>

抛出:

IOException

populatePut

protected void populatePut(byte[] lineBytes,
               org.apache.hadoop.hbase.mapreduce.ImportTsv.TsvParser.ParsedLine parsed,
               Put put,
               int i)
                    throws ImportTsv.TsvParser.BadTsvLineException,
                           IOException

抛出:

ImportTsv.TsvParser.BadTsvLineException

IOException