org.apache.hadoop.hbase.mapreduce

类 TableOutputFormat<KEY>

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<KEY,Mutation>

org.apache.hadoop.hbase.mapreduce.TableOutputFormat<KEY>

所有已实现的接口:

org.apache.hadoop.conf.Configurable

@InterfaceAudience.Public
@InterfaceStability.Stable
public class TableOutputFormat<KEY>
extends org.apache.hadoop.mapreduce.OutputFormat<KEY,Mutation>
implements org.apache.hadoop.conf.Configurable

Convert Map/Reduce output and write it to an HBase table. The KEY is ignored while the output value must be either a Put or a Delete instance.

嵌套类概要

嵌套类

限定符和类型	类和说明
protected class	TableOutputFormat.TableRecordWriter Writes the reducer output to an HBase table.

字段概要

字段

限定符和类型	字段和说明
static String	OUTPUT_CONF_PREFIX Prefix for configuration property overrides to apply in setConf(Configuration).
static String	OUTPUT_TABLE Job parameter that specifies the output table.
static String	QUORUM_ADDRESS Optional job parameter to specify a peer cluster.
static String	QUORUM_PORT Optional job parameter to specify peer cluster's ZK client port
static String	REGION_SERVER_CLASS Optional specification of the rs class name of the peer cluster
static String	REGION_SERVER_IMPL Optional specification of the rs impl name of the peer cluster

构造器概要

构造器

构造器和说明
TableOutputFormat()

方法概要

方法

限定符和类型	方法和说明
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context) Checks if the output table exists and is enabled.
org.apache.hadoop.conf.Configuration	getConf()
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Returns the output committer.
org.apache.hadoop.mapreduce.RecordWriter<KEY,Mutation>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Creates a new record writer.
void	setConf(org.apache.hadoop.conf.Configuration otherConf)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

OUTPUT_TABLE

public static final String OUTPUT_TABLE

Job parameter that specifies the output table.

另请参阅:

常量字段值

OUTPUT_CONF_PREFIX

public static final String OUTPUT_CONF_PREFIX

Prefix for configuration property overrides to apply in setConf(Configuration). For keys matching this prefix, the prefix is stripped, and the value is set in the configuration with the resulting key, ie. the entry "hbase.mapred.output.key1 = value1" would be set in the configuration as "key1 = value1". Use this to set properties which should only be applied to the TableOutputFormat configuration and not the input configuration.

另请参阅:

常量字段值

QUORUM_ADDRESS

public static final String QUORUM_ADDRESS

Optional job parameter to specify a peer cluster. Used specifying remote cluster when copying between hbase clusters (the source is picked up from hbase-site.xml).

另请参阅:

TableMapReduceUtil.initTableReducerJob(String, Class, org.apache.hadoop.mapreduce.Job, Class, String, String, String), 常量字段值

QUORUM_PORT

public static final String QUORUM_PORT

Optional job parameter to specify peer cluster's ZK client port

另请参阅:

常量字段值

REGION_SERVER_CLASS

public static final String REGION_SERVER_CLASS

Optional specification of the rs class name of the peer cluster

另请参阅:

常量字段值

REGION_SERVER_IMPL

public static final String REGION_SERVER_IMPL

Optional specification of the rs impl name of the peer cluster

另请参阅:

常量字段值

构造器详细资料

TableOutputFormat

public TableOutputFormat()

方法详细资料

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<KEY,Mutation> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                       throws IOException,
                                                                              InterruptedException

Creates a new record writer.

指定者:

getRecordWriter 在类中 org.apache.hadoop.mapreduce.OutputFormat<KEY,Mutation>

参数:

context - The current task context.

返回:

The newly created writer instance.

抛出:

IOException - When creating the writer fails.

InterruptedException - When the jobs is cancelled.

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws IOException,
                             InterruptedException

Checks if the output table exists and is enabled.

指定者:

checkOutputSpecs 在类中 org.apache.hadoop.mapreduce.OutputFormat<KEY,Mutation>

参数:

context - The current context.

抛出:

IOException - When the check fails.

InterruptedException - When the job is aborted.

另请参阅:

OutputFormat.checkOutputSpecs(JobContext)

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws IOException,
                                                                      InterruptedException

Returns the output committer.

指定者:

getOutputCommitter 在类中 org.apache.hadoop.mapreduce.OutputFormat<KEY,Mutation>

参数:

context - The current context.

返回:

The committer.

抛出:

IOException - When creating the committer fails.

InterruptedException - When the job is aborted.

另请参阅:

OutputFormat.getOutputCommitter(TaskAttemptContext)

getConf

public org.apache.hadoop.conf.Configuration getConf()

指定者:

getConf 在接口中 org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration otherConf)

指定者:

setConf 在接口中 org.apache.hadoop.conf.Configurable