org.apache.tez.examples

Class WordCount

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.tez.examples.TezExampleBase

org.apache.tez.examples.WordCount

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class WordCount
extends TezExampleBase

Simple example to perform WordCount using Tez API's. WordCount is the HelloWorld program of distributed data processing and counts the number of occurrences of a word in a distributed text data set.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WordCount.SumProcessor
static class	WordCount.TokenProcessor

Field Summary

Fields inherited from class org.apache.tez.examples.TezExampleBase

COUNTER_LOG, DISABLE_SPLIT_GROUPING, GENERATE_SPLIT_IN_CLIENT, LOCAL_MODE

Constructor Summary

Constructors

Constructor and Description
WordCount()

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(String[] args)
protected void	printUsage() Print usage instructions for this example
protected int	runJob(String[] args, org.apache.tez.dag.api.TezConfiguration tezConf, org.apache.tez.client.TezClient tezClient) Create and execute the actual DAG for the example
protected int	validateArgs(String[] otherArgs) Validate the arguments

Methods inherited from class org.apache.tez.examples.TezExampleBase

getAppId, isCountersLog, isDisableSplitGrouping, isGenerateSplitInClient, printExtraOptionsUsage, run, run, runDag

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

WordCount

public WordCount()

Method Detail

printUsage

protected void printUsage()

Description copied from class: TezExampleBase

Print usage instructions for this example

Specified by:

printUsage in class TezExampleBase

validateArgs

protected int validateArgs(String[] otherArgs)

Description copied from class: TezExampleBase

Validate the arguments

Specified by:

validateArgs in class TezExampleBase

Parameters:

otherArgs - arguments, if any

Returns:

Zero indicates success, non-zero indicates failure

runJob

protected int runJob(String[] args,
         org.apache.tez.dag.api.TezConfiguration tezConf,
         org.apache.tez.client.TezClient tezClient)
              throws Exception

Description copied from class: TezExampleBase

Create and execute the actual DAG for the example

Specified by:

runJob in class TezExampleBase

Parameters:

args - arguments for execution

tezConf - the tez configuration instance to be used while processing the DAG

tezClient - the tez client instance to use to run the DAG if any custom monitoring is required. Otherwise the utility method TezExampleBase.runDag(org.apache.tez.dag.api.DAG, boolean, org.slf4j.Logger) should be used

Returns:

Zero indicates success, non-zero indicates failure

Throws:

IOException

org.apache.tez.dag.api.TezException

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception