edu.umd.cloud9.util

Class CombineSequenceFiles

java.lang.Object

org.apache.hadoop.conf.Configured

edu.umd.cloud9.util.CombineSequenceFiles

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class CombineSequenceFiles
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

Combine a number of sequence files into a smaller number of sequence files.

Input: Any number of sequence files containing key-value pairs, each of a certain type.

Output: N sequence or text files containing all key-value pairs given as input.

Given the number of desired sequence files, say N, map over a number of sequence files and partition all key-value pairs into N.

Usage: [input] [output-dir] [number-of-mappers] [number-of-reducers] [key-class-name] [value-class-name] [seqeuence|text]

Author:

ferhanture

Constructor Summary

Constructors

Constructor and Description
CombineSequenceFiles()

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(String[] args)
int	run(String[] args)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

CombineSequenceFiles

public CombineSequenceFiles()

Method Detail

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception