org.apache.mahout.common.iterator.sequencefile

Class SequenceFileDirIterable<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.mahout.common.iterator.sequencefile.SequenceFileDirIterable<K,V>

All Implemented Interfaces:

Iterable<Pair<K,V>>

public final class SequenceFileDirIterable<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>
extends Object
implements Iterable<Pair<K,V>>

Iterable counterpart to SequenceFileDirIterator.

Constructor Summary

Constructors

Constructor and Description
SequenceFileDirIterable(org.apache.hadoop.fs.Path path, PathType pathType, org.apache.hadoop.conf.Configuration conf)
SequenceFileDirIterable(org.apache.hadoop.fs.Path path, PathType pathType, org.apache.hadoop.fs.PathFilter filter, Comparator<org.apache.hadoop.fs.FileStatus> ordering, boolean reuseKeyValueInstances, org.apache.hadoop.conf.Configuration conf)
SequenceFileDirIterable(org.apache.hadoop.fs.Path path, PathType pathType, org.apache.hadoop.fs.PathFilter filter, org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method and Description
Iterator<Pair<K,V>>	iterator()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

SequenceFileDirIterable

public SequenceFileDirIterable(org.apache.hadoop.fs.Path path,
                               PathType pathType,
                               org.apache.hadoop.conf.Configuration conf)

SequenceFileDirIterable

public SequenceFileDirIterable(org.apache.hadoop.fs.Path path,
                               PathType pathType,
                               org.apache.hadoop.fs.PathFilter filter,
                               org.apache.hadoop.conf.Configuration conf)

SequenceFileDirIterable

public SequenceFileDirIterable(org.apache.hadoop.fs.Path path,
                               PathType pathType,
                               org.apache.hadoop.fs.PathFilter filter,
                               Comparator<org.apache.hadoop.fs.FileStatus> ordering,
                               boolean reuseKeyValueInstances,
                               org.apache.hadoop.conf.Configuration conf)

Parameters:

path - file to iterate over

pathType - whether or not to treat path as a directory (PathType.LIST) or glob pattern (PathType.GLOB)

filter - if not null, specifies sequence files to be ignored by the iteration

ordering - if not null, specifies the order in which to iterate over matching sequence files

reuseKeyValueInstances - if true, reuses instances of the value object instead of creating a new one for each read from the file

Method Detail

iterator

public Iterator<Pair<K,V>> iterator()

Specified by:

iterator in interface Iterable<Pair<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>>