org.apache.mahout.math.hadoop.decomposer

Class DistributedLanczosSolver

java.lang.Object

org.apache.mahout.math.decomposer.lanczos.LanczosSolver

org.apache.mahout.math.hadoop.decomposer.DistributedLanczosSolver

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

Deprecated.

@Deprecated
public class DistributedLanczosSolver
extends LanczosSolver
implements org.apache.hadoop.util.Tool

See the SSVD code for a better option than using this: http://mahout.apache.org/users/dim-reduction/ssvd.html

See Also:

SSVDSolver

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	DistributedLanczosSolver.DistributedLanczosSolverJob Deprecated. Inner subclass of AbstractJob so we get access to AbstractJob's functionality w.r.t.

Nested classes/interfaces inherited from class org.apache.mahout.math.decomposer.lanczos.LanczosSolver

LanczosSolver.TimingSection

Field Summary

Fields

Modifier and Type	Field and Description
static String	RAW_EIGENVECTORS Deprecated.

Fields inherited from class org.apache.mahout.math.decomposer.lanczos.LanczosSolver

SAFE_MAX

Constructor Summary

Constructors

Constructor and Description
DistributedLanczosSolver() Deprecated.

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf() Deprecated.
static Vector	getInitialVector(VectorIterable corpus) Deprecated. For the distributed case, the best guess at a useful initialization state for Lanczos we'll chose to be uniform over all input dimensions, L_2 normalized.
DistributedLanczosSolver.DistributedLanczosSolverJob	job() Deprecated.
static void	main(String[] args) Deprecated.
int	run(org.apache.hadoop.fs.Path inputPath, org.apache.hadoop.fs.Path outputPath, org.apache.hadoop.fs.Path outputTmpPath, org.apache.hadoop.fs.Path workingDirPath, int numRows, int numCols, boolean isSymmetric, int desiredRank) Deprecated. Run the solver to produce the raw eigenvectors
int	run(org.apache.hadoop.fs.Path inputPath, org.apache.hadoop.fs.Path outputPath, org.apache.hadoop.fs.Path outputTmpPath, org.apache.hadoop.fs.Path workingDirPath, int numRows, int numCols, boolean isSymmetric, int desiredRank, double maxError, double minEigenvalue, boolean inMemory) Deprecated. Run the solver to produce raw eigenvectors, then run the EigenVerificationJob to clean them
int	run(String[] strings) Deprecated.
LanczosState	runJob(org.apache.hadoop.conf.Configuration originalConfig, LanczosState state, int desiredRank, boolean isSymmetric, String outputEigenVectorPathString) Deprecated.
LanczosState	runJob(org.apache.hadoop.conf.Configuration originalConfig, org.apache.hadoop.fs.Path inputPath, org.apache.hadoop.fs.Path outputTmpPath, int numRows, int numCols, boolean isSymmetric, int desiredRank, String outputEigenVectorPathString) Deprecated. Factored-out LanczosSolver for the purpose of invoking it programmatically
void	serializeOutput(LanczosState state, org.apache.hadoop.fs.Path outputPath) Deprecated.
void	setConf(org.apache.hadoop.conf.Configuration configuration) Deprecated.

Methods inherited from class org.apache.mahout.math.decomposer.lanczos.LanczosSolver

calculateScaleFactor, orthoganalizeAgainstAllButLast, solve, solve

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

RAW_EIGENVECTORS

public static final String RAW_EIGENVECTORS

Deprecated.

See Also:

Constant Field Values

Constructor Detail

DistributedLanczosSolver

public DistributedLanczosSolver()

Deprecated.

Method Detail

getInitialVector

public static Vector getInitialVector(VectorIterable corpus)

Deprecated.

For the distributed case, the best guess at a useful initialization state for Lanczos we'll chose to be uniform over all input dimensions, L_2 normalized.

runJob

public LanczosState runJob(org.apache.hadoop.conf.Configuration originalConfig,
                           LanczosState state,
                           int desiredRank,
                           boolean isSymmetric,
                           String outputEigenVectorPathString)
                    throws IOException

Deprecated.

Throws:

IOException

runJob

public LanczosState runJob(org.apache.hadoop.conf.Configuration originalConfig,
                           org.apache.hadoop.fs.Path inputPath,
                           org.apache.hadoop.fs.Path outputTmpPath,
                           int numRows,
                           int numCols,
                           boolean isSymmetric,
                           int desiredRank,
                           String outputEigenVectorPathString)
                    throws IOException

Deprecated.

Factored-out LanczosSolver for the purpose of invoking it programmatically

Throws:

IOException

run

public int run(String[] strings)
        throws Exception

Deprecated.

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

run

public int run(org.apache.hadoop.fs.Path inputPath,
               org.apache.hadoop.fs.Path outputPath,
               org.apache.hadoop.fs.Path outputTmpPath,
               org.apache.hadoop.fs.Path workingDirPath,
               int numRows,
               int numCols,
               boolean isSymmetric,
               int desiredRank,
               double maxError,
               double minEigenvalue,
               boolean inMemory)
        throws Exception

Deprecated.

Run the solver to produce raw eigenvectors, then run the EigenVerificationJob to clean them

Parameters:

inputPath - the Path to the input corpus

outputPath - the Path to the output

outputTmpPath - a Path to a temporary working directory

numRows - the int number of rows

numCols - the int number of columns

isSymmetric - true if the input matrix is symmetric

desiredRank - the int desired rank of eigenvectors to produce

maxError - the maximum allowable error

minEigenvalue - the minimum usable eigenvalue

inMemory - true if the verification can be done in memory

Returns:

an int indicating success (0) or otherwise

Throws:

Exception

run

public int run(org.apache.hadoop.fs.Path inputPath,
               org.apache.hadoop.fs.Path outputPath,
               org.apache.hadoop.fs.Path outputTmpPath,
               org.apache.hadoop.fs.Path workingDirPath,
               int numRows,
               int numCols,
               boolean isSymmetric,
               int desiredRank)
        throws Exception

Deprecated.

Run the solver to produce the raw eigenvectors

Parameters:

inputPath - the Path to the input corpus

outputPath - the Path to the output

outputTmpPath - a Path to a temporary working directory

numRows - the int number of rows

numCols - the int number of columns

isSymmetric - true if the input matrix is symmetric

desiredRank - the int desired rank of eigenvectors to produce

Returns:

an int indicating success (0) or otherwise

Throws:

Exception

serializeOutput

public void serializeOutput(LanczosState state,
                            org.apache.hadoop.fs.Path outputPath)
                     throws IOException

Deprecated.

Parameters:

state - The final LanczosState to be serialized

outputPath - The path (relative to the current Configuration's FileSystem) to save the output to.

Throws:

IOException

setConf

public void setConf(org.apache.hadoop.conf.Configuration configuration)

Deprecated.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Deprecated.

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

job

public DistributedLanczosSolver.DistributedLanczosSolverJob job()

Deprecated.

main

public static void main(String[] args)
                 throws Exception

Deprecated.

Throws:

Exception