com.metamx.common.io.smoosh

Class FileSmoosher

java.lang.Object

com.metamx.common.io.smoosh.FileSmoosher

All Implemented Interfaces:

Closeable, AutoCloseable

public class FileSmoosher
extends Object
implements Closeable

A class that concatenates files together into configurable sized chunks, works in conjunction with the SmooshedFileMapper to provide access to the individual files.

It does not split input files among separate output files, instead the various "chunk" files will be varying sizes and it is not possible to add a file of size greater than Integer.MAX_VALUE

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FileSmoosher.Outer

Constructor Summary

Constructors

Constructor and Description
FileSmoosher(File baseDir)
FileSmoosher(File baseDir, int maxChunkSize)

Method Summary

Methods

Modifier and Type	Method and Description
void	add(File fileToAdd)
void	add(String name, ByteBuffer bufferToAdd)
void	add(String name, File fileToAdd)
void	add(String name, List<ByteBuffer> bufferToAdd)
SmooshedWriter	addWithSmooshedWriter(String name, long size)
void	close()
Set<String>	getInternalFilenames()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileSmoosher

public FileSmoosher(File baseDir)

FileSmoosher

public FileSmoosher(File baseDir,
            int maxChunkSize)

Method Detail

getInternalFilenames

public Set<String> getInternalFilenames()

add

public void add(File fileToAdd)
         throws IOException

Throws:

IOException

add

public void add(String name,
       File fileToAdd)
         throws IOException

Throws:

IOException

add

public void add(String name,
       ByteBuffer bufferToAdd)
         throws IOException

Throws:

IOException

add

public void add(String name,
       List<ByteBuffer> bufferToAdd)
         throws IOException

Throws:

IOException

addWithSmooshedWriter

public SmooshedWriter addWithSmooshedWriter(String name,
                                   long size)
                                     throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException