org.gridgain.grid.kernal.ggfs.hadoop

Class GridGgfsHadoopWrapper

java.lang.Object

org.gridgain.grid.kernal.ggfs.hadoop.GridGgfsHadoopWrapper

All Implemented Interfaces:

GridGgfsHadoop

public class GridGgfsHadoopWrapper
extends Object
implements GridGgfsHadoop

Wrapper for GGFS server.

Constructor Summary

Constructors

Constructor and Description
GridGgfsHadoopWrapper(String authority, String logDir, org.apache.hadoop.conf.Configuration conf, org.apache.commons.logging.Log log) Constructor.

Method Summary

Methods

Modifier and Type	Method and Description
Collection<org.gridgain.grid.ggfs.GridGgfsBlockLocation>	affinity(org.gridgain.grid.ggfs.GridGgfsPath path, long start, long len) Command to get affinity for given path, offset and length.
GridGgfsHadoopStreamDelegate	append(org.gridgain.grid.ggfs.GridGgfsPath path, boolean create, Map<String,String> props) Open file for output appending data to the end of a file.
void	close(boolean force) Close connection.
org.gridgain.grid.ggfs.GridGgfsPathSummary	contentSummary(org.gridgain.grid.ggfs.GridGgfsPath path) Gets path summary.
GridGgfsHadoopStreamDelegate	create(org.gridgain.grid.ggfs.GridGgfsPath path, boolean overwrite, boolean colocate, int replication, long blockSize, Map<String,String> props) Command to create file and open it for output.
Boolean	delete(org.gridgain.grid.ggfs.GridGgfsPath path, boolean recursive) Command to delete given path.
GridGgfsStatus	fsStatus() Performs status request.
GridGgfsHandshakeResponse	handshake(String logDir) Perform handshake.
org.gridgain.grid.ggfs.GridGgfsFile	info(org.gridgain.grid.ggfs.GridGgfsPath path) Command to retrieve file info for some GGFS path.
Collection<org.gridgain.grid.ggfs.GridGgfsFile>	listFiles(org.gridgain.grid.ggfs.GridGgfsPath path) Command to get list of files in directory.
Collection<org.gridgain.grid.ggfs.GridGgfsPath>	listPaths(org.gridgain.grid.ggfs.GridGgfsPath path) Command to get directory listing.
Boolean	mkdirs(org.gridgain.grid.ggfs.GridGgfsPath path, Map<String,String> props) Command to create directories.
GridGgfsHadoopStreamDelegate	open(org.gridgain.grid.ggfs.GridGgfsPath path) Command to open file for reading.
GridGgfsHadoopStreamDelegate	open(org.gridgain.grid.ggfs.GridGgfsPath path, int seqReadsBeforePrefetch) Command to open file for reading.
Boolean	rename(org.gridgain.grid.ggfs.GridGgfsPath src, org.gridgain.grid.ggfs.GridGgfsPath dest) Command to rename given path.
Boolean	setTimes(org.gridgain.grid.ggfs.GridGgfsPath path, long accessTime, long modificationTime) Sets last access time and last modification time for a file.
org.gridgain.grid.ggfs.GridGgfsFile	update(org.gridgain.grid.ggfs.GridGgfsPath path, Map<String,String> props) Command to update file properties.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridGgfsHadoopWrapper

public GridGgfsHadoopWrapper(String authority,
                     String logDir,
                     org.apache.hadoop.conf.Configuration conf,
                     org.apache.commons.logging.Log log)
                      throws IOException

Constructor.

Parameters:

authority - Authority (connection string).

logDir - Log directory for server.

conf - Configuration.

log - Current logger.

Throws:

IOException

Method Detail

handshake

public GridGgfsHandshakeResponse handshake(String logDir)
                                    throws IOException

Perform handshake.

Specified by:

handshake in interface GridGgfsHadoop

Parameters:

logDir - Log directory.

Returns:

Future with handshake result.

Throws:

IOException

close

public void close(boolean force)

Close connection.

Specified by:

close in interface GridGgfsHadoop

Parameters:

force - Force flag.

info

public org.gridgain.grid.ggfs.GridGgfsFile info(org.gridgain.grid.ggfs.GridGgfsPath path)
                                         throws IOException

Command to retrieve file info for some GGFS path.

Specified by:

info in interface GridGgfsHadoop

Parameters:

path - Path to get file info for.

Returns:

Future for info operation.

Throws:

IOException

update

public org.gridgain.grid.ggfs.GridGgfsFile update(org.gridgain.grid.ggfs.GridGgfsPath path,
                                         Map<String,String> props)
                                           throws IOException

Command to update file properties.

Specified by:

update in interface GridGgfsHadoop

Parameters:

path - GGFS path to update properties.

props - Properties to update.

Returns:

Future for update operation.

Throws:

IOException

setTimes

public Boolean setTimes(org.gridgain.grid.ggfs.GridGgfsPath path,
               long accessTime,
               long modificationTime)
                 throws IOException

Sets last access time and last modification time for a file.

Specified by:

setTimes in interface GridGgfsHadoop

Parameters:

path - Path to update times.

accessTime - Last access time to set.

modificationTime - Last modification time to set.

Throws:

IOException

rename

public Boolean rename(org.gridgain.grid.ggfs.GridGgfsPath src,
             org.gridgain.grid.ggfs.GridGgfsPath dest)
               throws IOException

Command to rename given path.

Specified by:

rename in interface GridGgfsHadoop

Parameters:

src - Source path.

dest - Destination path.

Returns:

Future for rename operation.

Throws:

IOException

delete

public Boolean delete(org.gridgain.grid.ggfs.GridGgfsPath path,
             boolean recursive)
               throws IOException

Command to delete given path.

Specified by:

delete in interface GridGgfsHadoop

Parameters:

path - Path to delete.

recursive - True if deletion is recursive.

Returns:

Future for delete operation.

Throws:

IOException

affinity

public Collection<org.gridgain.grid.ggfs.GridGgfsBlockLocation> affinity(org.gridgain.grid.ggfs.GridGgfsPath path,
                                                                long start,
                                                                long len)
                                                                  throws IOException

Command to get affinity for given path, offset and length.

Specified by:

affinity in interface GridGgfsHadoop

Parameters:

path - Path to get affinity for.

start - Start position (offset).

len - Data length.

Returns:

Future for affinity command.

Throws:

IOException

contentSummary

public org.gridgain.grid.ggfs.GridGgfsPathSummary contentSummary(org.gridgain.grid.ggfs.GridGgfsPath path)
                                                          throws IOException

Gets path summary.

Specified by:

contentSummary in interface GridGgfsHadoop

Parameters:

path - Path to get summary for.

Returns:

Future that will be completed when summary is received.

Throws:

IOException

mkdirs

public Boolean mkdirs(org.gridgain.grid.ggfs.GridGgfsPath path,
             Map<String,String> props)
               throws IOException

Command to create directories.

Specified by:

mkdirs in interface GridGgfsHadoop

Parameters:

path - Path to create.

Returns:

Future for mkdirs operation.

Throws:

IOException

listFiles

public Collection<org.gridgain.grid.ggfs.GridGgfsFile> listFiles(org.gridgain.grid.ggfs.GridGgfsPath path)
                                                          throws IOException

Command to get list of files in directory.

Specified by:

listFiles in interface GridGgfsHadoop

Parameters:

path - Path to list.

Returns:

Future for listFiles operation.

Throws:

IOException

listPaths

public Collection<org.gridgain.grid.ggfs.GridGgfsPath> listPaths(org.gridgain.grid.ggfs.GridGgfsPath path)
                                                          throws IOException

Command to get directory listing.

Specified by:

listPaths in interface GridGgfsHadoop

Parameters:

path - Path to list.

Returns:

Future for listPaths operation.

Throws:

IOException

fsStatus

public GridGgfsStatus fsStatus()
                        throws IOException

Performs status request.

Specified by:

fsStatus in interface GridGgfsHadoop

Returns:

Status response.

Throws:

IOException

open

public GridGgfsHadoopStreamDelegate open(org.gridgain.grid.ggfs.GridGgfsPath path)
                                  throws IOException

Command to open file for reading.

Specified by:

open in interface GridGgfsHadoop

Parameters:

path - File path to open.

Returns:

Future for open operation.

Throws:

IOException

open

public GridGgfsHadoopStreamDelegate open(org.gridgain.grid.ggfs.GridGgfsPath path,
                                int seqReadsBeforePrefetch)
                                  throws IOException

Command to open file for reading.

Specified by:

open in interface GridGgfsHadoop

Parameters:

path - File path to open.

Returns:

Future for open operation.

Throws:

IOException

create

public GridGgfsHadoopStreamDelegate create(org.gridgain.grid.ggfs.GridGgfsPath path,
                                  boolean overwrite,
                                  boolean colocate,
                                  int replication,
                                  long blockSize,
                                  @Nullable
                                  Map<String,String> props)
                                    throws IOException

Command to create file and open it for output.

Specified by:

create in interface GridGgfsHadoop

Parameters:

path - Path to file.

overwrite - If true then old file contents will be lost.

colocate - If true and called on data node, file will be written on that node.

replication - Replication factor.

props - File properties for creation.

Returns:

Stream descriptor.

Throws:

IOException

append

public GridGgfsHadoopStreamDelegate append(org.gridgain.grid.ggfs.GridGgfsPath path,
                                  boolean create,
                                  @Nullable
                                  Map<String,String> props)
                                    throws IOException

Open file for output appending data to the end of a file.

Specified by:

append in interface GridGgfsHadoop

Parameters:

path - Path to file.

create - If true, file will be created if does not exist.

props - File properties.

Returns:

Stream descriptor.

Throws:

IOException