org.gridgain.grid.kernal.processors.ggfs

Class GridGgfsDataManager

java.lang.Object

org.gridgain.grid.kernal.processors.ggfs.GridGgfsManager

org.gridgain.grid.kernal.processors.ggfs.GridGgfsDataManager

public class GridGgfsDataManager
extends GridGgfsManager

Cache based file's data container.

Field Summary

Fields inherited from class org.gridgain.grid.kernal.processors.ggfs.GridGgfsManager

ggfsCtx, log

Constructor Summary

Constructors

Constructor and Description
GridGgfsDataManager()

Method Summary

Methods

Modifier and Type	Method and Description
Collection<org.gridgain.grid.ggfs.GridGgfsBlockLocation>	affinity(GridGgfsFileInfo info, long start, long len) Resolve affinity nodes for specified part of file.
Collection<org.gridgain.grid.ggfs.GridGgfsBlockLocation>	affinity(GridGgfsFileInfo info, long start, long len, long maxLen) Resolve affinity nodes for specified part of file.
org.gridgain.grid.GridNode	affinityNode(Object affinityKey) Maps affinity key to node.
GridGgfsBlockKey	blockKey(long blockIdx, GridGgfsFileInfo fileInfo)
void	cleanBlocks(GridGgfsFileInfo fileInfo, GridGgfsFileAffinityRange range, boolean cleanNonColocated) Tries to remove blocks affected by fragmentizer.
org.gridgain.grid.GridFuture<byte[]>	dataBlock(GridGgfsFileInfo fileInfo, org.gridgain.grid.ggfs.GridGgfsPath path, long blockIdx, GridGgfsSecondaryInputStreamWrapper inWrapper) Get data block for specified file ID and block index.
org.gridgain.grid.GridFuture<Object>	delete(GridGgfsFileInfo fileInfo) Delete file's data from data cache.
long	groupBlockSize() Gets group block size (block size * group size).
List<Long>	listLocalDataBlocks(GridGgfsFileInfo fileInfo) Get list of local data blocks of the given file.
long	maxSpaceSize()
org.gridgain.grid.GridUuid	nextAffinityKey(org.gridgain.grid.GridUuid prevAffKey) Generates next affinity key for local node based on current topology.
protected void	onKernalStart0()
protected void	onKernalStop0(boolean cancel)
long	spaceSize()
void	spreadBlocks(GridGgfsFileInfo fileInfo, GridGgfsFileAffinityRange range) Moves all colocated blocks in range to non-colocated keys.
protected void	start0() Start manager implementation.
byte[]	storeDataBlocks(GridGgfsFileInfo fileInfo, long reservedLen, byte[] remainder, int remainderLen, ByteBuffer data, boolean flush, GridGgfsFileAffinityRange affinityRange, GridGgfsFileWorkerBatch batch) Store data blocks in file. Note! If file concurrently deleted we'll get lost blocks.
byte[]	storeDataBlocks(GridGgfsFileInfo fileInfo, long reservedLen, byte[] remainder, int remainderLen, DataInput in, int len, boolean flush, GridGgfsFileAffinityRange affinityRange, GridGgfsFileWorkerBatch batch) Store data blocks in file. Note! If file concurrently deleted we'll got lost blocks.
void	writeClose(GridGgfsFileInfo fileInfo) Notifies data manager that no further writes will be performed on stream.
org.gridgain.grid.GridFuture<Boolean>	writeStart(GridGgfsFileInfo fileInfo) Registers write future in ggfs data manager.

Methods inherited from class org.gridgain.grid.kernal.processors.ggfs.GridGgfsManager

kernalStartInfo, kernalStopInfo, onKernalStart, onKernalStop, start, startInfo, stop, stop0, stopInfo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridGgfsDataManager

public GridGgfsDataManager()

Method Detail

start0

protected void start0()
               throws org.gridgain.grid.GridException

Start manager implementation.

Overrides:

start0 in class GridGgfsManager

Throws:

org.gridgain.grid.GridException

onKernalStart0

protected void onKernalStart0()
                       throws org.gridgain.grid.GridException

Overrides:

onKernalStart0 in class GridGgfsManager

Throws:

org.gridgain.grid.GridException - If failed.

onKernalStop0

protected void onKernalStop0(boolean cancel)

Overrides:

onKernalStop0 in class GridGgfsManager

spaceSize

public long spaceSize()

Returns:

Number of bytes used to store files.

maxSpaceSize

public long maxSpaceSize()

Returns:

Maximum number of bytes for GGFS data cache.

nextAffinityKey

public org.gridgain.grid.GridUuid nextAffinityKey(@Nullable
                                         org.gridgain.grid.GridUuid prevAffKey)

Generates next affinity key for local node based on current topology. If previous affinity key maps on local node, return previous affinity key to prevent unnecessary file map growth.

Parameters:

prevAffKey - Affinity key of previous block.

Returns:

Affinity key.

affinityNode

public org.gridgain.grid.GridNode affinityNode(Object affinityKey)

Maps affinity key to node.

Parameters:

affinityKey - Affinity key to map.

Returns:

Primary node for this key.

listLocalDataBlocks

public List<Long> listLocalDataBlocks(GridGgfsFileInfo fileInfo)
                               throws org.gridgain.grid.GridException

Get list of local data blocks of the given file.

Parameters:

fileInfo - File info.

Returns:

List of local data block indices.

Throws:

org.gridgain.grid.GridException - If failed.

dataBlock

@Nullable
public org.gridgain.grid.GridFuture<byte[]> dataBlock(GridGgfsFileInfo fileInfo,
                                                      org.gridgain.grid.ggfs.GridGgfsPath path,
                                                      long blockIdx,
                                                      @Nullable
                                                      GridGgfsSecondaryInputStreamWrapper inWrapper)
                                               throws org.gridgain.grid.GridException

Get data block for specified file ID and block index.

Parameters:

fileInfo - File info.

path - Path reading from.

blockIdx - Block index.

inWrapper - Optional secondary file system input stream wrapper.

Returns:

Requested data block or null if nothing found.

Throws:

org.gridgain.grid.GridException - If failed.

writeStart

public org.gridgain.grid.GridFuture<Boolean> writeStart(GridGgfsFileInfo fileInfo)

Registers write future in ggfs data manager.

Parameters:

fileInfo - File info of file opened to write.

Returns:

Future that will be completed when all ack messages are received or when write failed.

writeClose

public void writeClose(GridGgfsFileInfo fileInfo)

Notifies data manager that no further writes will be performed on stream.

Parameters:

fileInfo - File info being written.

storeDataBlocks

@Nullable
public byte[] storeDataBlocks(GridGgfsFileInfo fileInfo,
                              long reservedLen,
                              @Nullable
                              byte[] remainder,
                              int remainderLen,
                              ByteBuffer data,
                              boolean flush,
                              GridGgfsFileAffinityRange affinityRange,
                              @Nullable
                              GridGgfsFileWorkerBatch batch)
                       throws org.gridgain.grid.GridException

Store data blocks in file.
Note! If file concurrently deleted we'll get lost blocks.

Parameters:

fileInfo - File info.

reservedLen - Reserved length.

remainder - Remainder.

remainderLen - Remainder length.

data - Data to store.

flush - Flush flag.

affinityRange - Affinity range to update if file write can be colocated.

batch - Optional secondary file system worker batch.

Returns:

Remainder if data did not fill full block.

Throws:

org.gridgain.grid.GridException - If failed.

storeDataBlocks

@Nullable
public byte[] storeDataBlocks(GridGgfsFileInfo fileInfo,
                              long reservedLen,
                              @Nullable
                              byte[] remainder,
                              int remainderLen,
                              DataInput in,
                              int len,
                              boolean flush,
                              GridGgfsFileAffinityRange affinityRange,
                              @Nullable
                              GridGgfsFileWorkerBatch batch)
                       throws org.gridgain.grid.GridException,
                              IOException

Store data blocks in file.
Note! If file concurrently deleted we'll got lost blocks.

Parameters:

fileInfo - File info.

reservedLen - Reserved length.

remainder - Remainder.

remainderLen - Remainder length.

in - Data to store.

len - Data length to store.

flush - Flush flag.

affinityRange - File affinity range to update if file cal be colocated.

batch - Optional secondary file system worker batch.

Returns:

Remainder of data that did not fit the block if flush flag is false.

Throws:

org.gridgain.grid.GridException - If failed.

IOException - If store failed.

delete

public org.gridgain.grid.GridFuture<Object> delete(GridGgfsFileInfo fileInfo)

Delete file's data from data cache.

Parameters:

fileInfo - File details to remove data for.

Returns:

Delete future that will be completed when file is actually erased.

blockKey

public GridGgfsBlockKey blockKey(long blockIdx,
                        GridGgfsFileInfo fileInfo)

Parameters:

blockIdx - Block index.

fileInfo - File info.

Returns:

Block key.

cleanBlocks

public void cleanBlocks(GridGgfsFileInfo fileInfo,
               GridGgfsFileAffinityRange range,
               boolean cleanNonColocated)

Tries to remove blocks affected by fragmentizer. If cleanNonColocated is true, will remove non-colocated blocks as well.

Parameters:

fileInfo - File info to clean up.

range - Range to clean up.

cleanNonColocated - True if all blocks should be cleaned.

spreadBlocks

public void spreadBlocks(GridGgfsFileInfo fileInfo,
                GridGgfsFileAffinityRange range)

Moves all colocated blocks in range to non-colocated keys.

Parameters:

fileInfo - File info to move data for.

range - Range to move.

affinity

public Collection<org.gridgain.grid.ggfs.GridGgfsBlockLocation> affinity(GridGgfsFileInfo info,
                                                                long start,
                                                                long len)
                                                                  throws org.gridgain.grid.GridException

Resolve affinity nodes for specified part of file.

Parameters:

info - File info to resolve affinity nodes for.

start - Start position in the file.

len - File part length to get affinity for.

Returns:

Affinity blocks locations.

Throws:

org.gridgain.grid.GridException - If failed.

affinity

public Collection<org.gridgain.grid.ggfs.GridGgfsBlockLocation> affinity(GridGgfsFileInfo info,
                                                                long start,
                                                                long len,
                                                                long maxLen)
                                                                  throws org.gridgain.grid.GridException

Resolve affinity nodes for specified part of file.

Parameters:

info - File info to resolve affinity nodes for.

start - Start position in the file.

len - File part length to get affinity for.

maxLen - Maximum block length.

Returns:

Affinity blocks locations.

Throws:

org.gridgain.grid.GridException - If failed.

groupBlockSize

public long groupBlockSize()

Gets group block size (block size * group size).

Returns:

Group block size.