org.apache.hadoop.hbase.regionserver

Class AbstractMemStore

java.lang.Object

org.apache.hadoop.hbase.regionserver.AbstractMemStore

All Implemented Interfaces:

MemStore

Direct Known Subclasses:

CompactingMemStore, DefaultMemStore

@InterfaceAudience.Private
public abstract class AbstractMemStore
extends Object
implements MemStore

An abstract class, which implements the behaviour shared by all concrete memstore instances.

Field Summary

Fields

Modifier and Type	Field and Description
static long	DEEP_OVERHEAD
static long	FIXED_OVERHEAD
protected RegionServicesForStores	regionServices
protected ImmutableSegment	snapshot
protected long	snapshotId

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractMemStore(org.apache.hadoop.conf.Configuration conf, CellComparator c, RegionServicesForStores regionServices)

Method Summary

Modifier and Type	Method and Description
void	add(Cell cell, MemStoreSizing memstoreSizing) Write an update
void	add(Iterable<Cell> cells, MemStoreSizing memstoreSizing) Write the updates
static void	addToScanners(List<? extends Segment> segments, long readPt, List<KeyValueScanner> scanners)
protected static void	addToScanners(Segment segment, long readPt, List<KeyValueScanner> scanners)
void	clearSnapshot(long id) This method is protected under HStore write lock. The passed snapshot was successfully persisted; it can be let go.
protected void	doAdd(MutableSegment currentActive, Cell cell, MemStoreSizing memstoreSizing)
protected void	doClearSnapShot()
protected void	dump(org.slf4j.Logger log)
protected CellComparator	getComparator()
protected org.apache.hadoop.conf.Configuration	getConfiguration()
protected Cell	getLowest(Cell a, Cell b)
protected Cell	getNextRow(Cell key, NavigableSet<Cell> set)
protected abstract List<Segment>	getSegments() Returns an ordered list of segments from most recent to oldest in memstore
MemStoreSize	getSnapshotSize() Return the size of the snapshot(s) if any
protected abstract long	heapSize()
protected abstract long	keySize() Returns The total size of cells in this memstore.
protected abstract void	postUpdate(MutableSegment currentActive) Issue any post update synchronization and tests
protected abstract boolean	preUpdate(MutableSegment currentActive, Cell cell, MemStoreSizing memstoreSizing) Issue any synchronization and test needed before applying the update
protected void	resetActive()
protected void	resetTimeOfOldestEdit()
protected abstract boolean	sizeAddedPreOperation()
long	timeOfOldestEdit() Returns Oldest timestamp of all the Cells in the MemStore
String	toString()
abstract void	updateLowestUnflushedSequenceIdInWAL(boolean onlyIfMoreRecent) Updates the wal with the lowest sequence id (oldest entry) that is still in memory
void	upsert(Iterable<Cell> cells, long readpoint, MemStoreSizing memstoreSizing) Update or insert the specified cells.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.regionserver.MemStore

getFlushableSize, getScanners, isSloppy, preFlushSeqIDEstimation, size, snapshot, startReplayingFromWAL, stopReplayingFromWAL

Field Detail

snapshot

protected volatile ImmutableSegment snapshot

snapshotId

protected volatile long snapshotId

regionServices

protected RegionServicesForStores regionServices

FIXED_OVERHEAD

public static final long FIXED_OVERHEAD

DEEP_OVERHEAD

public static final long DEEP_OVERHEAD

Constructor Detail

AbstractMemStore

protected AbstractMemStore(org.apache.hadoop.conf.Configuration conf,
                           CellComparator c,
                           RegionServicesForStores regionServices)

Method Detail

addToScanners

public static void addToScanners(List<? extends Segment> segments,
                                 long readPt,
                                 List<KeyValueScanner> scanners)

addToScanners

protected static void addToScanners(Segment segment,
                                    long readPt,
                                    List<KeyValueScanner> scanners)

resetActive

protected void resetActive()

resetTimeOfOldestEdit

protected void resetTimeOfOldestEdit()

updateLowestUnflushedSequenceIdInWAL

public abstract void updateLowestUnflushedSequenceIdInWAL(boolean onlyIfMoreRecent)

Updates the wal with the lowest sequence id (oldest entry) that is still in memory

Parameters:

onlyIfMoreRecent - a flag that marks whether to update the sequence id no matter what or only if it is greater than the previous sequence id

add

public void add(Iterable<Cell> cells,
                MemStoreSizing memstoreSizing)

Description copied from interface: MemStore

Write the updates

Specified by:

add in interface MemStore

memstoreSizing - The delta in memstore size will be passed back via this. This will include both data size and heap overhead delta.

add

public void add(Cell cell,
                MemStoreSizing memstoreSizing)

Description copied from interface: MemStore

Write an update

Specified by:

add in interface MemStore

memstoreSizing - The delta in memstore size will be passed back via this. This will include both data size and heap overhead delta.

doAdd

protected void doAdd(MutableSegment currentActive,
                     Cell cell,
                     MemStoreSizing memstoreSizing)

preUpdate

protected abstract boolean preUpdate(MutableSegment currentActive,
                                     Cell cell,
                                     MemStoreSizing memstoreSizing)

Issue any synchronization and test needed before applying the update

Parameters:

currentActive - the segment to be updated

cell - the cell to be added

memstoreSizing - object to accumulate region size changes

Returns:

true iff can proceed with applying the update

postUpdate

protected abstract void postUpdate(MutableSegment currentActive)

Issue any post update synchronization and tests

Parameters:

currentActive - updated segment

upsert

public void upsert(Iterable<Cell> cells,
                   long readpoint,
                   MemStoreSizing memstoreSizing)

Description copied from interface: MemStore

Update or insert the specified cells.

For each Cell, insert into MemStore. This will atomically upsert the value for that row/family/qualifier. If a Cell did already exist, it will then be removed.

Currently the memstoreTS is kept at 0 so as each insert happens, it will be immediately visible. May want to change this so it is atomic across all KeyValues.

This is called under row lock, so Get operations will still see updates atomically. Scans will only see each KeyValue update as atomic.

Specified by:

upsert in interface MemStore

readpoint - readpoint below which we can safely remove duplicate Cells.

memstoreSizing - The delta in memstore size will be passed back via this. This will include both data size and heap overhead delta.

timeOfOldestEdit

public long timeOfOldestEdit()

Returns Oldest timestamp of all the Cells in the MemStore

Specified by:

timeOfOldestEdit in interface MemStore

clearSnapshot

public void clearSnapshot(long id)
                   throws UnexpectedStateException

This method is protected under HStore write lock.
The passed snapshot was successfully persisted; it can be let go.

Specified by:

clearSnapshot in interface MemStore

Parameters:

id - Id of the snapshot to clean out.

Throws:

UnexpectedStateException

See Also:

MemStore.snapshot()

doClearSnapShot

protected void doClearSnapShot()

getSnapshotSize

public MemStoreSize getSnapshotSize()

Description copied from interface: MemStore

Return the size of the snapshot(s) if any

Specified by:

getSnapshotSize in interface MemStore

Returns:

size of the memstore snapshot

toString

public String toString()

Overrides:

toString in class Object

getConfiguration

protected org.apache.hadoop.conf.Configuration getConfiguration()

dump

protected void dump(org.slf4j.Logger log)

getLowest

protected Cell getLowest(Cell a,
                         Cell b)

getNextRow

protected Cell getNextRow(Cell key,
                          NavigableSet<Cell> set)

sizeAddedPreOperation

protected abstract boolean sizeAddedPreOperation()

keySize

protected abstract long keySize()

Returns The total size of cells in this memstore. We will not consider cells in the snapshot

heapSize

protected abstract long heapSize()

Returns:

The total heap size of cells in this memstore. We will not consider cells in the snapshot

getComparator

protected CellComparator getComparator()

getSegments

protected abstract List<Segment> getSegments()
                                      throws IOException

Returns an ordered list of segments from most recent to oldest in memstore

Throws:

IOException