org.apache.hadoop.hbase.mob

类 DefaultMobStoreCompactor

java.lang.Object

org.apache.hadoop.hbase.regionserver.compactions.Compactor<StoreFileWriter>

org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor

org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor

@InterfaceAudience.Private
public class DefaultMobStoreCompactor
extends DefaultCompactor

Compact passed set of files in the mob-enabled column family.

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.hbase.regionserver.compactions.Compactor

Compactor.CellSinkFactory<S>, Compactor.FileDetails, Compactor.InternalScannerFactory

字段概要

从类继承的字段 org.apache.hadoop.hbase.regionserver.compactions.Compactor

COMPACTION_PROGRESS_LOG_INTERVAL, compactionCompression, compactionKVMax, conf, defaultScannerFactory, keepSeqIdPeriod, MAJOR_COMPACTION_DROP_CACHE, MINOR_COMPACTION_DROP_CACHE, progress, store

构造器概要

构造器

构造器和说明
DefaultMobStoreCompactor(org.apache.hadoop.conf.Configuration conf, HStore store)

方法概要

限定符和类型	方法和说明
List<org.apache.hadoop.fs.Path>	compact(CompactionRequestImpl request, ThroughputController throughputController, User user) Do a minor/major compaction on an explicit set of storefiles from a Store.
protected boolean	performCompaction(Compactor.FileDetails fd, InternalScanner scanner, CellSink writer, long smallestReadPoint, boolean cleanSeqId, ThroughputController throughputController, boolean major, int numofFilesToCompact) Performs compaction on a column family with the mob flag enabled.

从类继承的方法 org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor

abortWriter, commitWriter, compactForTesting

从类继承的方法 org.apache.hadoop.hbase.regionserver.compactions.Compactor

compact, createScanner, createScanner, createTmpWriter, getProgress

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DefaultMobStoreCompactor

public DefaultMobStoreCompactor(org.apache.hadoop.conf.Configuration conf,
                                HStore store)

方法详细资料

compact

public List<org.apache.hadoop.fs.Path> compact(CompactionRequestImpl request,
                                               ThroughputController throughputController,
                                               User user)
                                        throws IOException

从类复制的说明: DefaultCompactor

Do a minor/major compaction on an explicit set of storefiles from a Store.

覆盖:

compact 在类中 DefaultCompactor

抛出:

IOException

performCompaction

protected boolean performCompaction(Compactor.FileDetails fd,
                                    InternalScanner scanner,
                                    CellSink writer,
                                    long smallestReadPoint,
                                    boolean cleanSeqId,
                                    ThroughputController throughputController,
                                    boolean major,
                                    int numofFilesToCompact)
                             throws IOException

Performs compaction on a column family with the mob flag enabled. This is for when the mob threshold size has changed or if the mob column family mode has been toggled via an alter table statement. Compacts the files by the following rules. 1. If the Put cell has a mob reference tag, the cell's value is the path of the mob file.

1. If the value size of a cell is larger than the threshold, this cell is regarded as a mob, directly copy the (with mob tag) cell into the new store file.
2. Otherwise, retrieve the mob cell from the mob file, and writes a copy of the cell into the new store file.

2. If the Put cell doesn't have a reference tag.

1. If the value size of a cell is larger than the threshold, this cell is regarded as a mob, write this cell to a mob file, and write the path of this mob file to the store file.
2. Otherwise, directly write this cell into the store file.

3. Decide how to write a Delete cell.

1. If a Delete cell does not have a mob reference tag which means this delete marker have not been written to the mob del file, write this cell to the mob del file, and write this cell with a ref tag to a store file.
2. Otherwise, directly write it to a store file.

After the major compaction on the normal hfiles, we have a guarantee that we have purged all deleted or old version mob refs, and the delete markers are written to a del file with the suffix _del. Because of this, it is safe to use the del file in the mob compaction. The mob compaction doesn't take place in the normal hfiles, it occurs directly in the mob files. When the small mob files are merged into bigger ones, the del file is added into the scanner to filter the deleted cells.

覆盖:

performCompaction 在类中 Compactor<StoreFileWriter>

参数:

fd - File details

scanner - Where to read from.

writer - Where to write to.

smallestReadPoint - Smallest read point.

cleanSeqId - When true, remove seqId(used to be mvcc) value which is <= smallestReadPoint

throughputController - The compaction throughput controller.

major - Is a major compaction.

numofFilesToCompact - the number of files to compact

返回:

Whether compaction ended; false if it was interrupted for any reason.

抛出:

IOException