org.apache.hadoop.hbase.regionserver.compactions

类 FIFOCompactionPolicy

java.lang.Object

org.apache.hadoop.hbase.regionserver.compactions.CompactionPolicy

org.apache.hadoop.hbase.regionserver.compactions.SortedCompactionPolicy

org.apache.hadoop.hbase.regionserver.compactions.RatioBasedCompactionPolicy

org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy

org.apache.hadoop.hbase.regionserver.compactions.FIFOCompactionPolicy

@InterfaceAudience.Private
public class FIFOCompactionPolicy
extends ExploringCompactionPolicy

FIFO compaction policy selects only files which have all cells expired. The column family MUST have non-default TTL. One of the use cases for this policy is when we need to store raw data which will be post-processed later and discarded completely after quite short period of time. Raw time-series vs. time-based roll up aggregates and compacted time-series. We collect raw time-series and store them into CF with FIFO compaction policy, periodically we run task which creates roll up aggregates and compacts time-series, the original raw data can be discarded after that.

字段概要

从类继承的字段 org.apache.hadoop.hbase.regionserver.compactions.CompactionPolicy

comConf, storeConfigInfo

构造器概要

构造器

构造器和说明
FIFOCompactionPolicy(org.apache.hadoop.conf.Configuration conf, StoreConfigInformation storeConfigInfo)

方法概要

限定符和类型	方法和说明
boolean	needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting) A heuristic method to decide whether to schedule a compaction request
CompactionRequestImpl	selectCompaction(Collection<HStoreFile> candidateFiles, List<HStoreFile> filesCompacting, boolean isUserCompaction, boolean mayUseOffPeak, boolean forceMajor)
boolean	shouldPerformMajorCompaction(Collection<HStoreFile> filesToCompact)

从类继承的方法 org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy

applyCompactionPolicy, applyCompactionPolicy

从类继承的方法 org.apache.hadoop.hbase.regionserver.compactions.RatioBasedCompactionPolicy

createCompactionRequest, setMinThreshold

从类继承的方法 org.apache.hadoop.hbase.regionserver.compactions.SortedCompactionPolicy

checkMinFilesCriteria, filterBulk, getCurrentEligibleFiles, getNextMajorCompactTime, preSelectCompactionForCoprocessor, removeExcessFiles, skipLargeFiles, throttleCompaction

从类继承的方法 org.apache.hadoop.hbase.regionserver.compactions.CompactionPolicy

getConf, setConf

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

FIFOCompactionPolicy

public FIFOCompactionPolicy(org.apache.hadoop.conf.Configuration conf,
                            StoreConfigInformation storeConfigInfo)

方法详细资料

selectCompaction

public CompactionRequestImpl selectCompaction(Collection<HStoreFile> candidateFiles,
                                              List<HStoreFile> filesCompacting,
                                              boolean isUserCompaction,
                                              boolean mayUseOffPeak,
                                              boolean forceMajor)
                                       throws IOException

覆盖:

selectCompaction 在类中 SortedCompactionPolicy

参数:

candidateFiles - candidate files, ordered from oldest to newest by seqId. We rely on DefaultStoreFileManager to sort the files by seqId to guarantee contiguous compaction based on seqId for data consistency.

返回:

subset copy of candidate list that meets compaction criteria

抛出:

IOException

shouldPerformMajorCompaction

public boolean shouldPerformMajorCompaction(Collection<HStoreFile> filesToCompact)
                                     throws IOException

覆盖:

shouldPerformMajorCompaction 在类中 RatioBasedCompactionPolicy

参数:

filesToCompact - Files to compact. Can be null.

返回:

True if we should run a major compaction.

抛出:

IOException

needsCompaction

public boolean needsCompaction(Collection<HStoreFile> storeFiles,
                               List<HStoreFile> filesCompacting)

从类复制的说明: RatioBasedCompactionPolicy

A heuristic method to decide whether to schedule a compaction request

覆盖:

needsCompaction 在类中 RatioBasedCompactionPolicy

参数:

storeFiles - files in the store.

filesCompacting - files being scheduled to compact.

返回:

true to schedule a request.