类的使用
org.apache.hadoop.hbase.regionserver.HStoreFile

使用HStoreFile的程序包

程序包	说明
org.apache.hadoop.hbase.backup
org.apache.hadoop.hbase.mob
org.apache.hadoop.hbase.mob.compactions
org.apache.hadoop.hbase.regionserver
org.apache.hadoop.hbase.regionserver.compactions

org.apache.hadoop.hbase.backup中HStoreFile的使用

类型变量类型为HStoreFile的org.apache.hadoop.hbase.backup中的方法参数

限定符和类型	方法和说明
static void	HFileArchiver.archiveStoreFiles(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, RegionInfo regionInfo, org.apache.hadoop.fs.Path tableDir, byte[] family, Collection<HStoreFile> compactedFiles) Remove the store files, either by archiving them or outright deletion

org.apache.hadoop.hbase.mob中HStoreFile的使用

类型变量类型为HStoreFile的org.apache.hadoop.hbase.mob中的方法参数

限定符和类型	方法和说明
static void	MobUtils.removeMobFiles(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, TableName tableName, org.apache.hadoop.fs.Path tableDir, byte[] family, Collection<HStoreFile> storeFiles) Archives the mob files.

参数类型为HStoreFile的org.apache.hadoop.hbase.mob中的构造器

构造器和说明
CachedMobFile(HStoreFile sf)
MobFile(HStoreFile sf)

org.apache.hadoop.hbase.mob.compactions中HStoreFile的使用

返回变量类型为HStoreFile的类型的org.apache.hadoop.hbase.mob.compactions中的方法

限定符和类型	方法和说明
List<HStoreFile>	PartitionedMobCompactionRequest.CompactionDelPartition.getStoreFiles()

参数类型为HStoreFile的org.apache.hadoop.hbase.mob.compactions中的方法

限定符和类型	方法和说明
void	PartitionedMobCompactionRequest.CompactionDelPartition.addStoreFile(HStoreFile file)

org.apache.hadoop.hbase.regionserver中HStoreFile的使用

返回HStoreFile的org.apache.hadoop.hbase.regionserver中的方法

限定符和类型	方法和说明
protected HStoreFile	HStore.createStoreFileAndReader(org.apache.hadoop.fs.Path p)

返回变量类型为HStoreFile的类型的org.apache.hadoop.hbase.regionserver中的方法

限定符和类型	方法和说明
Collection<HStoreFile>	StoreFileManager.clearCompactedFiles() Clears all the compacted files and returns them.
org.apache.hbase.thirdparty.com.google.common.collect.ImmutableCollection<HStoreFile>	StripeStoreFileManager.clearCompactedFiles()
org.apache.hbase.thirdparty.com.google.common.collect.ImmutableCollection<HStoreFile>	StoreFileManager.clearFiles() Clears all the files currently in use and returns them.
org.apache.hbase.thirdparty.com.google.common.collect.ImmutableCollection<HStoreFile>	StripeStoreFileManager.clearFiles()
Map<byte[],List<HStoreFile>>	HRegion.close() Close down this HRegion.
org.apache.hbase.thirdparty.com.google.common.collect.ImmutableCollection<HStoreFile>	HStore.close() Close all the readers We don't need to worry about subsequent requests because the Region holds a write lock that will prevent any more reads or writes.
Map<byte[],List<HStoreFile>>	HRegion.close(boolean abort) Close down this HRegion.
List<HStoreFile>	HStore.compact(CompactionContext compaction, ThroughputController throughputController, User user) Compact the StoreFiles.
protected List<HStoreFile>	HStore.doCompaction(CompactionRequestImpl cr, Collection<HStoreFile> filesToCompact, User user, long compactionStartTime, List<org.apache.hadoop.fs.Path> newFiles)
Iterator<HStoreFile>	StoreFileManager.getCandidateFilesForRowKeyBefore(KeyValue targetKey) Gets initial, full list of candidate store files to check for row-key-before.
Iterator<HStoreFile>	StripeStoreFileManager.getCandidateFilesForRowKeyBefore(KeyValue targetKey) See StoreFileManager.getCandidateFilesForRowKeyBefore(KeyValue) for details on this methods.
Collection<HStoreFile>	StoreFileManager.getCompactedfiles() List of compacted files inside this store that needs to be excluded in reads because further new reads will be using only the newly created files out of compaction.
Collection<HStoreFile>	StripeStoreFileManager.getCompactedfiles()
Collection<HStoreFile>	HStore.getCompactedFiles()
Collection<HStoreFile>	StoreFileManager.getFilesForScan(byte[] startRow, boolean includeStartRow, byte[] stopRow, boolean includeStopRow) Gets the store files to scan for a Scan or Get request.
Collection<HStoreFile>	StripeStoreFileManager.getFilesForScan(byte[] startRow, boolean includeStartRow, byte[] stopRow, boolean includeStopRow)
List<HStoreFile>	StripeStoreFileManager.getLevel0Files()
Comparator<HStoreFile>	StoreFileManager.getStoreFileComparator()
Comparator<HStoreFile>	StripeStoreFileManager.getStoreFileComparator()
Collection<HStoreFile>	StoreFileManager.getStorefiles() Gets the snapshot of the store files currently in use.
Collection<HStoreFile>	HStore.getStorefiles()
Collection<HStoreFile>	StripeStoreFileManager.getStorefiles()
ArrayList<org.apache.hbase.thirdparty.com.google.common.collect.ImmutableList<HStoreFile>>	StripeStoreFileManager.getStripes()
Collection<HStoreFile>	StoreFileManager.getUnneededFiles(long maxTs, List<HStoreFile> filesCompacting)
Collection<HStoreFile>	StripeStoreFileManager.getUnneededFiles(long maxTs, List<HStoreFile> filesCompacting)
Iterator<HStoreFile>	StoreFileManager.updateCandidateFilesForRowKeyBefore(Iterator<HStoreFile> candidateFiles, KeyValue targetKey, Cell candidate) Updates the candidate list for finding row key before.
Iterator<HStoreFile>	StripeStoreFileManager.updateCandidateFilesForRowKeyBefore(Iterator<HStoreFile> candidateFiles, KeyValue targetKey, Cell candidate) See StoreFileManager.getCandidateFilesForRowKeyBefore(KeyValue) and StoreFileManager.updateCandidateFilesForRowKeyBefore(Iterator, KeyValue, Cell) for details on this methods.

参数类型为HStoreFile的org.apache.hadoop.hbase.regionserver中的方法

限定符和类型	方法和说明
org.apache.hadoop.fs.Path	HRegionFileSystem.mergeStoreFile(RegionInfo mergedRegion, String familyName, HStoreFile f, org.apache.hadoop.fs.Path mergedDir) Write out a merge reference under the given merges directory.
void	RegionCoprocessorHost.postCompact(HStore store, HStoreFile resultFile, CompactionLifeCycleTracker tracker, CompactionRequest request, User user) Called after the store compaction has completed.
void	RegionCoprocessorHost.postFlush(HStore store, HStoreFile storeFile, FlushLifeCycleTracker tracker) Invoked after a memstore flush
org.apache.hadoop.fs.Path	HRegionFileSystem.splitStoreFile(RegionInfo hri, String familyName, HStoreFile f, byte[] splitRow, boolean top, RegionSplitPolicy splitPolicy) Write out a split reference.

类型变量类型为HStoreFile的org.apache.hadoop.hbase.regionserver中的方法参数

限定符和类型	方法和说明
void	StoreFileManager.addCompactionResults(Collection<HStoreFile> compactedFiles, Collection<HStoreFile> results) Adds only the new compaction results into the structure.
void	StoreFileManager.addCompactionResults(Collection<HStoreFile> compactedFiles, Collection<HStoreFile> results) Adds only the new compaction results into the structure.
void	StripeStoreFileManager.addCompactionResults(Collection<HStoreFile> compactedFiles, Collection<HStoreFile> results)
void	StripeStoreFileManager.addCompactionResults(Collection<HStoreFile> compactedFiles, Collection<HStoreFile> results)
protected void	HStore.completeCompaction(Collection<HStoreFile> compactedFiles) It works by processing a compaction that's been written to disk.
protected List<HStoreFile>	HStore.doCompaction(CompactionRequestImpl cr, Collection<HStoreFile> filesToCompact, User user, long compactionStartTime, List<org.apache.hadoop.fs.Path> newFiles)
static OptionalInt	StoreUtils.getDeterministicRandomSeed(Collection<HStoreFile> files) Creates a deterministic hash code for store file collection.
static long	StoreUtils.getLowestTimestamp(Collection<HStoreFile> candidates) Gets lowest timestamp from candidate StoreFiles
static OptionalLong	StoreUtils.getMaxMemStoreTSInList(Collection<HStoreFile> sfs) Return the largest memstoreTS found across all storefiles in the given list.
static OptionalLong	StoreUtils.getMaxSequenceIdInList(Collection<HStoreFile> sfs) Return the highest sequence ID found across all storefiles in the given list.
List<KeyValueScanner>	HStore.getScanners(List<HStoreFile> files, boolean cacheBlocks, boolean isGet, boolean usePread, boolean isCompaction, ScanQueryMatcher matcher, byte[] startRow, byte[] stopRow, long readPt, boolean includeMemstoreScanner) Create scanners on the given files and if needed on the memstore with no filtering based on TTL (that happens further down the line).
List<KeyValueScanner>	HStore.getScanners(List<HStoreFile> files, boolean cacheBlocks, boolean usePread, boolean isCompaction, ScanQueryMatcher matcher, byte[] startRow, boolean includeStartRow, byte[] stopRow, boolean includeStopRow, long readPt, boolean includeMemstoreScanner) Create scanners on the given files and if needed on the memstore with no filtering based on TTL (that happens further down the line).
static List<StoreFileScanner>	StoreFileScanner.getScannersForCompaction(Collection<HStoreFile> files, boolean canUseDropBehind, long readPt) Get scanners for compaction.
static List<StoreFileScanner>	StoreFileScanner.getScannersForStoreFiles(Collection<HStoreFile> files, boolean cacheBlocks, boolean usePread, boolean isCompaction, boolean useDropBehind, long readPt) Return an array of scanners corresponding to the given set of store files.
static List<StoreFileScanner>	StoreFileScanner.getScannersForStoreFiles(Collection<HStoreFile> files, boolean cacheBlocks, boolean usePread, boolean isCompaction, boolean canUseDrop, ScanQueryMatcher matcher, long readPt) Return an array of scanners corresponding to the given set of store files, And set the ScanQueryMatcher for each store file scanner for further optimization
static List<StoreFileScanner>	StoreFileScanner.getScannersForStoreFiles(Collection<HStoreFile> files, boolean cacheBlocks, boolean usePread, long readPt) Return an array of scanners corresponding to the given set of store files.
Collection<HStoreFile>	StoreFileManager.getUnneededFiles(long maxTs, List<HStoreFile> filesCompacting)
Collection<HStoreFile>	StripeStoreFileManager.getUnneededFiles(long maxTs, List<HStoreFile> filesCompacting)
static boolean	StoreUtils.hasReferences(Collection<HStoreFile> files) Determines whether any files in the collection are references.
void	StoreFileManager.insertNewFiles(Collection<HStoreFile> sfs) Adds new files, either for from MemStore flush or bulk insert, into the structure.
void	StripeStoreFileManager.insertNewFiles(Collection<HStoreFile> sfs)
void	StoreFileManager.loadFiles(List<HStoreFile> storeFiles) Loads the initial store files into empty StoreFileManager.
void	StripeStoreFileManager.loadFiles(List<HStoreFile> storeFiles)
boolean	DateTieredStoreEngine.needsCompaction(List<HStoreFile> filesCompacting)
boolean	StripeStoreEngine.needsCompaction(List<HStoreFile> filesCompacting)
abstract boolean	StoreEngine.needsCompaction(List<HStoreFile> filesCompacting)
boolean	DefaultStoreEngine.needsCompaction(List<HStoreFile> filesCompacting)
void	RegionCoprocessorHost.postCompactSelection(HStore store, List<HStoreFile> selected, CompactionLifeCycleTracker tracker, CompactionRequest request, User user) Called after the HStoreFiles to be compacted have been selected from the available candidates.
boolean	RegionCoprocessorHost.preCompactSelection(HStore store, List<HStoreFile> candidates, CompactionLifeCycleTracker tracker, User user) Called prior to selecting the HStoreFiles for compaction from the list of currently available candidates.
void	StoreFileManager.removeCompactedFiles(Collection<HStoreFile> compactedFiles) Remove the compacted files
void	StripeStoreFileManager.removeCompactedFiles(Collection<HStoreFile> compactedFiles)
void	HRegionFileSystem.removeStoreFiles(String familyName, Collection<HStoreFile> storeFiles) Closes and archives the specified store files from the specified family.
Iterator<HStoreFile>	StoreFileManager.updateCandidateFilesForRowKeyBefore(Iterator<HStoreFile> candidateFiles, KeyValue targetKey, Cell candidate) Updates the candidate list for finding row key before.
Iterator<HStoreFile>	StripeStoreFileManager.updateCandidateFilesForRowKeyBefore(Iterator<HStoreFile> candidateFiles, KeyValue targetKey, Cell candidate) See StoreFileManager.getCandidateFilesForRowKeyBefore(KeyValue) and StoreFileManager.updateCandidateFilesForRowKeyBefore(Iterator, KeyValue, Cell) for details on this methods.
void	ChangedReadersObserver.updateReaders(List<HStoreFile> sfs, List<KeyValueScanner> memStoreScanners) Notify observers.
void	StoreScanner.updateReaders(List<HStoreFile> sfs, List<KeyValueScanner> memStoreScanners)

org.apache.hadoop.hbase.regionserver.compactions中HStoreFile的使用

返回变量类型为HStoreFile的类型的org.apache.hadoop.hbase.regionserver.compactions中的方法

限定符和类型	方法和说明
protected ArrayList<HStoreFile>	ExploringCompactionPolicy.applyCompactionPolicy(ArrayList<HStoreFile> candidates, boolean mayUseOffPeak, boolean mightBeStuck)
protected ArrayList<HStoreFile>	RatioBasedCompactionPolicy.applyCompactionPolicy(ArrayList<HStoreFile> candidates, boolean mayUseOffPeak, boolean mayBeStuck) -- Default minor compaction selection algorithm: choose CompactSelection from candidates -- First exclude bulk-load files if indicated in configuration.
List<HStoreFile>	ExploringCompactionPolicy.applyCompactionPolicy(List<HStoreFile> candidates, boolean mightBeStuck, boolean mayUseOffPeak, int minFiles, int maxFiles)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.checkMinFilesCriteria(ArrayList<HStoreFile> candidates, int minFiles)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.filterBulk(ArrayList<HStoreFile> candidates)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.getCurrentEligibleFiles(ArrayList<HStoreFile> candidateFiles, List<HStoreFile> filesCompacting)
Collection<HStoreFile>	CompactionRequestImpl.getFiles()
List<HStoreFile>	StripeCompactionPolicy.StripeInformationProvider.getLevel0Files()
Collection<HStoreFile>	StripeCompactionPolicy.StripeInformationProvider.getStorefiles()
ArrayList<org.apache.hbase.thirdparty.com.google.common.collect.ImmutableList<HStoreFile>>	StripeCompactionPolicy.StripeInformationProvider.getStripes()
abstract List<HStoreFile>	CompactionContext.preSelect(List<HStoreFile> filesCompacting) Called before coprocessor preCompactSelection and should filter the candidates for coprocessor; i.e. exclude the files that definitely cannot be compacted at this time.
List<HStoreFile>	SortedCompactionPolicy.preSelectCompactionForCoprocessor(Collection<HStoreFile> candidates, List<HStoreFile> filesCompacting)
List<HStoreFile>	StripeCompactionPolicy.preSelectFilesForCoprocessor(StripeCompactionPolicy.StripeInformationProvider si, List<HStoreFile> filesCompacting)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.skipLargeFiles(ArrayList<HStoreFile> candidates, boolean mayUseOffpeak)

类型变量类型为HStoreFile的org.apache.hadoop.hbase.regionserver.compactions中的方法参数

限定符和类型	方法和说明
protected ArrayList<HStoreFile>	ExploringCompactionPolicy.applyCompactionPolicy(ArrayList<HStoreFile> candidates, boolean mayUseOffPeak, boolean mightBeStuck)
protected ArrayList<HStoreFile>	RatioBasedCompactionPolicy.applyCompactionPolicy(ArrayList<HStoreFile> candidates, boolean mayUseOffPeak, boolean mayBeStuck) -- Default minor compaction selection algorithm: choose CompactSelection from candidates -- First exclude bulk-load files if indicated in configuration.
List<HStoreFile>	ExploringCompactionPolicy.applyCompactionPolicy(List<HStoreFile> candidates, boolean mightBeStuck, boolean mayUseOffPeak, int minFiles, int maxFiles)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.checkMinFilesCriteria(ArrayList<HStoreFile> candidates, int minFiles)
List<org.apache.hadoop.fs.Path>	DefaultCompactor.compactForTesting(Collection<HStoreFile> filesToCompact, boolean isMajor) Compact a list of files for testing.
protected abstract CompactionRequestImpl	SortedCompactionPolicy.createCompactionRequest(ArrayList<HStoreFile> candidateSelection, boolean tryingMajor, boolean mayUseOffPeak, boolean mayBeStuck)
protected CompactionRequestImpl	DateTieredCompactionPolicy.createCompactionRequest(ArrayList<HStoreFile> candidateSelection, boolean tryingMajor, boolean mayUseOffPeak, boolean mayBeStuck)
protected CompactionRequestImpl	RatioBasedCompactionPolicy.createCompactionRequest(ArrayList<HStoreFile> candidateSelection, boolean tryingMajor, boolean mayUseOffPeak, boolean mayBeStuck)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.filterBulk(ArrayList<HStoreFile> candidates)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.getCurrentEligibleFiles(ArrayList<HStoreFile> candidateFiles, List<HStoreFile> filesCompacting)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.getCurrentEligibleFiles(ArrayList<HStoreFile> candidateFiles, List<HStoreFile> filesCompacting)
long	SortedCompactionPolicy.getNextMajorCompactTime(Collection<HStoreFile> filesToCompact)
static long	StripeCompactionPolicy.getTotalFileSize(Collection<HStoreFile> candidates)
abstract boolean	SortedCompactionPolicy.needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting)
abstract boolean	SortedCompactionPolicy.needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting)
boolean	DateTieredCompactionPolicy.needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting) Heuristics for guessing whether we need minor compaction.
boolean	DateTieredCompactionPolicy.needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting) Heuristics for guessing whether we need minor compaction.
boolean	RatioBasedCompactionPolicy.needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting) A heuristic method to decide whether to schedule a compaction request
boolean	RatioBasedCompactionPolicy.needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting) A heuristic method to decide whether to schedule a compaction request
boolean	FIFOCompactionPolicy.needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting)
boolean	FIFOCompactionPolicy.needsCompaction(Collection<HStoreFile> storeFiles, List<HStoreFile> filesCompacting)
boolean	StripeCompactionPolicy.needsCompactions(StripeCompactionPolicy.StripeInformationProvider si, List<HStoreFile> filesCompacting)
abstract List<HStoreFile>	CompactionContext.preSelect(List<HStoreFile> filesCompacting) Called before coprocessor preCompactSelection and should filter the candidates for coprocessor; i.e. exclude the files that definitely cannot be compacted at this time.
List<HStoreFile>	SortedCompactionPolicy.preSelectCompactionForCoprocessor(Collection<HStoreFile> candidates, List<HStoreFile> filesCompacting)
List<HStoreFile>	SortedCompactionPolicy.preSelectCompactionForCoprocessor(Collection<HStoreFile> candidates, List<HStoreFile> filesCompacting)
List<HStoreFile>	StripeCompactionPolicy.preSelectFilesForCoprocessor(StripeCompactionPolicy.StripeInformationProvider si, List<HStoreFile> filesCompacting)
protected void	SortedCompactionPolicy.removeExcessFiles(ArrayList<HStoreFile> candidates, boolean isUserCompaction, boolean isMajorCompaction)
abstract boolean	CompactionContext.select(List<HStoreFile> filesCompacting, boolean isUserCompaction, boolean mayUseOffPeak, boolean forceMajor) Called to select files for compaction.
CompactionRequestImpl	SortedCompactionPolicy.selectCompaction(Collection<HStoreFile> candidateFiles, List<HStoreFile> filesCompacting, boolean isUserCompaction, boolean mayUseOffPeak, boolean forceMajor)
CompactionRequestImpl	SortedCompactionPolicy.selectCompaction(Collection<HStoreFile> candidateFiles, List<HStoreFile> filesCompacting, boolean isUserCompaction, boolean mayUseOffPeak, boolean forceMajor)
CompactionRequestImpl	FIFOCompactionPolicy.selectCompaction(Collection<HStoreFile> candidateFiles, List<HStoreFile> filesCompacting, boolean isUserCompaction, boolean mayUseOffPeak, boolean forceMajor)
CompactionRequestImpl	FIFOCompactionPolicy.selectCompaction(Collection<HStoreFile> candidateFiles, List<HStoreFile> filesCompacting, boolean isUserCompaction, boolean mayUseOffPeak, boolean forceMajor)
StripeCompactionPolicy.StripeCompactionRequest	StripeCompactionPolicy.selectCompaction(StripeCompactionPolicy.StripeInformationProvider si, List<HStoreFile> filesCompacting, boolean isOffpeak)
CompactionRequestImpl	DateTieredCompactionPolicy.selectMajorCompaction(ArrayList<HStoreFile> candidateSelection)
CompactionRequestImpl	DateTieredCompactionPolicy.selectMinorCompaction(ArrayList<HStoreFile> candidateSelection, boolean mayUseOffPeak, boolean mayBeStuck) We receive store files sorted in ascending order by seqId then scan the list of files.
abstract boolean	SortedCompactionPolicy.shouldPerformMajorCompaction(Collection<HStoreFile> filesToCompact)
abstract boolean	CompactionPolicy.shouldPerformMajorCompaction(Collection<HStoreFile> filesToCompact)
boolean	DateTieredCompactionPolicy.shouldPerformMajorCompaction(Collection<HStoreFile> filesToCompact)
boolean	RatioBasedCompactionPolicy.shouldPerformMajorCompaction(Collection<HStoreFile> filesToCompact)
boolean	FIFOCompactionPolicy.shouldPerformMajorCompaction(Collection<HStoreFile> filesToCompact)
boolean	StripeCompactionPolicy.shouldPerformMajorCompaction(Collection<HStoreFile> filesToCompact)
protected ArrayList<HStoreFile>	SortedCompactionPolicy.skipLargeFiles(ArrayList<HStoreFile> candidates, boolean mayUseOffpeak)
void	CompactionRequestImpl.updateFiles(Collection<HStoreFile> files)

类型变量类型为HStoreFile的org.apache.hadoop.hbase.regionserver.compactions中的构造器参数

构造器和说明
CompactionRequestImpl(Collection<HStoreFile> files)
DateTieredCompactionRequest(Collection<HStoreFile> files, List<Long> boundaryList)