org.apache.hadoop.hbase.regionserver

类 StoreFileScanner

java.lang.Object

org.apache.hadoop.hbase.regionserver.StoreFileScanner

所有已实现的接口:

Closeable, AutoCloseable, KeyValueScanner, Shipper

@InterfaceAudience.LimitedPrivate(value="Phoenix")
 @InterfaceStability.Evolving
public class StoreFileScanner
extends Object
implements KeyValueScanner

KeyValueScanner adaptor over the Reader. It also provides hooks into bloom filter things.

字段概要

从接口继承的字段 org.apache.hadoop.hbase.regionserver.KeyValueScanner

NO_NEXT_INDEXED_KEY

构造器概要

构造器

构造器和说明
StoreFileScanner(StoreFileReader reader, HFileScanner hfs, boolean useMVCC, boolean hasMVCC, long readPt, long scannerOrder, boolean canOptimizeForNonNullColumn) Implements a KeyValueScanner on top of the specified HFileScanner

方法概要

限定符和类型	方法和说明
boolean	backwardSeek(Cell key) Seek the scanner at or before the row of specified Cell, it firstly tries to seek the scanner at or after the specified Cell, return if peek KeyValue of scanner has the same row with specified Cell, otherwise seek the scanner at the first Cell of the row which is the previous row of specified KeyValue
void	close() Close the KeyValue scanner.
void	enforceSeek() Does the real seek operation in case it was skipped by seekToRowCol(KeyValue, boolean) (TODO: Whats this?).
org.apache.hadoop.fs.Path	getFilePath()
Cell	getNextIndexedKey()
long	getScannerOrder() Get the order of this KeyValueScanner.
static List<StoreFileScanner>	getScannersForCompaction(Collection<HStoreFile> files, boolean canUseDropBehind, long readPt) Get scanners for compaction.
static List<StoreFileScanner>	getScannersForStoreFiles(Collection<HStoreFile> files, boolean cacheBlocks, boolean usePread, boolean isCompaction, boolean useDropBehind, long readPt) Return an array of scanners corresponding to the given set of store files.
static List<StoreFileScanner>	getScannersForStoreFiles(Collection<HStoreFile> files, boolean cacheBlocks, boolean usePread, boolean isCompaction, boolean canUseDrop, ScanQueryMatcher matcher, long readPt) Return an array of scanners corresponding to the given set of store files, And set the ScanQueryMatcher for each store file scanner for further optimization
static List<StoreFileScanner>	getScannersForStoreFiles(Collection<HStoreFile> files, boolean cacheBlocks, boolean usePread, long readPt) Return an array of scanners corresponding to the given set of store files.
boolean	isFileScanner()
Cell	next() Return the next Cell in this scanner, iterating the scanner
Cell	peek() Look at the next Cell in this scanner, but do not iterate scanner.
boolean	realSeekDone() We optimize our store scanners by checking the most recent store file first, so we sometimes pretend we have done a seek but delay it until the store scanner bubbles up to the top of the key-value heap.
boolean	requestSeek(Cell kv, boolean forward, boolean useBloom) Pretend we have done a seek but don't do it yet, if possible.
boolean	reseek(Cell key) Reseek the scanner at or after the specified KeyValue.
boolean	seek(Cell key) Seek the scanner at or after the specified KeyValue.
static boolean	seekAtOrAfter(HFileScanner s, Cell k)
boolean	seekToLastRow() Seek the scanner at the first KeyValue of last row
boolean	seekToPreviousRow(Cell originalKey) Seek the scanner at the first Cell of the row which is the previous row of specified key
protected void	setCurrentCell(Cell newVal)
void	shipped() Called after a batch of rows scanned and set to be returned to client.
boolean	shouldUseScanner(Scan scan, HStore store, long oldestUnexpiredTS) Allows to filter out scanners (both StoreFile and memstore) that we don't want to use based on criteria such as Bloom filters and timestamp ranges.
protected boolean	skipKVsNewerThanReadpoint()
String	toString()

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

构造器详细资料

StoreFileScanner

public StoreFileScanner(StoreFileReader reader,
                        HFileScanner hfs,
                        boolean useMVCC,
                        boolean hasMVCC,
                        long readPt,
                        long scannerOrder,
                        boolean canOptimizeForNonNullColumn)

Implements a KeyValueScanner on top of the specified HFileScanner

参数:

useMVCC - If true, scanner will filter out updates with MVCC larger than readPt.

readPt - MVCC value to use to filter out the updates newer than this scanner.

hasMVCC - Set to true if underlying store file reader has MVCC info.

scannerOrder - Order of the scanner relative to other scanners. See KeyValueScanner.getScannerOrder().

canOptimizeForNonNullColumn - true if we can make sure there is no null column, otherwise false. This is a hint for optimization.

方法详细资料

getScannersForStoreFiles

public static List<StoreFileScanner> getScannersForStoreFiles(Collection<HStoreFile> files,
                                                              boolean cacheBlocks,
                                                              boolean usePread,
                                                              long readPt)
                                                       throws IOException

Return an array of scanners corresponding to the given set of store files.

抛出:

IOException

getScannersForStoreFiles

public static List<StoreFileScanner> getScannersForStoreFiles(Collection<HStoreFile> files,
                                                              boolean cacheBlocks,
                                                              boolean usePread,
                                                              boolean isCompaction,
                                                              boolean useDropBehind,
                                                              long readPt)
                                                       throws IOException

Return an array of scanners corresponding to the given set of store files.

抛出:

IOException

getScannersForStoreFiles

public static List<StoreFileScanner> getScannersForStoreFiles(Collection<HStoreFile> files,
                                                              boolean cacheBlocks,
                                                              boolean usePread,
                                                              boolean isCompaction,
                                                              boolean canUseDrop,
                                                              ScanQueryMatcher matcher,
                                                              long readPt)
                                                       throws IOException

Return an array of scanners corresponding to the given set of store files, And set the ScanQueryMatcher for each store file scanner for further optimization

抛出:

IOException

getScannersForCompaction

public static List<StoreFileScanner> getScannersForCompaction(Collection<HStoreFile> files,
                                                              boolean canUseDropBehind,
                                                              long readPt)
                                                       throws IOException

Get scanners for compaction. We will create a separated reader for each store file to avoid contention with normal read request.

抛出:

IOException

toString

public String toString()

覆盖:

toString 在类中 Object

peek

public Cell peek()

从接口复制的说明: KeyValueScanner

Look at the next Cell in this scanner, but do not iterate scanner. NOTICE: The returned cell has not been passed into ScanQueryMatcher. So it may not be what the user need.

指定者:

peek 在接口中 KeyValueScanner

返回:

the next Cell

next

public Cell next()
          throws IOException

从接口复制的说明: KeyValueScanner

Return the next Cell in this scanner, iterating the scanner

指定者:

next 在接口中 KeyValueScanner

返回:

the next Cell

抛出:

IOException

seek

public boolean seek(Cell key)
             throws IOException

从接口复制的说明: KeyValueScanner

Seek the scanner at or after the specified KeyValue.

指定者:

seek 在接口中 KeyValueScanner

参数:

key - seek value

返回:

true if scanner has values left, false if end of scanner

抛出:

IOException

reseek

public boolean reseek(Cell key)
               throws IOException

从接口复制的说明: KeyValueScanner

Reseek the scanner at or after the specified KeyValue. This method is guaranteed to seek at or after the required key only if the key comes after the current position of the scanner. Should not be used to seek to a key which may come before the current position.

指定者:

reseek 在接口中 KeyValueScanner

参数:

key - seek value (should be non-null)

返回:

true if scanner has values left, false if end of scanner

抛出:

IOException

setCurrentCell

protected void setCurrentCell(Cell newVal)
                       throws IOException

抛出:

IOException

skipKVsNewerThanReadpoint

protected boolean skipKVsNewerThanReadpoint()
                                     throws IOException

抛出:

IOException

close

public void close()

从接口复制的说明: KeyValueScanner

Close the KeyValue scanner.

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

指定者:

close 在接口中 KeyValueScanner

seekAtOrAfter

public static boolean seekAtOrAfter(HFileScanner s,
                                    Cell k)
                             throws IOException

参数:

s -

k -

返回:

false if not found or if k is after the end.

抛出:

IOException

getScannerOrder

public long getScannerOrder()

从接口复制的说明: KeyValueScanner

Get the order of this KeyValueScanner. This is only relevant for StoreFileScanners. This is required for comparing multiple files to find out which one has the latest data. StoreFileScanners are ordered from 0 (oldest) to newest in increasing order.

指定者:

getScannerOrder 在接口中 KeyValueScanner

另请参阅:

KeyValueScanner.getScannerOrder()

requestSeek

public boolean requestSeek(Cell kv,
                           boolean forward,
                           boolean useBloom)
                    throws IOException

Pretend we have done a seek but don't do it yet, if possible. The hope is that we find requested columns in more recent files and won't have to seek in older files. Creates a fake key/value with the given row/column and the highest (most recent) possible timestamp we might get from this file. When users of such "lazy scanner" need to know the next KV precisely (e.g. when this scanner is at the top of the heap), they run enforceSeek().

Note that this function does guarantee that the current KV of this scanner will be advanced to at least the given KV. Because of this, it does have to do a real seek in cases when the seek timestamp is older than the highest timestamp of the file, e.g. when we are trying to seek to the next row/column and use OLDEST_TIMESTAMP in the seek key.

指定者:

requestSeek 在接口中 KeyValueScanner

forward - do a forward-only "reseek" instead of a random-access seek

useBloom - whether to enable multi-column Bloom filter optimization

抛出:

IOException

realSeekDone

public boolean realSeekDone()

从接口复制的说明: KeyValueScanner

We optimize our store scanners by checking the most recent store file first, so we sometimes pretend we have done a seek but delay it until the store scanner bubbles up to the top of the key-value heap. This method is then used to ensure the top store file scanner has done a seek operation.

指定者:

realSeekDone 在接口中 KeyValueScanner

enforceSeek

public void enforceSeek()
                 throws IOException

从接口复制的说明: KeyValueScanner

Does the real seek operation in case it was skipped by seekToRowCol(KeyValue, boolean) (TODO: Whats this?). Note that this function should be never called on scanners that always do real seek operations (i.e. most of the scanners). The easiest way to achieve this is to call KeyValueScanner.realSeekDone() first.

指定者:

enforceSeek 在接口中 KeyValueScanner

抛出:

IOException

isFileScanner

public boolean isFileScanner()

指定者:

isFileScanner 在接口中 KeyValueScanner

返回:

true if this is a file scanner. Otherwise a memory scanner is assumed.

getFilePath

public org.apache.hadoop.fs.Path getFilePath()

指定者:

getFilePath 在接口中 KeyValueScanner

返回:

the file path if this is a file scanner, otherwise null.

另请参阅:

KeyValueScanner.isFileScanner()

shouldUseScanner

public boolean shouldUseScanner(Scan scan,
                                HStore store,
                                long oldestUnexpiredTS)

从接口复制的说明: KeyValueScanner

Allows to filter out scanners (both StoreFile and memstore) that we don't want to use based on criteria such as Bloom filters and timestamp ranges.

指定者:

shouldUseScanner 在接口中 KeyValueScanner

参数:

scan - the scan that we are selecting scanners for

store - the store we are performing the scan on.

oldestUnexpiredTS - the oldest timestamp we are interested in for this query, based on TTL

返回:

true if the scanner should be included in the query

seekToPreviousRow

public boolean seekToPreviousRow(Cell originalKey)
                          throws IOException

从接口复制的说明: KeyValueScanner

Seek the scanner at the first Cell of the row which is the previous row of specified key

指定者:

seekToPreviousRow 在接口中 KeyValueScanner

参数:

originalKey - seek value

返回:

true if the scanner at the first valid Cell of previous row, false if not existing such Cell

抛出:

IOException

seekToLastRow

public boolean seekToLastRow()
                      throws IOException

从接口复制的说明: KeyValueScanner

Seek the scanner at the first KeyValue of last row

指定者:

seekToLastRow 在接口中 KeyValueScanner

返回:

true if scanner has values left, false if the underlying data is empty

抛出:

IOException

backwardSeek

public boolean backwardSeek(Cell key)
                     throws IOException

从接口复制的说明: KeyValueScanner

Seek the scanner at or before the row of specified Cell, it firstly tries to seek the scanner at or after the specified Cell, return if peek KeyValue of scanner has the same row with specified Cell, otherwise seek the scanner at the first Cell of the row which is the previous row of specified KeyValue

指定者:

backwardSeek 在接口中 KeyValueScanner

参数:

key - seek KeyValue

返回:

true if the scanner is at the valid KeyValue, false if such KeyValue does not exist

抛出:

IOException

getNextIndexedKey

public Cell getNextIndexedKey()

指定者:

getNextIndexedKey 在接口中 KeyValueScanner

返回:

the next key in the index, usually the first key of next block OR a key that falls between last key of current block and first key of next block.. see HFileWriterImpl#getMidpoint, or null if not known.

shipped

public void shipped()
             throws IOException

从接口复制的说明: Shipper

Called after a batch of rows scanned and set to be returned to client. Any in between cleanup can be done here.

指定者:

shipped 在接口中 Shipper

抛出:

IOException