@InterfaceAudience.Private public class CompoundBloomFilterWriter extends CompoundBloomFilterBase implements BloomFilterWriter, InlineBlockWriter
HFile to the
CompoundBloomFilter class.comparator, errorRate, hashType, numChunks, totalByteSize, totalKeyCount, totalMaxKeys, VERSION| 构造器和说明 |
|---|
CompoundBloomFilterWriter(int chunkByteSizeHint,
float errorRate,
int hashType,
int maxFold,
boolean cacheOnWrite,
CellComparator comparator,
BloomType bloomType) |
| 限定符和类型 | 方法和说明 |
|---|---|
void |
append(Cell cell)
Append the given cell
|
void |
beforeShipped()
The action that needs to be performed before
Shipper.shipped() is performed |
void |
blockWritten(long offset,
int onDiskSize,
int uncompressedSize)
Called after a block has been written, and its offset, raw size, and
compressed size have been determined.
|
void |
compactBloom()
Compact the Bloom filter before writing metadata & data to disk.
|
boolean |
getCacheOnWrite() |
org.apache.hadoop.io.Writable |
getDataWriter()
Get a writable interface into bloom filter data (the actual Bloom bits).
|
BlockType |
getInlineBlockType()
The type of blocks this block writer produces.
|
org.apache.hadoop.io.Writable |
getMetaWriter()
Get a writable interface into bloom filter meta data.
|
Cell |
getPrevCell()
Returns the previous cell written by this writer
|
boolean |
shouldWriteBlock(boolean closing)
Determines whether there is a new block to be written out.
|
void |
writeInlineBlock(DataOutput out)
Writes the block to the provided stream.
|
getByteSize, getKeyCount, getMaxKeysclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitgetByteSize, getKeyCount, getMaxKeyspublic CompoundBloomFilterWriter(int chunkByteSizeHint,
float errorRate,
int hashType,
int maxFold,
boolean cacheOnWrite,
CellComparator comparator,
BloomType bloomType)
chunkByteSizeHint - each chunk's size in bytes. The real chunk size might be different
as required by the fold factor.errorRate - target false positive ratehashType - hash function type to usemaxFold - maximum degree of folding allowedbloomType - the bloom typepublic boolean shouldWriteBlock(boolean closing)
InlineBlockWritershouldWriteBlock 在接口中 InlineBlockWriterclosing - whether the file is being closed, in which case we need to write
out all available data and not wait to accumulate another blockpublic void append(Cell cell) throws IOException
CellSinkappend 在接口中 CellSinkcell - the cell to be addedIOExceptionpublic void beforeShipped()
throws IOException
ShipperListenerShipper.shipped() is performedbeforeShipped 在接口中 ShipperListenerIOExceptionpublic Cell getPrevCell()
BloomFilterWritergetPrevCell 在接口中 BloomFilterWriterpublic void writeInlineBlock(DataOutput out) throws IOException
InlineBlockWriterInlineBlockWriter.shouldWriteBlock(boolean) returned true.writeInlineBlock 在接口中 InlineBlockWriterout - a stream (usually a compressing stream) to write the block toIOExceptionpublic void blockWritten(long offset,
int onDiskSize,
int uncompressedSize)
InlineBlockWriterblockWritten 在接口中 InlineBlockWriteroffset - the offset of the block in the streamonDiskSize - the on-disk size of the blockuncompressedSize - the uncompressed size of the blockpublic BlockType getInlineBlockType()
InlineBlockWritergetInlineBlockType 在接口中 InlineBlockWriterpublic void compactBloom()
BloomFilterWritercompactBloom 在接口中 BloomFilterWriterpublic org.apache.hadoop.io.Writable getMetaWriter()
BloomFilterWritergetMetaWriter 在接口中 BloomFilterWriterpublic org.apache.hadoop.io.Writable getDataWriter()
BloomFilterWritergetDataWriter 在接口中 BloomFilterWriterpublic boolean getCacheOnWrite()
getCacheOnWrite 在接口中 InlineBlockWriterCopyright © 2007–2019 The Apache Software Foundation. All rights reserved.