package deletionvectors
- Alphabetic
- Public
- All
Type Members
-
case class
DeletionVectorStoredBitmap(dvDescriptor: DeletionVectorDescriptor, tableDataPath: Option[Path] = None) extends StoredBitmap with DeltaLogging with Product with Serializable
Bitmap for a Deletion Vector, implemented as a thin wrapper around a Deletion Vector Descriptor.
Bitmap for a Deletion Vector, implemented as a thin wrapper around a Deletion Vector Descriptor. The bitmap can be empty, inline or on-disk. In case of on-disk deletion vectors,
tableDataPathmust be set to the data path of the Delta table, which is where deletion vectors are stored. -
final
class
DropMarkedRowsFilter extends RowIndexMarkingFilters
Implementation of RowIndexFilter which checks, for a given row index and deletion vector, whether the row index is present in the deletion vector.
Implementation of RowIndexFilter which checks, for a given row index and deletion vector, whether the row index is present in the deletion vector. If present, the row is marked for skipping.
-
final
class
KeepMarkedRowsFilter extends RowIndexMarkingFilters
Implementation of RowIndexFilter which checks, for a given row index and deletion vector, whether the row index is present in the deletion vector.
Implementation of RowIndexFilter which checks, for a given row index and deletion vector, whether the row index is present in the deletion vector. If not present, the row is marked for skipping.
-
final
class
RoaringBitmapArray extends Equals
A 64-bit extension of RoaringBitmap that is optimized for cases that usually fit within a 32-bit bitmap, but may run over by a few bits on occasion.
A 64-bit extension of RoaringBitmap that is optimized for cases that usually fit within a 32-bit bitmap, but may run over by a few bits on occasion.
This focus makes it different from org.roaringbitmap.longlong.Roaring64NavigableMap and org.roaringbitmap.longlong.Roaring64Bitmap which focus on sparse bitmaps over the whole 64-bit range.
Structurally, this implementation simply uses the most-significant 4 bytes to index into an array of 32-bit RoaringBitmap instances. The array is grown as necessary to accommodate the largest value in the bitmap.
*Note:* As opposed to the other two 64-bit bitmap implementations mentioned above, this implementation cannot accommodate
Longvalues where the most significant bit is non-zero (i.e., negativeLongvalues). It cannot even accommodate values where the 4 high-order bytes areInt.MaxValue, because then the length of thebitmapsarray would be a negative number (Int.MaxValue + 1). -
sealed abstract
class
RowIndexMarkingFilters extends RowIndexFilter
Base class for row index filters.
- sealed trait RowIndexMarkingFiltersBuilder extends AnyRef
-
trait
StoredBitmap extends AnyRef
Interface for bitmaps that are stored as Deletion Vectors.
Value Members
- object DropAllRowsFilter extends RowIndexFilter with Product with Serializable
-
object
DropMarkedRowsFilter extends RowIndexMarkingFiltersBuilder
Utility methods that creates DropMarkedRowsFilter to filter out row indices that are present in the given deletion vector.
- object KeepAllRowsFilter extends RowIndexFilter with Product with Serializable
-
object
KeepMarkedRowsFilter extends RowIndexMarkingFiltersBuilder
Utility methods that creates KeepMarkedRowsFilter to filter out row indices that are present in the given deletion vector.
- object RoaringBitmapArray
-
object
RoaringBitmapArrayFormat extends Enumeration
Legal values for the serialization format for RoaringBitmapArray.
- object StoredBitmap