org.apache.spark.sql.delta.deletionvectors
DropMarkedRowsFilter
Companion object DropMarkedRowsFilter
final class DropMarkedRowsFilter extends RowIndexMarkingFilters
Implementation of RowIndexFilter which checks, for a given row index and deletion vector, whether the row index is present in the deletion vector. If present, the row is marked for skipping.
- Alphabetic
- By Inheritance
- DropMarkedRowsFilter
- RowIndexMarkingFilters
- RowIndexFilter
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
DropMarkedRowsFilter(bitmap: RoaringBitmapArray)
- bitmap
Represents the deletion vector
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
def
materializeIntoVector(start: Long, end: Long, batch: WritableColumnVector): Unit
Materialize filtering information for all rows in the range [start, end) by filling a boolean column vector batch.
Materialize filtering information for all rows in the range [start, end) by filling a boolean column vector batch. Assumes the indexes of the rows in the batch are consecutive and start from 0.
- start
Beginning index of the filtering range (inclusive).
- end
End index of the filtering range (exclusive).
- batch
The column vector for the current batch to materialize the range into.
- Definition Classes
- RowIndexMarkingFilters → RowIndexFilter
-
def
materializeIntoVectorWithRowIndex(batchSize: Int, rowIndexColumn: ColumnVector, batch: WritableColumnVector): Unit
Materialize filtering information for all rows in the batch.
Materialize filtering information for all rows in the batch. This is achieved by probing the roaring bitmap with the row index of every row in the batch.
- batchSize
The size of the batch.
- rowIndexColumn
A column vector that contains the row index of each row in the batch.
- batch
The column vector for the current batch to materialize the range into.
- Definition Classes
- RowIndexMarkingFilters → RowIndexFilter
-
def
materializeSingleRowWithRowIndex(rowIndex: Long, batch: WritableColumnVector): Unit
Materialize filtering information for batches with a single row.
Materialize filtering information for batches with a single row.
- rowIndex
The index of the row to materialize the filtering information.
- batch
The column vector for the current batch to materialize the range into. We assume it contains a single row.
- Definition Classes
- RowIndexMarkingFilters → RowIndexFilter
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
val
valueWhenContained: Byte
- Definition Classes
- DropMarkedRowsFilter → RowIndexMarkingFilters
-
val
valueWhenNotContained: Byte
- Definition Classes
- DropMarkedRowsFilter → RowIndexMarkingFilters
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()