object UnsafeRowUtils
- Alphabetic
- By Inheritance
- UnsafeRowUtils
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- def validateStructuralIntegrity(row: UnsafeRow, expectedSchema: StructType): Boolean
Use the following rules to check the integrity of the UnsafeRow: - schema.fields.length == row.numFields should always be true - UnsafeRow.calculateBitSetWidthInBytes(row.numFields) < row.getSizeInBytes should always be true if the expectedSchema contains at least one field.
Use the following rules to check the integrity of the UnsafeRow: - schema.fields.length == row.numFields should always be true - UnsafeRow.calculateBitSetWidthInBytes(row.numFields) < row.getSizeInBytes should always be true if the expectedSchema contains at least one field. - For variable-length fields: if null bit says it's null then don't do anything, else extract offset and size: 1) 0 <= size < row.getSizeInBytes should always be true. We can be even more precise than this, where the upper bound of size can only be as big as the variable length part of the row. 2) offset should be >= fixed sized part of the row. 3) offset + size should be within the row bounds. - For fixed-length fields that are narrower than 8 bytes (boolean/byte/short/int/float), if null bit says it's null then don't do anything, else: check if the unused bits in the field are all zeros. The UnsafeRowWriter's write() methods make this guarantee. - Check the total length of the row.
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()