Packages

c

org.apache.spark.sql.execution.streaming.state

NoPrefixKeyStateEncoder

class NoPrefixKeyStateEncoder extends RocksDBStateEncoder

Encodes/decodes UnsafeRows to versioned byte arrays. It uses the first byte of the generated byte array to store the version the describes how the row is encoded in the rest of the byte array. Currently, the default version is 0,

VERSION 0: [ VERSION (1 byte) | ROW (N bytes) ] The bytes of a UnsafeRow is written unmodified to starting from offset 1 (offset 0 is the version byte of value 0). That is, if the unsafe row has N bytes, then the generated array byte will be N+1 bytes.

Linear Supertypes
RocksDBStateEncoder, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. NoPrefixKeyStateEncoder
  2. RocksDBStateEncoder
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new NoPrefixKeyStateEncoder(keySchema: StructType, valueSchema: StructType)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  6. def decode(byteArrayTuple: ByteArrayPair): UnsafeRowPair

    Decode pair of key-value byte arrays in a pair of key-value UnsafeRows.

    Decode pair of key-value byte arrays in a pair of key-value UnsafeRows.

    Definition Classes
    NoPrefixKeyStateEncoder → RocksDBStateEncoder
    Note

    The UnsafeRow returned is reused across calls, and the UnsafeRow just points to the given byte array.

  7. def decodeKey(keyBytes: Array[Byte]): UnsafeRow

    Decode byte array for a key to a UnsafeRow.

    Decode byte array for a key to a UnsafeRow.

    Definition Classes
    NoPrefixKeyStateEncoder → RocksDBStateEncoder
    Note

    The UnsafeRow returned is reused across calls, and the UnsafeRow just points to the given byte array.

  8. def decodeValue(valueBytes: Array[Byte]): UnsafeRow

    Decode byte array for a value to a UnsafeRow.

    Decode byte array for a value to a UnsafeRow.

    Definition Classes
    NoPrefixKeyStateEncoder → RocksDBStateEncoder
    Note

    The UnsafeRow returned is reused across calls, and the UnsafeRow just points to the given byte array.

  9. def encodeKey(row: UnsafeRow): Array[Byte]
    Definition Classes
    NoPrefixKeyStateEncoder → RocksDBStateEncoder
  10. def encodePrefixKey(prefixKey: UnsafeRow): Array[Byte]
    Definition Classes
    NoPrefixKeyStateEncoder → RocksDBStateEncoder
  11. def encodeValue(row: UnsafeRow): Array[Byte]
    Definition Classes
    NoPrefixKeyStateEncoder → RocksDBStateEncoder
  12. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  14. def extractPrefixKey(key: UnsafeRow): UnsafeRow
    Definition Classes
    NoPrefixKeyStateEncoder → RocksDBStateEncoder
  15. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  16. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  17. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  18. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  19. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  20. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  22. def supportPrefixKeyScan: Boolean
    Definition Classes
    NoPrefixKeyStateEncoder → RocksDBStateEncoder
  23. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  24. def toString(): String
    Definition Classes
    AnyRef → Any
  25. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  26. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  27. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from RocksDBStateEncoder

Inherited from AnyRef

Inherited from Any

Ungrouped