Packages

object ExpressionEncoder extends Serializable

A factory for constructing encoders that convert objects and primitives to and from the internal row format using catalyst expressions and code generation. By default, the expressions used to retrieve values from an input row when producing an object will be created as follows:

  • Classes will have their sub fields extracted by name using UnresolvedAttribute expressions and UnresolvedExtractValue expressions.
  • Tuples will have their subfields extracted by position using BoundReference expressions.
  • Primitives will have their values extracted from the first ordinal with a schema that defaults to the name value.
Linear Supertypes
Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExpressionEncoder
  2. Serializable
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Type Members

  1. class Deserializer[T] extends (InternalRow) => T with Serializable

    Function that deserializes an InternalRow into an object of type T.

    Function that deserializes an InternalRow into an object of type T. This class is not thread-safe.

  2. class Serializer[T] extends (T) => InternalRow with Serializable

    Function that serializes an object of type T to an InternalRow.

    Function that serializes an object of type T to an InternalRow. This class is not thread-safe. Note that multiple calls to apply(..) return the same actual InternalRow object. Thus, the caller should copy the result before making another call if required.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def apply(schema: StructType, lenient: Boolean): ExpressionEncoder[Row]
  5. def apply(schema: StructType): ExpressionEncoder[Row]
  6. def apply[T](enc: AgnosticEncoder[T]): ExpressionEncoder[T]
  7. def apply[T]()(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): ExpressionEncoder[T]
  8. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  9. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  10. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  13. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. def javaBean[T](beanClass: Class[T]): ExpressionEncoder[T]
  17. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  21. def toString(): String
    Definition Classes
    AnyRef → Any
  22. def tuple[T1, T2, T3, T4, T5](e1: ExpressionEncoder[T1], e2: ExpressionEncoder[T2], e3: ExpressionEncoder[T3], e4: ExpressionEncoder[T4], e5: ExpressionEncoder[T5]): ExpressionEncoder[(T1, T2, T3, T4, T5)]
  23. def tuple[T1, T2, T3, T4](e1: ExpressionEncoder[T1], e2: ExpressionEncoder[T2], e3: ExpressionEncoder[T3], e4: ExpressionEncoder[T4]): ExpressionEncoder[(T1, T2, T3, T4)]
  24. def tuple[T1, T2, T3](e1: ExpressionEncoder[T1], e2: ExpressionEncoder[T2], e3: ExpressionEncoder[T3]): ExpressionEncoder[(T1, T2, T3)]
  25. def tuple[T1, T2](e1: ExpressionEncoder[T1], e2: ExpressionEncoder[T2]): ExpressionEncoder[(T1, T2)]
  26. def tuple[T](e: ExpressionEncoder[T]): ExpressionEncoder[(T)]
  27. def tuple(encoders: Seq[ExpressionEncoder[_]], useNullSafeDeserializer: Boolean = false): ExpressionEncoder[_]

    Given a set of N encoders, constructs a new encoder that produce objects as items in an N-tuple.

    Given a set of N encoders, constructs a new encoder that produce objects as items in an N-tuple. Note that these encoders should be unresolved so that information about name/positional binding is preserved. When useNullSafeDeserializer is true, the deserialization result for a child will be null if the input is null. It is false by default as most deserializers handle null input properly and don't require an extra null check. Some of them are null-tolerant, such as the deserializer for Option[T], and we must not set it to true in this case.

  28. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  29. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  30. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped