Packages

c

ai.chronon.flink

SparkExpressionEvalFn

class SparkExpressionEvalFn[T] extends RichFlatMapFunction[T, Map[String, Any]]

A Flink function that uses Chronon's CatalystUtil to evaluate the Spark SQL expression in a GroupBy. This function is instantiated for a given type T (specific case class object, Thrift / Proto object). Based on the selects and where clauses in the GroupBy, this function projects and filters the input data and emits a Map which contains the relevant fields & values that are needed to compute the aggregated values for the GroupBy.

T

The type of the input data.

Linear Supertypes
RichFlatMapFunction[T, Map[String, Any]], FlatMapFunction[T, Map[String, Any]], AbstractRichFunction, RichFunction, Function, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SparkExpressionEvalFn
  2. RichFlatMapFunction
  3. FlatMapFunction
  4. AbstractRichFunction
  5. RichFunction
  6. Function
  7. Serializable
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SparkExpressionEvalFn(encoder: Encoder[T], groupBy: GroupBy)

    encoder

    Spark Encoder for the input data type

    groupBy

    The GroupBy to evaluate.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. def close(): Unit
    Definition Classes
    SparkExpressionEvalFn → AbstractRichFunction → RichFunction
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. def flatMap(inputEvent: T, out: Collector[Map[String, Any]]): Unit
    Definition Classes
    SparkExpressionEvalFn → RichFlatMapFunction → FlatMapFunction
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. def getIterationRuntimeContext(): IterationRuntimeContext
    Definition Classes
    AbstractRichFunction → RichFunction
  13. def getRuntimeContext(): RuntimeContext
    Definition Classes
    AbstractRichFunction → RichFunction
  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. lazy val logger: Logger
    Annotations
    @transient()
  17. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. def open(configuration: Configuration): Unit
    Definition Classes
    SparkExpressionEvalFn → AbstractRichFunction → RichFunction
  21. def setRuntimeContext(arg0: RuntimeContext): Unit
    Definition Classes
    AbstractRichFunction → RichFunction
  22. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  23. def toString(): String
    Definition Classes
    AnyRef → Any
  24. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from RichFlatMapFunction[T, Map[String, Any]]

Inherited from FlatMapFunction[T, Map[String, Any]]

Inherited from AbstractRichFunction

Inherited from RichFunction

Inherited from Function

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped