Packages

package utils

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. case class AvroDeserializerExpression(child: Expression, schemaAvroJson: String, darwinConfig: Option[Config], avoidReevaluation: Boolean = true, useSchemaManager: Boolean = false) extends UnaryExpression with ExpectsInputTypes with CompatibilityAvroDeserializerExpression with Product with Serializable

    An Expression which deserializes a binary field encoded in Avro and returns the corresponding representation in Spark.

    An Expression which deserializes a binary field encoded in Avro and returns the corresponding representation in Spark.

    child

    the Expression containing the binary Avro to be deserialized

    schemaAvroJson

    the JSON representation of the Avro schema

    darwinConfig

    the configuration for the AvroSchemaManager

    avoidReevaluation

    this filed forces the Expression to be non-deterministic. Setting this to true measn that this expression is executed only once even though the Optimizer creates several copies of it (eg. it happens usually with CollapseProject if the value returned by the expression is used several times, as with a selection of fields of the struct returned). If you set this flag to false, the expression may be evaluated once for each occurence of ti you see in the physical plan.

  2. case class AvroSerializerExpression extends UnaryExpression with ExpectsInputTypes with TimeZoneAwareExpression with CompatibilityAvroSerializerExpression with Product with Serializable
  3. trait CompatibilityAvroDeserializerExpression extends AnyRef
  4. trait CompatibilityAvroSerializerExpression extends AnyRef
  5. trait CompatibilityCompressExpression extends AnyRef
  6. trait CompatibilityDecodeUsingAvro[A] extends AnyRef
  7. trait CompatibilityEncodeUsingAvro[A] extends AnyRef
  8. trait CompatibilityEncoders extends AnyRef
  9. case class CompressExpression(codecName: String, conf: HadoopConfiguration, child: Expression) extends UnaryExpression with ExpectsInputTypes with CompatibilityCompressExpression with Product with Serializable
  10. case class DecodeUsingAvro[A](child: Expression, tag: ClassTag[A], schema: String, avroSchemaManager: () ⇒ AvroSchemaManager, fromGenericRecord: (GenericRecord) ⇒ A) extends UnaryExpression with NonSQLExpression with CompatibilityDecodeUsingAvro[A] with Product with Serializable
  11. case class EncodeUsingAvro[A](child: Expression, schema: String, avroSchemaManager: () ⇒ AvroSchemaManager, toGenericRecord: (A) ⇒ GenericRecord) extends UnaryExpression with NonSQLExpression with CompatibilityEncodeUsingAvro[A] with Product with Serializable
  12. class HBaseConnection extends GuardedLogging
  13. class HadoopConfiguration extends Serializable

    Serializable wrapper for a Hadoop Configuration

Value Members

  1. object AvroDeserializerExpression extends Serializable
  2. object AvroEncoders extends CompatibilityEncoders
  3. object AvroSerializerExpression extends Serializable
  4. object CompressExpression extends Serializable
  5. object DecodeUsingAvro extends Serializable
  6. object EncodeUsingAvro extends Serializable
  7. object MetadataUtils
  8. object Quartz2Utils

    Utilities for Quartz 2 scheduler.

  9. object SchemaFlatteners
  10. object SparkUtils extends Logging with WaspConfiguration with ElasticConfiguration with SparkStreamingConfiguration

    Utilities related to Spark.

  11. object ToolBoxUtils

Ungrouped