p

ai.chronon

online

package online

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. Protected

Type Members

  1. abstract class Api extends Serializable
  2. class ArrayRow extends Row

    Consumed by row aggregator after decoding.

    Consumed by row aggregator after decoding. Mutations follow the same schema as input for value indices. However there are two main differences. * ts and reversal columns are required for computation * Mutation ts takes on the role of ts. Since the schema is the same with the sole difference of the added columns, we add these columns on the tail of the Array and extract them accordingly. i.e. for mutations: reversal index = ArrayRow.length - (Constants.MutationAvroColumns.length - (index of reversal in Constants.MutationAvroColumns)

  3. class AvroCodec extends Serializable
  4. class CatalystUtil extends AnyRef
  5. case class DataMetrics(series: Seq[(Long, SortedMap[String, Any])]) extends Product with Serializable
  6. case class DataStream(df: DataFrame, partitions: Int, topicInfo: TopicInfo) extends Product with Serializable
  7. abstract class ExternalSourceHandler extends Serializable
  8. class ExternalSourceRegistry extends Serializable
  9. class Fetcher extends FetcherBase
  10. class FetcherBase extends MetadataStore with FetcherCache
  11. trait FetcherCache extends AnyRef
  12. trait FlagStore extends Serializable

    Interface to allow rolling out features/infrastructure changes in a safe & controlled manner.

    Interface to allow rolling out features/infrastructure changes in a safe & controlled manner.

    The "Flag"s in FlagStore referes to 'feature flags', a technique that allows enabling or disabling features at runtime.

    Chronon users can provide their own implementation in the Api.

  13. class GroupByServingInfoParsed extends GroupByServingInfo with Serializable
  14. abstract class JTry[V] extends AnyRef
  15. abstract class JavaExternalSourceHandler extends ExternalSourceHandler
  16. class JavaFetcher extends AnyRef
  17. class JavaRequest extends AnyRef
  18. class JavaResponse extends AnyRef
  19. class JavaSeriesStatsResponse extends AnyRef
  20. class JavaStatsRequest extends AnyRef
  21. class JavaStatsResponse extends AnyRef
  22. case class JoinCodec(conf: JoinOps, keySchema: StructType, baseValueSchema: StructType, keyCodec: AvroCodec, baseValueCodec: AvroCodec) extends Serializable with Product
  23. trait KVStore extends AnyRef
  24. case class LoggableResponse(keyBytes: Array[Byte], valueBytes: Array[Byte], joinName: String, tsMillis: Long, schemaHash: String) extends Product with Serializable
  25. case class LoggableResponseBase64(keyBase64: String, valueBase64: String, name: String, tsMillis: Long, schemaHash: String) extends Product with Serializable
  26. class MetadataDirWalker extends AnyRef
  27. case class MetadataEndPoint[Conf <: TBase[_, _]](extractFn: (String, Conf) => (String, String), name: String)(implicit evidence$1: Manifest[Conf], evidence$2: ClassTag[Conf]) extends Product with Serializable
  28. class MetadataStore extends AnyRef
  29. case class Mutation(schema: StructType = null, before: Array[Any] = null, after: Array[Any] = null) extends Product with Serializable

    Mutation is the general case of an Event Imagine a user impression/view stream - impressions/views are immutable events Imagine a stream of changes to a credit card transaction stream.

    MUTATION vs. EVENT

    Mutation is the general case of an Event Imagine a user impression/view stream - impressions/views are immutable events Imagine a stream of changes to a credit card transaction stream.

    • transactions can be "corrected"/updated & deleted, besides being "inserted"
    • This is one of the core difference between entity and event sources. Events are insert-only.
    • (The other difference is Entites are stored in the warehouse typically as snapshots of the table as of midnight) In case of an update - one must produce both before and after values In case of a delete - only before is populated & after is left as null In case of a insert - only after is populated & before is left as null
    TIME ASSUMPTIONS

    The schema needs to contain a ts(milliseconds as a java Long) For the entities case, mutation_ts when absent will use ts as a replacement

    TYPE CONVERSIONS

    Java types corresponding to the schema types. StreamDecoder should produce mutations that comply. NOTE: everything is nullable (hence boxed) IntType java.lang.Integer LongType java.lang.Long DoubleType java.lang.Double FloatType java.lang.Float ShortType java.lang.Short BooleanType java.lang.Boolean ByteType java.lang.Byte StringType java.lang.String BinaryType Array[Byte] ListType java.util.List[Byte] MapType java.util.Map[Byte] StructType Array[Any]

  30. class PoolMap[Key, Value] extends AnyRef
  31. class PooledCatalystUtil extends AnyRef
  32. class RowWrapper extends Row
  33. trait SerializableFunction[T, R] extends Function[T, R] with Serializable
  34. trait StreamBuilder extends AnyRef
  35. abstract class StreamDecoder extends Serializable
  36. class TBaseDecoderFactory extends Serializable
  37. class TTLCache[I, O] extends AnyRef
  38. class ThriftDecoder extends Serializable
  39. class TileCodec extends AnyRef

    TileCodec is a helper class that allows for the creation of pre-aggregated tiles of feature values.

    TileCodec is a helper class that allows for the creation of pre-aggregated tiles of feature values. These pre-aggregated tiles can be used in the serving layer to compute the final feature values along with batch pre-aggregates produced by GroupByUploads. The pre-aggregated tiles are serialized as Avro and indicate whether the tile is complete or not (partial aggregates)

  40. case class TopicInfo(name: String, topicType: String, params: Map[String, String]) extends Product with Serializable

Value Members

  1. object AvroCodec extends Serializable
  2. object AvroConversions
  3. object CatalystUtil
  4. object CompatParColls
  5. object Extensions
  6. object ExternalSourceHandler extends Serializable
  7. object Fetcher
  8. object FetcherBase
  9. object FetcherCache
  10. object FlexibleExecutionContext
  11. object JoinCodec extends Serializable
  12. object KVStore
  13. object LRUCache

    Utility to create a cache with LRU semantics.

    Utility to create a cache with LRU semantics.

    The original purpose of having an LRU cache in Chronon is to cache KVStore calls and decoded IRs in the Fetcher. This helps decrease to feature serving latency.

  14. object MetadataEndPoint extends Serializable
  15. object Metrics
  16. object OnlineDerivationUtil
  17. object ScalaVersionSpecificCatalystHelper
  18. object SparkConversions
  19. object SparkInternalRowConversions
  20. object StringArrayConverter
  21. object TTLCache
  22. object TileCodec
  23. object TopicInfo extends Serializable

Ungrouped