Packages

p

com.ebiznext.comet

workflow

package workflow

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. case class ImportConfig() extends Product with Serializable
  2. class IngestionWorkflow extends StrictLogging

    The whole worklfow works as follow :

    The whole worklfow works as follow :

    • loadLanding : Zipped files are uncompressed or raw files extracted from the local filesystem. -loadPending : files recognized with filename patterns are stored in the ingesting area and submitted for ingestion files with unrecognized filename patterns are stored in the unresolved area
    • ingest : files are finally ingested and saved as parquet/orc/... files and hive tables
  3. case class TransformConfig(name: String = "", options: Map[String, String] = Map.empty, views: Seq[String] = Nil, viewsDir: Option[String] = None, viewsCount: Int = 1000) extends Product with Serializable
  4. case class WatchConfig(includes: Seq[String] = Seq.empty, excludes: Seq[String] = Seq.empty, schemas: Seq[String] = Seq.empty, options: Map[String, String] = Map.empty) extends Product with Serializable

Value Members

  1. object ImportConfig extends CliConfig[ImportConfig] with Serializable
  2. object TransformConfig extends CliConfig[TransformConfig] with Serializable
  3. object WatchConfig extends CliConfig[WatchConfig] with Serializable

Ungrouped