package coxautodata
Ordering
- Alphabetic
Visibility
- Public
- All
Type Members
- case class Config(options: SparkDistCPOptions = SparkDistCPOptions(), URIs: Seq[URI] = Seq.empty) extends Product with Serializable
-
case class
SparkDistCPOptions(update: Boolean = SparkDistCPOptions.Defaults.update, overwrite: Boolean = ..., delete: Boolean = SparkDistCPOptions.Defaults.delete, log: Option[URI] = SparkDistCPOptions.Defaults.log, ignoreErrors: Boolean = ..., dryRun: Boolean = SparkDistCPOptions.Defaults.dryRun, consistentPathBehaviour: Boolean = ..., maxFilesPerTask: Int = ..., maxBytesPerTask: Long = ..., filterNot: List[Regex] = ..., numListstatusThreads: Int = ..., verbose: Boolean = SparkDistCPOptions.Defaults.verbose) extends Product with Serializable
Options for the DistCP application See OptionsParsing.parse for the explanation of each option
Value Members
- object OptionsParsing
-
object
SparkDistCP extends Logging
Spark-based DistCp application.
Spark-based DistCp application. SparkDistCP.main is the command-line entry to the application and SparkDistCP.run is the programmatic API entry to the application
- object SparkDistCPOptions extends Serializable