CatBoost for Apache Spark 1.2 API < Back

Packages

package root
Definition Classes
root
package ai
Definition Classes
root
package catboost
Definition Classes
ai
package spark
CatBoost is a machine learning algorithm that uses gradient boosting on decision trees.
CatBoost is a machine learning algorithm that uses gradient boosting on decision trees.
Overview
This package provides classes that implement interfaces from Apache Spark Machine Learning Library (MLLib).
For binary and multi- classification problems use CatBoostClassifier, for regression use CatBoostRegressor.
These classes implement usual fit method of org.apache.spark.ml.Predictor that accept a single org.apache.spark.sql.DataFrame for training, but you can also use other fit method that accepts additional datasets for computing evaluation metrics and overfitting detection similarily to CatBoost's other APIs.
This package also contains Pool class that is CatBoost's abstraction of a dataset. It contains additional information compared to simple org.apache.spark.sql.DataFrame.
It is also possible to create Pool with quantized features before training by calling quantize method. This is useful if this dataset is used for training multiple times and quantization parameters do not change. Pre-quantized Pool allows to cache quantized features data and so do not re-run feature quantization step at the start of an each training.
Detailed documentation is available on https://catboost.ai/docs/
Definition Classes
catboost
package impl
Definition Classes
spark
package params
Definition Classes
spark
ClassifierTrainingParamsTrait
DatasetParamsTrait
DurationParam
EnumParam
IgnoredFeaturesParams
OrderedStringMapParam
PoolLoadParams
QuantizationParams
QuantizationParamsTrait
RegressorTrainingParamsTrait
ThreadCountParams
TrainingParamsTrait

ai.catboost.spark

params

package params

Ordering

Alphabetic

Visibility

Public
Protected

Type Members

trait ClassifierTrainingParamsTrait extends TrainingParamsTrait
Params for training CatBoostClassifier.
Params for training CatBoostClassifier. See documentation on https://catboost.ai/docs/ for details.
trait DatasetParamsTrait extends HasLabelCol with HasFeaturesCol with HasWeightCol
Common dataset columns parameters
class DurationParam extends Param[Duration]
class EnumParam[E <: Enum[E]] extends Param[E]
A separate class is needed because default Param[E] won't jsonEncode/Decode properly
trait IgnoredFeaturesParams extends Params
class OrderedStringMapParam[V] extends Param[LinkedHashMap[String, V]]
supported V types are String, Long, Double or Boolean
class PoolLoadParams extends Params
Params for loading datasets in CatBoost dsv format
class QuantizationParams extends QuantizationParamsTrait
Parameters for quantization as a class.
Parameters for quantization as a class. Used in Pool!.quantize(QuantizationParamsTrait). See documentation on https://catboost.ai/docs/ for details.
trait QuantizationParamsTrait extends Params with IgnoredFeaturesParams with ThreadCountParams
Parameters for quantization.
Parameters for quantization. See documentation on https://catboost.ai/docs/ for details.
trait RegressorTrainingParamsTrait extends TrainingParamsTrait
Params for training CatBoostRegressor.
Params for training CatBoostRegressor. See documentation at https://catboost.ai/docs/ for details.
trait ThreadCountParams extends Params
trait TrainingParamsTrait extends QuantizationParamsTrait with HasLabelCol with HasFeaturesCol with HasWeightCol
Params for training CatBoost.
Params for training CatBoost. See documentation on https://catboost.ai/docs/ for details.

Value Members

object QuantizationParams extends Serializable

Packages

Overview

params

package params

Type Members

Value Members

Ungrouped

params