CatBoost for Apache Spark 1.2 API < Back

Packages

package root
Definition Classes
root
package ai
Definition Classes
root
package catboost
Definition Classes
ai
package spark
CatBoost is a machine learning algorithm that uses gradient boosting on decision trees.
CatBoost is a machine learning algorithm that uses gradient boosting on decision trees.
Overview
This package provides classes that implement interfaces from Apache Spark Machine Learning Library (MLLib).
For binary and multi- classification problems use CatBoostClassifier, for regression use CatBoostRegressor.
These classes implement usual fit method of org.apache.spark.ml.Predictor that accept a single org.apache.spark.sql.DataFrame for training, but you can also use other fit method that accepts additional datasets for computing evaluation metrics and overfitting detection similarily to CatBoost's other APIs.
This package also contains Pool class that is CatBoost's abstraction of a dataset. It contains additional information compared to simple org.apache.spark.sql.DataFrame.
It is also possible to create Pool with quantized features before training by calling quantize method. This is useful if this dataset is used for training multiple times and quantization parameters do not change. Pre-quantized Pool allows to cache quantized features data and so do not re-run feature quantization step at the start of an each training.
Detailed documentation is available on https://catboost.ai/docs/
Definition Classes
catboost
package impl
Definition Classes
spark
package params
Definition Classes
spark
CatBoostClassificationModel
CatBoostClassifier
CatBoostPredictorTrait
CatBoostRegressionModel
CatBoostRegressor
CatBoostTrainingContext
FeatureImportance
FeatureInteractionScore
Pool
PoolReader
PoolWriter

ai.catboost.spark

PoolWriter

class PoolWriter extends AnyRef

Linear Supertypes

AnyRef, Any

Ordering

Alphabetic
By Inheritance

Inherited

PoolWriter
AnyRef
Any

Hide All
Show All

Visibility

Public
Protected

Instance Constructors

new PoolWriter(pool: Pool, dataFramesWriterFormatValue: Option[String] = None, dataFramesWriterOptionsValue: HashMap[String, String] = new mutable.HashMap[String, String](), saveMode: SaveMode = SaveMode.ErrorIfExists)

Value Members

final def !=(arg0: Any): Boolean
Definition Classes
AnyRef → Any
final def ##: Int
Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean
Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0
Definition Classes
Any
def clone(): AnyRef
Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.CloneNotSupportedException]) @native()
def dataFramesWriterFormat(source: String): PoolWriter
def dataFramesWriterOption(name: String, value: AnyRef): PoolWriter
def dataFramesWriterOptions(options: Map[String, String]): PoolWriter
def dataFramesWriterOptions(options: Map[String, String]): PoolWriter
final def eq(arg0: AnyRef): Boolean
Definition Classes
AnyRef
def equals(arg0: AnyRef): Boolean
Definition Classes
AnyRef → Any
def finalize(): Unit
Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.Throwable])
final def getClass(): Class[_ <: AnyRef]
Definition Classes
AnyRef → Any
Annotations
@native()
def hashCode(): Int
Definition Classes
AnyRef → Any
Annotations
@native()
final def isInstanceOf[T0]: Boolean
Definition Classes
Any
def mode(saveModeArg: SaveMode): PoolWriter
def mode(saveModeArg: String): PoolWriter
final def ne(arg0: AnyRef): Boolean
Definition Classes
AnyRef
final def notify(): Unit
Definition Classes
AnyRef
Annotations
@native()
final def notifyAll(): Unit
Definition Classes
AnyRef
Annotations
@native()
val pool: Pool
def save(path: String): Unit
final def synchronized[T0](arg0: => T0): T0
Definition Classes
AnyRef
def toString(): String
Definition Classes
AnyRef → Any
final def wait(): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException])
final def wait(arg0: Long, arg1: Int): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException])
final def wait(arg0: Long): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException]) @native()

Packages

Overview

PoolWriter

class PoolWriter extends AnyRef

Instance Constructors

Value Members

Inherited from AnyRef

Inherited from Any

Ungrouped

Packages

Overview

PoolWriter

class PoolWriter extends AnyRef

Instance Constructors

Value Members

Inherited from AnyRef

Inherited from Any

Ungrouped

PoolWriter