Packages

class ColsToNumeric[T] extends RowTransformSchema

A schema which specialize on transforming multiple numeric columns to one Tensor. Types of selected columns will be identified according to their [DataType. And type conversions will be done automatically from DataType to T if valid. Currently, DoubleType, FloatType, ShortType, IntegerType, LongType are supported.

T

the type of result Tensor

Linear Supertypes
RowTransformSchema, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ColsToNumeric
  2. RowTransformSchema
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ColsToNumeric(schemaKey: String, indices: Seq[Int] = Seq.empty, fieldNames: Seq[String] = Seq.empty)(implicit arg0: ClassTag[T], ev: TensorNumeric[T])

    schemaKey

    key of the schema

    indices

    indices of selected columns

    fieldNames

    field names of selected columns

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. val fieldNames: Seq[String]

    This property will override indices when it is not empty.

    FieldNames of Selected Columns

    This property will override indices when it is not empty.

    Definition Classes
    ColsToNumeric → RowTransformSchema
  9. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. val indices: Seq[Int]

    It will work on only when fieldNames is empty, otherwise RowTransformer will select columns accord to fieldNames.

    Indices of Selected Columns

    It will work on only when fieldNames is empty, otherwise RowTransformer will select columns accord to fieldNames. If both indices and fieldNames are empty, RowTransformer will select all columns by default.

    Definition Classes
    ColsToNumeric → RowTransformSchema
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. val schemaKey: String

    Key of the schema, which will be the key of Tensor in result Table.

    Key of the schema, which will be the key of Tensor in result Table. So, it should be unique in single RowTransformer.

    Definition Classes
    ColsToNumeric → RowTransformSchema
  18. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. def transform(input: Seq[Any], fields: Seq[StructField]): Tensor[NumericWildcard]

    Transforming Logic of the Schema

    Transforming Logic of the Schema

    fields

    StructFields of selected columns

    returns

    a result Tensor

    Definition Classes
    ColsToNumeric → RowTransformSchema
  21. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )

Inherited from RowTransformSchema

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped