com.databricks.spark.csv

CsvRelation

case class CsvRelation(baseRDD: () ⇒ RDD[String], location: Option[String], useHeader: Boolean, delimiter: Char, quote: Character, escape: Character, comment: Character, parseMode: String, parserLib: String, ignoreLeadingWhiteSpace: Boolean, ignoreTrailingWhiteSpace: Boolean, treatEmptyValuesAsNulls: Boolean, userSchema: StructType = null, inferCsvSchema: Boolean, codec: String = null, nullValue: String = "", dateFormat: String = null)(sqlContext: SQLContext) extends BaseRelation with TableScan with PrunedScan with InsertableRelation with Product with Serializable

Linear Supertypes
Serializable, Serializable, Product, Equals, InsertableRelation, PrunedScan, TableScan, BaseRelation, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CsvRelation
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. InsertableRelation
  7. PrunedScan
  8. TableScan
  9. BaseRelation
  10. AnyRef
  11. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CsvRelation(baseRDD: () ⇒ RDD[String], location: Option[String], useHeader: Boolean, delimiter: Char, quote: Character, escape: Character, comment: Character, parseMode: String, parserLib: String, ignoreLeadingWhiteSpace: Boolean, ignoreTrailingWhiteSpace: Boolean, treatEmptyValuesAsNulls: Boolean, userSchema: StructType = null, inferCsvSchema: Boolean, codec: String = null, nullValue: String = "", dateFormat: String = null)(sqlContext: SQLContext)

    Attributes
    protected[com.databricks.spark]

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. val baseRDD: () ⇒ RDD[String]

  8. def buildScan(requiredColumns: Array[String]): RDD[Row]

    This supports to eliminate unneeded columns before producing an RDD containing all of its tuples as Row objects.

    This supports to eliminate unneeded columns before producing an RDD containing all of its tuples as Row objects. This reads all the tokens of each line and then drop unneeded tokens without casting and type-checking by mapping both the indices produced by requiredColumns and the ones of tokens.

    Definition Classes
    CsvRelation → PrunedScan

  9. def buildScan(): RDD[Row]

    Definition Classes
    CsvRelation → TableScan

  10. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  11. val codec: String

  12. val comment: Character

  13. val dateFormat: String

  14. val delimiter: Char

  15. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  16. val escape: Character

  17. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  18. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  19. val ignoreLeadingWhiteSpace: Boolean

  20. val ignoreTrailingWhiteSpace: Boolean

  21. val inferCsvSchema: Boolean

  22. def insert(data: DataFrame, overwrite: Boolean): Unit

    Definition Classes
    CsvRelation → InsertableRelation

  23. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  24. val location: Option[String]

  25. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  26. def needConversion: Boolean

    Definition Classes
    BaseRelation

  27. final def notify(): Unit

    Definition Classes
    AnyRef

  28. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  29. val nullValue: String

  30. val parseMode: String

  31. val parserLib: String

  32. val quote: Character

  33. val schema: StructType

    Definition Classes
    CsvRelation → BaseRelation

  34. def sizeInBytes: Long

    Definition Classes
    BaseRelation

  35. val sqlContext: SQLContext

    Definition Classes
    CsvRelation → BaseRelation

  36. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  37. val treatEmptyValuesAsNulls: Boolean

  38. def unhandledFilters(filters: Array[Filter]): Array[Filter]

    Definition Classes
    BaseRelation

  39. val useHeader: Boolean

  40. val userSchema: StructType

  41. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  42. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  43. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from InsertableRelation

Inherited from PrunedScan

Inherited from TableScan

Inherited from BaseRelation

Inherited from AnyRef

Inherited from Any

Ungrouped