trait FromParquet extends AnyRef
Factory of builders of Parquet readers.
- Alphabetic
- By Inheritance
- FromParquet
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Abstract Value Members
- abstract def as[T](implicit arg0: ParquetRecordDecoder[T]): Builder[T]
Creates Builder of Parquet reader for documents of type T.
- abstract def custom[T](builder: org.apache.parquet.hadoop.ParquetReader.Builder[T]): CustomBuilder[T]
Creates CustomBuilder of Parquet reader data using custom internal implementation.
Creates CustomBuilder of Parquet reader data using custom internal implementation.
- Annotations
- @experimental()
- abstract def generic: Builder[RowParquetRecord]
Creates Builder of Parquet reader of generic records.
- abstract def projectedAs[T](implicit arg0: ParquetRecordDecoder[T], arg1: ParquetSchemaResolver[T]): Builder[T]
Creates Builder of Parquet reader for projected documents of type T.
Creates Builder of Parquet reader for projected documents of type T. Due to projection reader does not attempt to read all existing columns of the file but applies enforced projection schema.
- abstract def projectedGeneric(col: TypedColumnPath[_], cols: TypedColumnPath[_]*): Builder[RowParquetRecord]
Creates Builder of Parquet reader returning projected generic records.
Creates Builder of Parquet reader returning projected generic records. Due to projection, reader does not attempt to read all existing columns of the file but applies enforced projection schema. Besides simple projection one can use aliases and extract values from nested fields - in a way similar to SQL.
- col
first column projection
- cols
next column projections
projectedGeneric( Col("foo").as[Int], // selects Int column "foo" Col("bar.baz".as[String]), // selects String field "bar.baz", creates column "baz" wih a value of "baz" Col("bar.baz".as[String].alias("bar_baz")) // selects String field "bar.baz", creates column "bar_baz" wih a value of "baz" )
Example: - abstract def projectedGeneric(projectedSchema: MessageType): Builder[RowParquetRecord]
Creates Builder of Parquet reader of projected generic records.
Creates Builder of Parquet reader of projected generic records. Due to projection reader does not attempt to read all existing columns of the file but applies enforced projection schema.
Concrete Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()