object HiveScriptIOSchema extends HiveInspectors
- Alphabetic
- By Inheritance
- HiveScriptIOSchema
- HiveInspectors
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Type Members
- implicit class typeInfoConversions extends AnyRef
- Definition Classes
- HiveInspectors
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def initInputSerDe(ioschema: ScriptTransformationIOSchema, input: Seq[Expression]): Option[(AbstractSerDe, StructObjectInspector)]
- def initOutputSerDe(ioschema: ScriptTransformationIOSchema, output: Seq[Attribute]): Option[(AbstractSerDe, StructObjectInspector)]
- def initSerDe(serdeClassName: String, columns: Seq[String], columnTypes: Seq[DataType], serdeProps: Seq[(String, String)]): AbstractSerDe
- def inspectorToDataType(inspector: ObjectInspector): DataType
- Definition Classes
- HiveInspectors
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def javaTypeToDataType(clz: Type): DataType
- Definition Classes
- HiveInspectors
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def recordReader(ioschema: ScriptTransformationIOSchema, inputStream: InputStream, conf: Configuration): Option[RecordReader]
- def recordWriter(ioschema: ScriptTransformationIOSchema, outputStream: OutputStream, conf: Configuration): Option[RecordWriter]
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toInspector(expr: Expression): ObjectInspector
Map the catalyst expression to ObjectInspector, however, if the expression is
Literalor foldable, a constant writable object inspector returns; Otherwise, we always get the object inspector according to its data type(in catalyst)Map the catalyst expression to ObjectInspector, however, if the expression is
Literalor foldable, a constant writable object inspector returns; Otherwise, we always get the object inspector according to its data type(in catalyst)- expr
Catalyst expression to be mapped
- returns
Hive java objectinspector (recursively).
- Definition Classes
- HiveInspectors
- def toInspector(dataType: DataType): ObjectInspector
- dataType
Catalyst data type
- returns
Hive java object inspector (recursively), not the Writable ObjectInspector We can easily map to the Hive built-in object inspector according to the data type.
- Definition Classes
- HiveInspectors
- def toString(): String
- Definition Classes
- AnyRef → Any
- def unwrapperFor(field: StructField): (Any, InternalRow, Int) => Unit
Builds unwrappers ahead of time according to object inspector types to avoid pattern matching and branching costs per row.
Builds unwrappers ahead of time according to object inspector types to avoid pattern matching and branching costs per row.
- field
The HiveStructField to create an unwrapper for.
- returns
A function that performs in-place updating of a MutableRow. Use the overloaded ObjectInspector version for assignments.
- Definition Classes
- HiveInspectors
- def unwrapperFor(objectInspector: ObjectInspector): (Any) => Any
Builds unwrappers ahead of time according to object inspector types to avoid pattern matching and branching costs per row.
Builds unwrappers ahead of time according to object inspector types to avoid pattern matching and branching costs per row.
Strictly follows the following order in unwrapping (constant OI has the higher priority): Constant Null object inspector => return null Constant object inspector => extract the value from constant object inspector If object inspector prefers writable => extract writable from
dataand then get the catalyst type from the writable Extract the java object directly from the object inspectorNOTICE: the complex data type requires recursive unwrapping.
- objectInspector
the ObjectInspector used to create an unwrapper.
- returns
A function that unwraps data objects. Use the overloaded HiveStructField version for in-place updating of a MutableRow.
- Definition Classes
- HiveInspectors
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- def wrap(row: Seq[Any], wrappers: Array[(Any) => Any], cache: Array[AnyRef], dataTypes: Array[DataType]): Array[AnyRef]
- Definition Classes
- HiveInspectors
- def wrap(row: InternalRow, wrappers: Array[(Any) => Any], cache: Array[AnyRef], dataTypes: Array[DataType]): Array[AnyRef]
- Definition Classes
- HiveInspectors
- def wrap(a: Any, oi: ObjectInspector, dataType: DataType): AnyRef
- Definition Classes
- HiveInspectors
- def wrapperFor(oi: ObjectInspector, dataType: DataType): (Any) => Any
Wraps with Hive types based on object inspector.
Wraps with Hive types based on object inspector.
- Attributes
- protected
- Definition Classes
- HiveInspectors