Class

za.co.absa.abris.avro.read

ScalaDatumReader

Related Doc: package read

Permalink

class ScalaDatumReader[T] extends SpecificDatumReader[T] with Serializable

Avro uses its own representations of Strings and Arrays, as well as a Java HashMap to back map records.

As those types are not directly translatable to Scala, this class overrides SpecificDatumReader to manually perform the translations at runtime.

Linear Supertypes
Serializable, Serializable, SpecificDatumReader[T], GenericDatumReader[T], DatumReader[T], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ScalaDatumReader
  2. Serializable
  3. Serializable
  4. SpecificDatumReader
  5. GenericDatumReader
  6. DatumReader
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ScalaDatumReader(schema: Schema)

    Permalink
  2. new ScalaDatumReader(writerSchema: Schema, readerSchema: Schema)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def addToArray(array: AnyRef, post: Long, e: AnyRef): Unit

    Permalink
    Definition Classes
    ScalaDatumReader → GenericDatumReader
  5. def addToMap(map: AnyRef, key: AnyRef, value: AnyRef): Unit

    Permalink
    Definition Classes
    ScalaDatumReader → GenericDatumReader
  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def convert(arg0: Any, arg1: Schema, arg2: LogicalType, arg3: Conversion[_]): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
  9. def createBytes(arg0: Array[Byte]): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
  10. def createEnum(arg0: String, arg1: Schema): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
  11. def createString(arg0: String): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
  12. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  13. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  14. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. def findStringClass(arg0: Schema): Class[_]

    Permalink
    Attributes
    protected[org.apache.avro.specific]
    Definition Classes
    SpecificDatumReader → GenericDatumReader
  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  17. def getData(): GenericData

    Permalink
    Definition Classes
    GenericDatumReader
  18. def getExpected(): Schema

    Permalink
    Definition Classes
    GenericDatumReader
  19. final def getResolver(arg0: Schema, arg1: Schema): ResolvingDecoder

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  20. def getSchema(): Schema

    Permalink
    Definition Classes
    GenericDatumReader
  21. def getSpecificData(): SpecificData

    Permalink
    Definition Classes
    SpecificDatumReader
  22. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  23. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  25. def newArray(old: AnyRef, size: Int, schema: Schema): ListBuffer[Any]

    Permalink

    This method was overriden so that every collection is read as a Scala's mutable.ListBuffer instead of Avro's GenericData.ARRAY.

    This method was overriden so that every collection is read as a Scala's mutable.ListBuffer instead of Avro's GenericData.ARRAY.

    Definition Classes
    ScalaDatumReader → GenericDatumReader
  26. def newInstanceFromString(arg0: Class[_], arg1: String): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
  27. def newMap(old: AnyRef, size: Int): AnyRef

    Permalink

    This method was overriden since Avro's original implementation relies on Java HashMaps, which are not directly translatable to Spark MapType.

    This method was overriden since Avro's original implementation relies on Java HashMaps, which are not directly translatable to Spark MapType.

    Definition Classes
    ScalaDatumReader → GenericDatumReader
  28. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  29. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  30. def peekArray(arg0: Any): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
  31. def read(arg0: Any, arg1: Schema, arg2: ResolvingDecoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  32. def read(arg0: T, arg1: Decoder): T

    Permalink
    Definition Classes
    GenericDatumReader → DatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  33. def readArray(arg0: Any, arg1: Schema, arg2: ResolvingDecoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  34. def readBytes(arg0: Any, arg1: Decoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  35. def readBytes(arg0: Any, arg1: Schema, arg2: Decoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  36. def readEnum(arg0: Schema, arg1: Decoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  37. def readField(arg0: Any, arg1: Field, arg2: Any, arg3: ResolvingDecoder, arg4: Any): Unit

    Permalink
    Attributes
    protected[org.apache.avro.specific]
    Definition Classes
    SpecificDatumReader → GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  38. def readFixed(arg0: Any, arg1: Schema, arg2: Decoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  39. def readInt(arg0: Any, arg1: Schema, arg2: Decoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  40. def readMap(arg0: Any, arg1: Schema, arg2: ResolvingDecoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  41. def readMapKey(arg0: Any, arg1: Schema, arg2: Decoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  42. def readRecord(arg0: Any, arg1: Schema, arg2: ResolvingDecoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  43. def readString(old: AnyRef, expected: Schema, in: Decoder): String

    Permalink

    This method was overriden to force all Strings to be read as Scala strings instead of Avro's org.apache.avro.util.Utf8.

    This method was overriden to force all Strings to be read as Scala strings instead of Avro's org.apache.avro.util.Utf8.

    Definition Classes
    ScalaDatumReader → GenericDatumReader
  44. def readString(arg0: Any, arg1: Decoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  45. def readWithConversion(arg0: Any, arg1: Schema, arg2: LogicalType, arg3: Conversion[_], arg4: ResolvingDecoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  46. def readWithoutConversion(arg0: Any, arg1: Schema, arg2: ResolvingDecoder): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @throws( classOf[java.io.IOException] )
  47. def setExpected(arg0: Schema): Unit

    Permalink
    Definition Classes
    GenericDatumReader
  48. def setSchema(arg0: Schema): Unit

    Permalink
    Definition Classes
    SpecificDatumReader → GenericDatumReader → DatumReader
  49. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  50. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  51. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  52. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  53. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def createFixed(arg0: Any, arg1: Array[Byte], arg2: Schema): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @Deprecated @deprecated
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

  2. def createFixed(arg0: Any, arg1: Schema): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @Deprecated @deprecated
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

  3. def newRecord(arg0: Any, arg1: Schema): AnyRef

    Permalink
    Attributes
    protected[org.apache.avro.generic]
    Definition Classes
    GenericDatumReader
    Annotations
    @Deprecated @deprecated
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from Serializable

Inherited from Serializable

Inherited from SpecificDatumReader[T]

Inherited from GenericDatumReader[T]

Inherited from DatumReader[T]

Inherited from AnyRef

Inherited from Any

Ungrouped