class AvroDataFileReader extends AvroFileReader
AvroDataFileReader reads the Avro file data in the iterator pattern. You can use it as below. while(reader.hasNextBlock) { val b = reader.peekBlock estimateBufSize(b) // allocate the batch buffer reader.readNextRawBlock(buffer_as_out_stream) }
- Alphabetic
- By Inheritance
- AvroDataFileReader
- AvroFileReader
- AutoCloseable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new AvroDataFileReader(si: SeekableInput)
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
close(): Unit
- Definition Classes
- AvroFileReader → AutoCloseable
-
var
curBlockStart: Long
- Attributes
- protected
- Definition Classes
- AvroFileReader
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hasNextBlock(): Boolean
Test if there is a block.
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
val
header: Header
- Definition Classes
- AvroFileReader
-
val
headerSize: Long
- Definition Classes
- AvroFileReader
-
val
headerSync: Array[Byte]
- Attributes
- protected
- Definition Classes
- AvroFileReader
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
pastSync(position: Long): Boolean
Return true if current point is past the next sync point after a position.
Return true if current point is past the next sync point after a position.
- Definition Classes
- AvroFileReader
-
def
peekBlock(reuse: MutableBlockInfo): MutableBlockInfo
Get the current block metadata.
Get the current block metadata. Call 'readNextRawBlock' to get the block raw data. Better to check its existence by calling 'hasNextBlock' first. This will not move the reader position forward.
-
def
readNextRawBlock(out: OutputStream): Unit
Read the current block raw data to the given output stream.
-
def
seek(position: Long): Unit
- Attributes
- protected
- Definition Classes
- AvroFileReader
-
val
sin: AvroSeekableInputStream
- Attributes
- protected
- Definition Classes
- AvroFileReader
-
def
skip(length: Int): Unit
Skip next length bytes
Skip next length bytes
- Definition Classes
- AvroFileReader
-
def
skipCurrentBlock(): Unit
Skip the current raw block
-
def
sync(position: Long): Unit
Move to the next synchronization point after a position.
Move to the next synchronization point after a position. To process a range of file entries, call this with the starting position, then check "pastSync(long)" with the end position before each call to "peekBlock()" or "readNextRawBlock". (Based off of the 'sync' in "DataFileReader" of apache/avro)
- Definition Classes
- AvroFileReader
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
var
vin: BinaryDecoder
- Attributes
- protected
- Definition Classes
- AvroFileReader
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()