| Interface | Description |
|---|---|
| SingleFileHdfsReader |
| Class | Description |
|---|---|
| AvroFileHdfsReader |
An implementation of the HdfsReader that reads and processes avro format
files.
|
| AvroFileHdfsReader.AvroFileCheckpoint |
An avro file looks something like this:
Byte offset: 0 103 271 391
┌────────┬──────────────┬───────────┬───────────┐
Avro file: │ Header │ Block 1 │ Block 2 │ Block 3 │ ...
|
| HdfsReaderFactory | |
| MultiFileHdfsReader |
A wrapper on top of
SingleFileHdfsReader
to manage the situation of multiple files per partition. |
| Enum | Description |
|---|---|
| HdfsReaderFactory.ReaderType |