com.google.cloud.spark.bigquery

Class AvroBinaryIterator

java.lang.Object

com.google.cloud.spark.bigquery.AvroBinaryIterator

All Implemented Interfaces:

Iterator<org.apache.spark.sql.catalyst.InternalRow>

public class AvroBinaryIterator
extends Object
implements Iterator<org.apache.spark.sql.catalyst.InternalRow>

Constructor Summary

Constructors

Constructor and Description

AvroBinaryIterator(com.google.cloud.bigquery.Schema bqSchema, List<String> columnsInOrder, org.apache.avro.Schema schema, com.google.cloud.bigquery.storage.v1.ReadRowsResponse response, Optional<org.apache.spark.sql.types.StructType> userProvidedSchema, Optional<BigQueryStorageReadRowsTracer> bigQueryStorageReadRowsTracer, SchemaConvertersConfiguration schemaConvertersConfiguration, com.google.cloud.bigquery.storage.v1.ReadSession.TableReadOptions.ResponseCompressionCodec responseCompressionCodec) An iterator for scanning over rows serialized in Avro format

Method Summary

Modifier and Type	Method and Description
boolean	hasNext()
org.apache.spark.sql.catalyst.InternalRow	next()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining, remove

Constructor Detail

AvroBinaryIterator

public AvroBinaryIterator(com.google.cloud.bigquery.Schema bqSchema,
                          List<String> columnsInOrder,
                          org.apache.avro.Schema schema,
                          com.google.cloud.bigquery.storage.v1.ReadRowsResponse response,
                          Optional<org.apache.spark.sql.types.StructType> userProvidedSchema,
                          Optional<BigQueryStorageReadRowsTracer> bigQueryStorageReadRowsTracer,
                          SchemaConvertersConfiguration schemaConvertersConfiguration,
                          com.google.cloud.bigquery.storage.v1.ReadSession.TableReadOptions.ResponseCompressionCodec responseCompressionCodec)

An iterator for scanning over rows serialized in Avro format

Parameters:

bqSchema - Schema of underlying BigQuery source

columnsInOrder - Sequence of columns in the schema

schema - Schema in avro format

rowsInBytes - Rows serialized in binary format for Avro

Method Detail

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator<org.apache.spark.sql.catalyst.InternalRow>

next

public org.apache.spark.sql.catalyst.InternalRow next()

Specified by:

next in interface Iterator<org.apache.spark.sql.catalyst.InternalRow>