com.google.cloud.spark.bigquery

Class InternalRowIterator

java.lang.Object

com.google.cloud.spark.bigquery.InternalRowIterator

All Implemented Interfaces:

Iterator<org.apache.spark.sql.catalyst.InternalRow>

public class InternalRowIterator
extends Object
implements Iterator<org.apache.spark.sql.catalyst.InternalRow>

Iterator on InternalRow that wraps the conversion from Avro/Arrow schema to InternalRow

Constructor Summary

Constructors

Constructor and Description
InternalRowIterator(Iterator<com.google.cloud.bigquery.storage.v1.ReadRowsResponse> readRowsResponses, ReadRowsResponseToInternalRowIteratorConverter converter, ReadRowsHelper readRowsHelper, BigQueryStorageReadRowsTracer bigQueryStorageReadRowsTracer)

Method Summary

Modifier and Type	Method and Description
boolean	hasNext()
org.apache.spark.sql.catalyst.InternalRow	next()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining, remove

Constructor Detail

InternalRowIterator

public InternalRowIterator(Iterator<com.google.cloud.bigquery.storage.v1.ReadRowsResponse> readRowsResponses,
                           ReadRowsResponseToInternalRowIteratorConverter converter,
                           ReadRowsHelper readRowsHelper,
                           BigQueryStorageReadRowsTracer bigQueryStorageReadRowsTracer)

Method Detail

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator<org.apache.spark.sql.catalyst.InternalRow>

next

public org.apache.spark.sql.catalyst.InternalRow next()

Specified by:

next in interface Iterator<org.apache.spark.sql.catalyst.InternalRow>