com.google.cloud.bigquery.connector.common

Class LoggingBigQueryStorageReadRowsTracer

java.lang.Object

com.google.cloud.bigquery.connector.common.LoggingBigQueryStorageReadRowsTracer

All Implemented Interfaces:

BigQueryStorageReadRowsTracer, Serializable

public class LoggingBigQueryStorageReadRowsTracer
extends Object
implements BigQueryStorageReadRowsTracer

Implementation of BigQueryStorageReadRowsTracer that accumulates and logs times periodically.

See Also:

Serialized Form

Method Summary

Modifier and Type	Method and Description
void	finished() The ReadRows stream has finished.
BigQueryStorageReadRowsTracer	forkWithPrefix(String id) Must only be called before any calls are made to the tracer.
long	getBytesRead()
long	getParseTimeInMilliSec()
long	getRowsRead()
long	getScanTimeInMilliSec()
long	getTimeInSparkInMilliSec()
void	nextBatchNeeded() Called when the next batch is needed from spark.
void	readRowsResponseObtained(long bytes) Indicates the next ReadRowsResponse was requested from the server.
void	readRowsResponseRequested() Indicates the next ReadRowsResponse was requested from the server.
void	rowsParseFinished(long rows) Indicates when a decoded item was delivered.
void	rowsParseStarted() Indicates a fully decoded element has been requested by spark (i.e.
void	startStream() Record stream initialization time.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

startStream

public void startStream()

Description copied from interface: BigQueryStorageReadRowsTracer

Record stream initialization time.

Specified by:

startStream in interface BigQueryStorageReadRowsTracer

rowsParseStarted

public void rowsParseStarted()

Description copied from interface: BigQueryStorageReadRowsTracer

Indicates a fully decoded element has been requested by spark (i.e. Arrow RecordBatch).

Specified by:

rowsParseStarted in interface BigQueryStorageReadRowsTracer

rowsParseFinished

public void rowsParseFinished(long rows)

Description copied from interface: BigQueryStorageReadRowsTracer

Indicates when a decoded item was delivered.

Specified by:

rowsParseFinished in interface BigQueryStorageReadRowsTracer

readRowsResponseRequested

public void readRowsResponseRequested()

Description copied from interface: BigQueryStorageReadRowsTracer

Indicates the next ReadRowsResponse was requested from the server.

Specified by:

readRowsResponseRequested in interface BigQueryStorageReadRowsTracer

readRowsResponseObtained

public void readRowsResponseObtained(long bytes)

Description copied from interface: BigQueryStorageReadRowsTracer

Indicates the next ReadRowsResponse was requested from the server.

Specified by:

readRowsResponseObtained in interface BigQueryStorageReadRowsTracer

finished

public void finished()

Description copied from interface: BigQueryStorageReadRowsTracer

The ReadRows stream has finished.

Specified by:

finished in interface BigQueryStorageReadRowsTracer

nextBatchNeeded

public void nextBatchNeeded()

Description copied from interface: BigQueryStorageReadRowsTracer

Called when the next batch is needed from spark.

Specified by:

nextBatchNeeded in interface BigQueryStorageReadRowsTracer

forkWithPrefix

public BigQueryStorageReadRowsTracer forkWithPrefix(String id)

Description copied from interface: BigQueryStorageReadRowsTracer

Must only be called before any calls are made to the tracer. This is intended for cases when multiple threads might be used for processing one stream. tracer that is distinguished between IDs.

Specified by:

forkWithPrefix in interface BigQueryStorageReadRowsTracer

Parameters:

id - A distinguisher to use.

Returns:

A new tracer with the ID>

getBytesRead

public long getBytesRead()

Specified by:

getBytesRead in interface BigQueryStorageReadRowsTracer

getRowsRead

public long getRowsRead()

Specified by:

getRowsRead in interface BigQueryStorageReadRowsTracer

getScanTimeInMilliSec

public long getScanTimeInMilliSec()

Specified by:

getScanTimeInMilliSec in interface BigQueryStorageReadRowsTracer

getParseTimeInMilliSec

public long getParseTimeInMilliSec()

Specified by:

getParseTimeInMilliSec in interface BigQueryStorageReadRowsTracer

getTimeInSparkInMilliSec

public long getTimeInSparkInMilliSec()

Specified by:

getTimeInSparkInMilliSec in interface BigQueryStorageReadRowsTracer