com.google.cloud.spark.bigquery.write.context

Class BigQueryDirectDataWriterContextFactory

java.lang.Object

com.google.cloud.spark.bigquery.write.context.BigQueryDirectDataWriterContextFactory

All Implemented Interfaces:

DataWriterContextFactory<org.apache.spark.sql.catalyst.InternalRow>, Serializable

public class BigQueryDirectDataWriterContextFactory
extends Object
implements DataWriterContextFactory<org.apache.spark.sql.catalyst.InternalRow>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
BigQueryDirectDataWriterContextFactory(BigQueryClientFactory writeClientFactory, String tablePath, org.apache.spark.sql.types.StructType sparkSchema, com.google.cloud.bigquery.storage.v1.ProtoSchema protoSchema, boolean ignoreInputs, com.google.api.gax.retrying.RetrySettings bigqueryDataWriterHelperRetrySettings, com.google.common.base.Optional<String> traceId, boolean writeAtLeastOnce)

Method Summary

Modifier and Type	Method and Description
DataWriterContext<org.apache.spark.sql.catalyst.InternalRow>	createDataWriterContext(int partitionId, long taskId, long epochId) If ignoreInputs is true, return a NoOpDataWriter, a stub class that performs no operations upon the call of its methods; otherwise return BigQueryDataWriter.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BigQueryDirectDataWriterContextFactory

public BigQueryDirectDataWriterContextFactory(BigQueryClientFactory writeClientFactory,
                                              String tablePath,
                                              org.apache.spark.sql.types.StructType sparkSchema,
                                              com.google.cloud.bigquery.storage.v1.ProtoSchema protoSchema,
                                              boolean ignoreInputs,
                                              com.google.api.gax.retrying.RetrySettings bigqueryDataWriterHelperRetrySettings,
                                              com.google.common.base.Optional<String> traceId,
                                              boolean writeAtLeastOnce)

Method Detail

createDataWriterContext

public DataWriterContext<org.apache.spark.sql.catalyst.InternalRow> createDataWriterContext(int partitionId,
                                                                                            long taskId,
                                                                                            long epochId)

If ignoreInputs is true, return a NoOpDataWriter, a stub class that performs no operations upon the call of its methods; otherwise return BigQueryDataWriter.

Specified by:

createDataWriterContext in interface DataWriterContextFactory<org.apache.spark.sql.catalyst.InternalRow>

Parameters:

partitionId - The partitionId of the DataWriter to be created

taskId - the taskId

epochId - the epochId

Returns:

The DataWriter to be used.

See Also:

NoOpDataWriterContext, BigQueryDirectDataWriterContext