Uses of Class
com.google.cloud.spark.bigquery.SparkBigQueryConfig

Packages that use SparkBigQueryConfig

Package	Description
com.google.cloud.spark.bigquery
com.google.cloud.spark.bigquery.direct
com.google.cloud.spark.bigquery.write
com.google.cloud.spark.bigquery.write.context

Uses of SparkBigQueryConfig in com.google.cloud.spark.bigquery

Methods in com.google.cloud.spark.bigquery that return SparkBigQueryConfig

Modifier and Type	Method and Description
static SparkBigQueryConfig	SparkBigQueryUtil.createSparkBigQueryConfig(org.apache.spark.sql.SQLContext sqlContext, scala.collection.immutable.Map<String,String> options, scala.Option<org.apache.spark.sql.types.StructType> schema, DataSourceVersion dataSourceVersion)
static SparkBigQueryConfig	SparkBigQueryConfig.from(Map<String,String> optionsInput, com.google.common.collect.ImmutableMap<String,String> originalGlobalOptions, org.apache.hadoop.conf.Configuration hadoopConfiguration, com.google.common.collect.ImmutableMap<String,String> customDefaults, int defaultParallelism, org.apache.spark.sql.internal.SQLConf sqlConf, String sparkVersion, Optional<org.apache.spark.sql.types.StructType> schema, boolean tableIsMandatory)
static SparkBigQueryConfig	SparkBigQueryConfig.from(Map<String,String> options, com.google.common.collect.ImmutableMap<String,String> customDefaults, DataSourceVersion dataSourceVersion, org.apache.spark.sql.SparkSession spark, Optional<org.apache.spark.sql.types.StructType> schema, boolean tableIsMandatory)
SparkBigQueryConfig	SparkBigQueryConnectorModule.provideSparkBigQueryConfig()

Methods in com.google.cloud.spark.bigquery with parameters of type SparkBigQueryConfig

Modifier and Type	Method and Description
static org.apache.hadoop.fs.Path	SparkBigQueryUtil.createGcsPath(SparkBigQueryConfig config, org.apache.hadoop.conf.Configuration conf, String applicationId) Checks whether temporaryGcsBucket or persistentGcsBucket parameters are present in the config and creates a org.apache.hadoop.fs.Path object backed by GCS.
static SchemaConvertersConfiguration	SchemaConvertersConfiguration.from(SparkBigQueryConfig config)
InjectorBuilder	InjectorBuilder.withConfig(SparkBigQueryConfig config)

Constructors in com.google.cloud.spark.bigquery with parameters of type SparkBigQueryConfig

Constructor and Description
BigQueryRelation(SparkBigQueryConfig options, com.google.cloud.bigquery.TableInfo table, org.apache.spark.sql.SQLContext sqlContext)

Constructor parameters in com.google.cloud.spark.bigquery with type arguments of type SparkBigQueryConfig

Constructor and Description
SparkBigQueryConnectorModule(org.apache.spark.sql.SparkSession spark, Map<String,String> options, Map<String,String> customDefaults, Optional<org.apache.spark.sql.types.StructType> schema, DataSourceVersion dataSourceVersion, boolean tableIsMandatory, Optional<SparkBigQueryConfig> config)

Uses of SparkBigQueryConfig in com.google.cloud.spark.bigquery.direct

Constructors in com.google.cloud.spark.bigquery.direct with parameters of type SparkBigQueryConfig

Constructor and Description
BigQueryRDDFactory(BigQueryClient bigQueryClient, BigQueryClientFactory bigQueryReadClientFactory, BigQueryTracerFactory bigQueryTracerFactory, SparkBigQueryConfig options, org.apache.spark.sql.SQLContext sqlContext)
DirectBigQueryRelation(SparkBigQueryConfig options, com.google.cloud.bigquery.TableInfo table, BigQueryClient bigQueryClient, BigQueryClientFactory bigQueryReadClientFactory, BigQueryTracerFactory bigQueryTracerFactory, org.apache.spark.sql.SQLContext sqlContext)

Uses of SparkBigQueryConfig in com.google.cloud.spark.bigquery.write

Fields in com.google.cloud.spark.bigquery.write declared as SparkBigQueryConfig

Modifier and Type	Field and Description
protected SparkBigQueryConfig	BigQueryInsertableRelationBase.config

Methods in com.google.cloud.spark.bigquery.write with parameters of type SparkBigQueryConfig

Modifier and Type	Method and Description
BigQueryInsertableRelationBase	CreatableRelationProviderHelper.createBigQueryInsertableRelation(org.apache.spark.sql.SQLContext sqlContext, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> data, org.apache.spark.sql.SaveMode saveMode, SparkBigQueryConfig config)
static void	BigQueryWriteHelper.updateTableMetadataIfNeeded(org.apache.spark.sql.types.StructType sparkSchema, SparkBigQueryConfig config, BigQueryClient bigQueryClient)

Constructors in com.google.cloud.spark.bigquery.write with parameters of type SparkBigQueryConfig

Constructor and Description
BigQueryDataSourceWriterInsertableRelation(BigQueryClient bigQueryClient, org.apache.spark.sql.SQLContext sqlContext, SparkBigQueryConfig config, com.google.inject.Injector injector)
BigQueryDeprecatedIndirectInsertableRelation(BigQueryClient bigQueryClient, org.apache.spark.sql.SQLContext sqlContext, SparkBigQueryConfig config)
BigQueryInsertableRelationBase(BigQueryClient bigQueryClient, org.apache.spark.sql.SQLContext sqlContext, SparkBigQueryConfig config)
BigQueryWriteHelper(BigQueryClient bigQueryClient, org.apache.spark.sql.SQLContext sqlContext, org.apache.spark.sql.SaveMode saveMode, SparkBigQueryConfig config, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> data, Optional<com.google.cloud.bigquery.TableInfo> tableInfo)

Uses of SparkBigQueryConfig in com.google.cloud.spark.bigquery.write.context

Constructors in com.google.cloud.spark.bigquery.write.context with parameters of type SparkBigQueryConfig

Constructor and Description
BigQueryDataSourceWriterModule(SparkBigQueryConfig tableConfig, String writeUUID, org.apache.spark.sql.types.StructType sparkSchema, org.apache.spark.sql.SaveMode mode)
BigQueryIndirectDataSourceWriterContext(BigQueryClient bigQueryClient, SparkBigQueryConfig config, org.apache.hadoop.conf.Configuration hadoopConfiguration, org.apache.spark.sql.types.StructType sparkSchema, String writeUUID, org.apache.spark.sql.SaveMode saveMode, org.apache.hadoop.fs.Path gcsPath, Optional<IntermediateDataCleaner> intermediateDataCleaner, org.apache.spark.SparkContext sparkContext)