Package com.hashicorp.cdktf.providers.google.dataproc_job

Class DataprocJobPysparkConfig.Builder

    • Constructor Detail

      • Builder

        public Builder()

    • Method Detail

      • mainPythonFileUri

        @Stability(Stable)
public DataprocJobPysparkConfig.Builder mainPythonFileUri​(String mainPythonFileUri)
        Sets the value of DataprocJobPysparkConfig.getMainPythonFileUri()
        Parameters:
        mainPythonFileUri - Required. The HCFS URI of the main Python file to use as the driver. Must be a .py file. This parameter is required. Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#main_python_file_uri DataprocJob#main_python_file_uri}
        Returns:
        this

      • archiveUris

        @Stability(Stable)
public DataprocJobPysparkConfig.Builder archiveUris​(List<String> archiveUris)
        Sets the value of DataprocJobPysparkConfig.getArchiveUris()
        Parameters:
        archiveUris - Optional. HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip. Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#archive_uris DataprocJob#archive_uris}
        Returns:
        this

      • args

        @Stability(Stable)
public DataprocJobPysparkConfig.Builder args​(List<String> args)
        Sets the value of DataprocJobPysparkConfig.getArgs()
        Parameters:
        args - Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#args DataprocJob#args}
        Returns:
        this

      • fileUris

        @Stability(Stable)
public DataprocJobPysparkConfig.Builder fileUris​(List<String> fileUris)
        Sets the value of DataprocJobPysparkConfig.getFileUris()
        Parameters:
        fileUris - Optional. HCFS URIs of files to be copied to the working directory of Python drivers and distributed tasks. Useful for naively parallel tasks Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#file_uris DataprocJob#file_uris}
        Returns:
        this

      • jarFileUris

        @Stability(Stable)
public DataprocJobPysparkConfig.Builder jarFileUris​(List<String> jarFileUris)
        Sets the value of DataprocJobPysparkConfig.getJarFileUris()
        Parameters:
        jarFileUris - Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Python driver and tasks. Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#jar_file_uris DataprocJob#jar_file_uris}
        Returns:
        this

      • properties

        @Stability(Stable)
public DataprocJobPysparkConfig.Builder properties​(Map<String,​String> properties)
        Sets the value of DataprocJobPysparkConfig.getProperties()
        Parameters:
        properties - Optional. A mapping of property names to values, used to configure PySpark. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#properties DataprocJob#properties}
        Returns:
        this

      • pythonFileUris

        @Stability(Stable)
public DataprocJobPysparkConfig.Builder pythonFileUris​(List<String> pythonFileUris)
        Sets the value of DataprocJobPysparkConfig.getPythonFileUris()
        Parameters:
        pythonFileUris - Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: .py, .egg, and .zip Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#python_file_uris DataprocJob#python_file_uris}
        Returns:
        this