Interface DataprocJobHadoopConfig

  • All Superinterfaces:
    software.amazon.jsii.JsiiSerializable
    All Known Implementing Classes:
    DataprocJobHadoopConfig.Jsii$Proxy

    @Generated(value="jsii-pacmak/1.102.0 (build e354887)",
               date="2024-08-31T03:59:20.737Z")
    @Stability(Stable)
    public interface DataprocJobHadoopConfig
    extends software.amazon.jsii.JsiiSerializable
    • Method Detail

      • getArchiveUris

        @Stability(Stable)
        @Nullable
        default List<String> getArchiveUris()
        HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip.

        Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#archive_uris DataprocJob#archive_uris}

      • getArgs

        @Stability(Stable)
        @Nullable
        default List<String> getArgs()
        The arguments to pass to the driver.

        Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#args DataprocJob#args}

      • getFileUris

        @Stability(Stable)
        @Nullable
        default List<String> getFileUris()
        HCFS URIs of files to be copied to the working directory of Spark drivers and distributed tasks.

        Useful for naively parallel tasks. Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#file_uris DataprocJob#file_uris}

      • getJarFileUris

        @Stability(Stable)
        @Nullable
        default List<String> getJarFileUris()
        HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.

        Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#jar_file_uris DataprocJob#jar_file_uris}

      • getLoggingConfig

        @Stability(Stable)
        @Nullable
        default DataprocJobHadoopConfigLoggingConfig getLoggingConfig()
        logging_config block.

        Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#logging_config DataprocJob#logging_config}

      • getMainClass

        @Stability(Stable)
        @Nullable
        default String getMainClass()
        The class containing the main method of the driver.

        Must be in a provided jar or jar that is already on the classpath. Conflicts with main_jar_file_uri Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#main_class DataprocJob#main_class}

      • getMainJarFileUri

        @Stability(Stable)
        @Nullable
        default String getMainJarFileUri()
        The HCFS URI of jar file containing the driver jar. Conflicts with main_class.

        Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#main_jar_file_uri DataprocJob#main_jar_file_uri}

      • getProperties

        @Stability(Stable)
        @Nullable
        default Map<String,​String> getProperties()
        A mapping of property names to values, used to configure Spark.

        Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code. Docs at Terraform Registry: {@link https://registry.terraform.io/providers/hashicorp/google/5.43.1/docs/resources/dataproc_job#properties DataprocJob#properties}