software.amazon.awscdk.services.glue

Interface PythonSparkJobExecutableProps

All Superinterfaces:

software.amazon.jsii.JsiiSerializable

All Known Implementing Classes:

PythonSparkJobExecutableProps.Jsii$Proxy

@Generated(value="jsii-pacmak/1.67.0 (build 2c027f5)",
           date="2022-09-07T23:47:07.731Z")
 @Stability(value=Experimental)
public interface PythonSparkJobExecutableProps
extends software.amazon.jsii.JsiiSerializable

(experimental) Props for creating a Python Spark (ETL or Streaming) job executable.

Example:

 Job.Builder.create(this, "PythonSparkStreamingJob")
         .executable(JobExecutable.pythonStreaming(PythonSparkJobExecutableProps.builder()
                 .glueVersion(GlueVersion.V2_0)
                 .pythonVersion(PythonVersion.THREE)
                 .script(Code.fromAsset(join(__dirname, "job-script/hello_world.py")))
                 .build()))
         .description("an example Python Streaming job")
         .build();
 

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	PythonSparkJobExecutableProps.Builder A builder for PythonSparkJobExecutableProps
static class	PythonSparkJobExecutableProps.Jsii$Proxy An implementation for PythonSparkJobExecutableProps

Method Summary

Modifier and Type	Method and Description
static PythonSparkJobExecutableProps.Builder	builder()
default List<Code>	getExtraFiles() (experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
default List<Code>	getExtraJars() (experimental) Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script.
default Boolean	getExtraJarsFirst() (experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.
default List<Code>	getExtraPythonFiles() (experimental) Additional Python files that AWS Glue adds to the Python path before executing your script.
GlueVersion	getGlueVersion() (experimental) Glue version.
PythonVersion	getPythonVersion() (experimental) The Python version to use.
Code	getScript() (experimental) The script that executes a job.

Methods inherited from interface software.amazon.jsii.JsiiSerializable

$jsii$toJson

Method Detail

getGlueVersion

@Stability(value=Experimental)
 @NotNull
GlueVersion getGlueVersion()

(experimental) Glue version.

See Also:

https://docs.aws.amazon.com/glue/latest/dg/release-notes.html

getPythonVersion

@Stability(value=Experimental)
 @NotNull
PythonVersion getPythonVersion()

(experimental) The Python version to use.

getScript

@Stability(value=Experimental)
 @NotNull
Code getScript()

(experimental) The script that executes a job.

getExtraFiles

@Stability(value=Experimental)
 @Nullable
default List<Code> getExtraFiles()

(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.

Only individual files are supported, directories are not supported.

Default: [] - no extra files are copied to the working directory

See Also:

`--extra-files` in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getExtraJars

@Stability(value=Experimental)
 @Nullable
default List<Code> getExtraJars()

(experimental) Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Only individual files are supported, directories are not supported.

Default: [] - no extra jars are added to the classpath

See Also:

`--extra-jars` in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getExtraJarsFirst

@Stability(value=Experimental)
 @Nullable
default Boolean getExtraJarsFirst()

(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.

Default: false - priority is not given to user-provided jars

See Also:

`--user-jars-first` in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getExtraPythonFiles

@Stability(value=Experimental)
 @Nullable
default List<Code> getExtraPythonFiles()

(experimental) Additional Python files that AWS Glue adds to the Python path before executing your script.

Only individual files are supported, directories are not supported.

Default: - no extra python files and argument is not set

See Also:

`--extra-py-files` in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

builder

@Stability(value=Experimental)
static PythonSparkJobExecutableProps.Builder builder()

Returns:

a PythonSparkJobExecutableProps.Builder of PythonSparkJobExecutableProps