Package software.amazon.awssdk.services.glue.model

Class CodeGenConfigurationNode

    • Method Detail

      • athenaConnectorSource

        public final AthenaConnectorSource athenaConnectorSource()

        Specifies a connector to an Amazon Athena data source.

        Returns:
        Specifies a connector to an Amazon Athena data source.

      • jdbcConnectorSource

        public final JDBCConnectorSource jdbcConnectorSource()

        Specifies a connector to a JDBC data source.

        Returns:
        Specifies a connector to a JDBC data source.

      • sparkConnectorSource

        public final SparkConnectorSource sparkConnectorSource()

        Specifies a connector to an Apache Spark data source.

        Returns:
        Specifies a connector to an Apache Spark data source.

      • catalogSource

        public final CatalogSource catalogSource()

        Specifies a data store in the Glue Data Catalog.

        Returns:
        Specifies a data store in the Glue Data Catalog.

      • redshiftSource

        public final RedshiftSource redshiftSource()

        Specifies an Amazon Redshift data store.

        Returns:
        Specifies an Amazon Redshift data store.

      • s3CatalogSource

        public final S3CatalogSource s3CatalogSource()

        Specifies an Amazon S3 data store in the Glue Data Catalog.

        Returns:
        Specifies an Amazon S3 data store in the Glue Data Catalog.

      • s3CsvSource

        public final S3CsvSource s3CsvSource()

        Specifies a command-separated value (CSV) data store stored in Amazon S3.

        Returns:
        Specifies a command-separated value (CSV) data store stored in Amazon S3.

      • s3JsonSource

        public final S3JsonSource s3JsonSource()

        Specifies a JSON data store stored in Amazon S3.

        Returns:
        Specifies a JSON data store stored in Amazon S3.

      • s3ParquetSource

        public final S3ParquetSource s3ParquetSource()

        Specifies an Apache Parquet data store stored in Amazon S3.

        Returns:
        Specifies an Apache Parquet data store stored in Amazon S3.

      • relationalCatalogSource

        public final RelationalCatalogSource relationalCatalogSource()

        Specifies a relational catalog data store in the Glue Data Catalog.

        Returns:
        Specifies a relational catalog data store in the Glue Data Catalog.

      • dynamoDBCatalogSource

        public final DynamoDBCatalogSource dynamoDBCatalogSource()

        Specifies a DynamoDBC Catalog data store in the Glue Data Catalog.

        Returns:
        Specifies a DynamoDBC Catalog data store in the Glue Data Catalog.

      • jdbcConnectorTarget

        public final JDBCConnectorTarget jdbcConnectorTarget()

        Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

        Returns:
        Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

      • sparkConnectorTarget

        public final SparkConnectorTarget sparkConnectorTarget()

        Specifies a target that uses an Apache Spark connector.

        Returns:
        Specifies a target that uses an Apache Spark connector.

      • catalogTarget

        public final BasicCatalogTarget catalogTarget()

        Specifies a target that uses a Glue Data Catalog table.

        Returns:
        Specifies a target that uses a Glue Data Catalog table.

      • redshiftTarget

        public final RedshiftTarget redshiftTarget()

        Specifies a target that uses Amazon Redshift.

        Returns:
        Specifies a target that uses Amazon Redshift.

      • s3CatalogTarget

        public final S3CatalogTarget s3CatalogTarget()

        Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.

        Returns:
        Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.

      • s3GlueParquetTarget

        public final S3GlueParquetTarget s3GlueParquetTarget()

        Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

        Returns:
        Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

      • s3DirectTarget

        public final S3DirectTarget s3DirectTarget()

        Specifies a data target that writes to Amazon S3.

        Returns:
        Specifies a data target that writes to Amazon S3.

      • applyMapping

        public final ApplyMapping applyMapping()

        Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.

        Returns:
        Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.

      • selectFields

        public final SelectFields selectFields()

        Specifies a transform that chooses the data property keys that you want to keep.

        Returns:
        Specifies a transform that chooses the data property keys that you want to keep.

      • dropFields

        public final DropFields dropFields()

        Specifies a transform that chooses the data property keys that you want to drop.

        Returns:
        Specifies a transform that chooses the data property keys that you want to drop.

      • renameField

        public final RenameField renameField()

        Specifies a transform that renames a single data property key.

        Returns:
        Specifies a transform that renames a single data property key.

      • spigot

        public final Spigot spigot()

        Specifies a transform that writes samples of the data to an Amazon S3 bucket.

        Returns:
        Specifies a transform that writes samples of the data to an Amazon S3 bucket.

      • join

        public final Join join()

        Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.

        Returns:
        Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.

      • splitFields

        public final SplitFields splitFields()

        Specifies a transform that splits data property keys into two DynamicFrames. The output is a collection of DynamicFrames: one with selected data property keys, and one with the remaining data property keys.

        Returns:
        Specifies a transform that splits data property keys into two DynamicFrames. The output is a collection of DynamicFrames: one with selected data property keys, and one with the remaining data property keys.

      • selectFromCollection

        public final SelectFromCollection selectFromCollection()

        Specifies a transform that chooses one DynamicFrame from a collection of DynamicFrames. The output is the selected DynamicFrame

        Returns:
        Specifies a transform that chooses one DynamicFrame from a collection of DynamicFrames. The output is the selected DynamicFrame

      • fillMissingValues

        public final FillMissingValues fillMissingValues()

        Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.

        Returns:
        Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.

      • filter

        public final Filter filter()

        Specifies a transform that splits a dataset into two, based on a filter condition.

        Returns:
        Specifies a transform that splits a dataset into two, based on a filter condition.

      • customCode

        public final CustomCode customCode()

        Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.

        Returns:
        Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.

      • sparkSQL

        public final SparkSQL sparkSQL()

        Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

        Returns:
        Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

      • directKinesisSource

        public final DirectKinesisSource directKinesisSource()

        Specifies a direct Amazon Kinesis data source.

        Returns:
        Specifies a direct Amazon Kinesis data source.

      • directKafkaSource

        public final DirectKafkaSource directKafkaSource()

        Specifies an Apache Kafka data store.

        Returns:
        Specifies an Apache Kafka data store.

      • catalogKinesisSource

        public final CatalogKinesisSource catalogKinesisSource()

        Specifies a Kinesis data source in the Glue Data Catalog.

        Returns:
        Specifies a Kinesis data source in the Glue Data Catalog.

      • catalogKafkaSource

        public final CatalogKafkaSource catalogKafkaSource()

        Specifies an Apache Kafka data store in the Data Catalog.

        Returns:
        Specifies an Apache Kafka data store in the Data Catalog.

      • dropNullFields

        public final DropNullFields dropNullFields()

        Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.

        Returns:
        Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.

      • merge

        public final Merge merge()

        Specifies a transform that merges a DynamicFrame with a staging DynamicFrame based on the specified primary keys to identify records. Duplicate records (records with the same primary keys) are not de-duplicated.

        Returns:
        Specifies a transform that merges a DynamicFrame with a staging DynamicFrame based on the specified primary keys to identify records. Duplicate records (records with the same primary keys) are not de-duplicated.

      • union

        public final Union union()

        Specifies a transform that combines the rows from two or more datasets into a single result.

        Returns:
        Specifies a transform that combines the rows from two or more datasets into a single result.

      • piiDetection

        public final PIIDetection piiDetection()

        Specifies a transform that identifies, removes or masks PII data.

        Returns:
        Specifies a transform that identifies, removes or masks PII data.

      • aggregate

        public final Aggregate aggregate()

        Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.

        Returns:
        Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.

      • dropDuplicates

        public final DropDuplicates dropDuplicates()

        Specifies a transform that removes rows of repeating data from a data set.

        Returns:
        Specifies a transform that removes rows of repeating data from a data set.

      • governedCatalogTarget

        public final GovernedCatalogTarget governedCatalogTarget()

        Specifies a data target that writes to a goverened catalog.

        Returns:
        Specifies a data target that writes to a goverened catalog.

      • governedCatalogSource

        public final GovernedCatalogSource governedCatalogSource()

        Specifies a data source in a goverened Data Catalog.

        Returns:
        Specifies a data source in a goverened Data Catalog.

      • microsoftSQLServerCatalogSource

        public final MicrosoftSQLServerCatalogSource microsoftSQLServerCatalogSource()

        Specifies a Microsoft SQL server data source in the Glue Data Catalog.

        Returns:
        Specifies a Microsoft SQL server data source in the Glue Data Catalog.

      • mySQLCatalogSource

        public final MySQLCatalogSource mySQLCatalogSource()

        Specifies a MySQL data source in the Glue Data Catalog.

        Returns:
        Specifies a MySQL data source in the Glue Data Catalog.

      • oracleSQLCatalogSource

        public final OracleSQLCatalogSource oracleSQLCatalogSource()

        Specifies an Oracle data source in the Glue Data Catalog.

        Returns:
        Specifies an Oracle data source in the Glue Data Catalog.

      • postgreSQLCatalogSource

        public final PostgreSQLCatalogSource postgreSQLCatalogSource()

        Specifies a PostgresSQL data source in the Glue Data Catalog.

        Returns:
        Specifies a PostgresSQL data source in the Glue Data Catalog.

      • microsoftSQLServerCatalogTarget

        public final MicrosoftSQLServerCatalogTarget microsoftSQLServerCatalogTarget()

        Specifies a target that uses Microsoft SQL.

        Returns:
        Specifies a target that uses Microsoft SQL.

      • mySQLCatalogTarget

        public final MySQLCatalogTarget mySQLCatalogTarget()

        Specifies a target that uses MySQL.

        Returns:
        Specifies a target that uses MySQL.

      • oracleSQLCatalogTarget

        public final OracleSQLCatalogTarget oracleSQLCatalogTarget()

        Specifies a target that uses Oracle SQL.

        Returns:
        Specifies a target that uses Oracle SQL.

      • postgreSQLCatalogTarget

        public final PostgreSQLCatalogTarget postgreSQLCatalogTarget()

        Specifies a target that uses Postgres SQL.

        Returns:
        Specifies a target that uses Postgres SQL.

      • dynamicTransform

        public final DynamicTransform dynamicTransform()

        Specifies a custom visual transform created by a user.

        Returns:
        Specifies a custom visual transform created by a user.

      • evaluateDataQuality

        public final EvaluateDataQuality evaluateDataQuality()

        Specifies your data quality evaluation criteria.

        Returns:
        Specifies your data quality evaluation criteria.

      • s3CatalogHudiSource

        public final S3CatalogHudiSource s3CatalogHudiSource()

        Specifies a Hudi data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.

        Returns:
        Specifies a Hudi data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.

      • catalogHudiSource

        public final CatalogHudiSource catalogHudiSource()

        Specifies a Hudi data source that is registered in the Glue Data Catalog.

        Returns:
        Specifies a Hudi data source that is registered in the Glue Data Catalog.

      • s3HudiSource

        public final S3HudiSource s3HudiSource()

        Specifies a Hudi data source stored in Amazon S3.

        Returns:
        Specifies a Hudi data source stored in Amazon S3.

      • s3HudiCatalogTarget

        public final S3HudiCatalogTarget s3HudiCatalogTarget()

        Specifies a target that writes to a Hudi data source in the Glue Data Catalog.

        Returns:
        Specifies a target that writes to a Hudi data source in the Glue Data Catalog.

      • s3HudiDirectTarget

        public final S3HudiDirectTarget s3HudiDirectTarget()

        Specifies a target that writes to a Hudi data source in Amazon S3.

        Returns:
        Specifies a target that writes to a Hudi data source in Amazon S3.

      • directJDBCSource

        public final DirectJDBCSource directJDBCSource()
        Returns the value of the DirectJDBCSource property for this object.
        Returns:
        The value of the DirectJDBCSource property for this object.

      • s3CatalogDeltaSource

        public final S3CatalogDeltaSource s3CatalogDeltaSource()

        Specifies a Delta Lake data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.

        Returns:
        Specifies a Delta Lake data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.

      • catalogDeltaSource

        public final CatalogDeltaSource catalogDeltaSource()

        Specifies a Delta Lake data source that is registered in the Glue Data Catalog.

        Returns:
        Specifies a Delta Lake data source that is registered in the Glue Data Catalog.

      • s3DeltaSource

        public final S3DeltaSource s3DeltaSource()

        Specifies a Delta Lake data source stored in Amazon S3.

        Returns:
        Specifies a Delta Lake data source stored in Amazon S3.

      • s3DeltaCatalogTarget

        public final S3DeltaCatalogTarget s3DeltaCatalogTarget()

        Specifies a target that writes to a Delta Lake data source in the Glue Data Catalog.

        Returns:
        Specifies a target that writes to a Delta Lake data source in the Glue Data Catalog.

      • s3DeltaDirectTarget

        public final S3DeltaDirectTarget s3DeltaDirectTarget()

        Specifies a target that writes to a Delta Lake data source in Amazon S3.

        Returns:
        Specifies a target that writes to a Delta Lake data source in Amazon S3.

      • amazonRedshiftSource

        public final AmazonRedshiftSource amazonRedshiftSource()

        Specifies a target that writes to a data source in Amazon Redshift.

        Returns:
        Specifies a target that writes to a data source in Amazon Redshift.

      • amazonRedshiftTarget

        public final AmazonRedshiftTarget amazonRedshiftTarget()

        Specifies a target that writes to a data target in Amazon Redshift.

        Returns:
        Specifies a target that writes to a data target in Amazon Redshift.

      • evaluateDataQualityMultiFrame

        public final EvaluateDataQualityMultiFrame evaluateDataQualityMultiFrame()

        Specifies your data quality evaluation criteria. Allows multiple input data and returns a collection of Dynamic Frames.

        Returns:
        Specifies your data quality evaluation criteria. Allows multiple input data and returns a collection of Dynamic Frames.

      • recipe

        public final Recipe recipe()

        Specifies a Glue DataBrew recipe node.

        Returns:
        Specifies a Glue DataBrew recipe node.

      • snowflakeSource

        public final SnowflakeSource snowflakeSource()

        Specifies a Snowflake data source.

        Returns:
        Specifies a Snowflake data source.

      • snowflakeTarget

        public final SnowflakeTarget snowflakeTarget()

        Specifies a target that writes to a Snowflake data source.

        Returns:
        Specifies a target that writes to a Snowflake data source.

      • connectorDataSource

        public final ConnectorDataSource connectorDataSource()

        Specifies a source generated with standard connection options.

        Returns:
        Specifies a source generated with standard connection options.

      • connectorDataTarget

        public final ConnectorDataTarget connectorDataTarget()

        Specifies a target generated with standard connection options.

        Returns:
        Specifies a target generated with standard connection options.

      • hashCode

        public final int hashCode()
        Overrides:
        hashCode in class Object

      • equals

        public final boolean equals​(Object obj)
        Overrides:
        equals in class Object

      • toString

        public final String toString()
        Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.
        Overrides:
        toString in class Object

      • getValueForField

        public final <T> Optional<T> getValueForField​(String fieldName,
                                              Class<T> clazz)