Interface S3DeltaDirectTarget.Builder

    • Method Detail

      • name

        S3DeltaDirectTarget.Builder name​(String name)

        The name of the data target.

        Parameters:
        name - The name of the data target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • inputs

        S3DeltaDirectTarget.Builder inputs​(Collection<String> inputs)

        The nodes that are inputs to the data target.

        Parameters:
        inputs - The nodes that are inputs to the data target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • inputs

        S3DeltaDirectTarget.Builder inputs​(String... inputs)

        The nodes that are inputs to the data target.

        Parameters:
        inputs - The nodes that are inputs to the data target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • partitionKeys

        S3DeltaDirectTarget.Builder partitionKeys​(Collection<? extends Collection<String>> partitionKeys)

        Specifies native partitioning using a sequence of keys.

        Parameters:
        partitionKeys - Specifies native partitioning using a sequence of keys.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • partitionKeys

        S3DeltaDirectTarget.Builder partitionKeys​(Collection<String>... partitionKeys)

        Specifies native partitioning using a sequence of keys.

        Parameters:
        partitionKeys - Specifies native partitioning using a sequence of keys.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • path

        S3DeltaDirectTarget.Builder path​(String path)

        The Amazon S3 path of your Delta Lake data source to write to.

        Parameters:
        path - The Amazon S3 path of your Delta Lake data source to write to.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • compression

        S3DeltaDirectTarget.Builder compression​(String compression)

        Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

        Parameters:
        compression - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        DeltaTargetCompressionType, DeltaTargetCompressionType
      • compression

        S3DeltaDirectTarget.Builder compression​(DeltaTargetCompressionType compression)

        Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

        Parameters:
        compression - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        DeltaTargetCompressionType, DeltaTargetCompressionType
      • numberTargetPartitions

        S3DeltaDirectTarget.Builder numberTargetPartitions​(String numberTargetPartitions)

        Specifies the number of target partitions for distributing Delta Lake dataset files across Amazon S3.

        Parameters:
        numberTargetPartitions - Specifies the number of target partitions for distributing Delta Lake dataset files across Amazon S3.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • format

        S3DeltaDirectTarget.Builder format​(String format)

        Specifies the data output format for the target.

        Parameters:
        format - Specifies the data output format for the target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        TargetFormat, TargetFormat
      • format

        S3DeltaDirectTarget.Builder format​(TargetFormat format)

        Specifies the data output format for the target.

        Parameters:
        format - Specifies the data output format for the target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        TargetFormat, TargetFormat
      • additionalOptions

        S3DeltaDirectTarget.Builder additionalOptions​(Map<String,​String> additionalOptions)

        Specifies additional connection options for the connector.

        Parameters:
        additionalOptions - Specifies additional connection options for the connector.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • schemaChangePolicy

        S3DeltaDirectTarget.Builder schemaChangePolicy​(DirectSchemaChangePolicy schemaChangePolicy)

        A policy that specifies update behavior for the crawler.

        Parameters:
        schemaChangePolicy - A policy that specifies update behavior for the crawler.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • autoDataQuality

        S3DeltaDirectTarget.Builder autoDataQuality​(AutoDataQuality autoDataQuality)

        Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to true, data quality checks are performed automatically during the write operation.

        Parameters:
        autoDataQuality - Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to true, data quality checks are performed automatically during the write operation.
        Returns:
        Returns a reference to this object so that method calls can be chained together.