Interface S3HudiDirectTarget.Builder

    • Method Detail

      • name

        S3HudiDirectTarget.Builder name​(String name)

        The name of the data target.

        Parameters:
        name - The name of the data target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • inputs

        S3HudiDirectTarget.Builder inputs​(Collection<String> inputs)

        The nodes that are inputs to the data target.

        Parameters:
        inputs - The nodes that are inputs to the data target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • inputs

        S3HudiDirectTarget.Builder inputs​(String... inputs)

        The nodes that are inputs to the data target.

        Parameters:
        inputs - The nodes that are inputs to the data target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • path

        S3HudiDirectTarget.Builder path​(String path)

        The Amazon S3 path of your Hudi data source to write to.

        Parameters:
        path - The Amazon S3 path of your Hudi data source to write to.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • compression

        S3HudiDirectTarget.Builder compression​(String compression)

        Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

        Parameters:
        compression - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        HudiTargetCompressionType, HudiTargetCompressionType
      • compression

        S3HudiDirectTarget.Builder compression​(HudiTargetCompressionType compression)

        Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

        Parameters:
        compression - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        HudiTargetCompressionType, HudiTargetCompressionType
      • numberTargetPartitions

        S3HudiDirectTarget.Builder numberTargetPartitions​(String numberTargetPartitions)

        Specifies the number of target partitions for distributing Hudi dataset files across Amazon S3.

        Parameters:
        numberTargetPartitions - Specifies the number of target partitions for distributing Hudi dataset files across Amazon S3.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • partitionKeys

        S3HudiDirectTarget.Builder partitionKeys​(Collection<? extends Collection<String>> partitionKeys)

        Specifies native partitioning using a sequence of keys.

        Parameters:
        partitionKeys - Specifies native partitioning using a sequence of keys.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • partitionKeys

        S3HudiDirectTarget.Builder partitionKeys​(Collection<String>... partitionKeys)

        Specifies native partitioning using a sequence of keys.

        Parameters:
        partitionKeys - Specifies native partitioning using a sequence of keys.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • format

        S3HudiDirectTarget.Builder format​(String format)

        Specifies the data output format for the target.

        Parameters:
        format - Specifies the data output format for the target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        TargetFormat, TargetFormat
      • format

        S3HudiDirectTarget.Builder format​(TargetFormat format)

        Specifies the data output format for the target.

        Parameters:
        format - Specifies the data output format for the target.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        TargetFormat, TargetFormat
      • additionalOptions

        S3HudiDirectTarget.Builder additionalOptions​(Map<String,​String> additionalOptions)

        Specifies additional connection options for the connector.

        Parameters:
        additionalOptions - Specifies additional connection options for the connector.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • schemaChangePolicy

        S3HudiDirectTarget.Builder schemaChangePolicy​(DirectSchemaChangePolicy schemaChangePolicy)

        A policy that specifies update behavior for the crawler.

        Parameters:
        schemaChangePolicy - A policy that specifies update behavior for the crawler.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • autoDataQuality

        S3HudiDirectTarget.Builder autoDataQuality​(AutoDataQuality autoDataQuality)

        Specifies whether to automatically enable data quality evaluation for the S3 Hudi direct target. When set to true, data quality checks are performed automatically during the write operation.

        Parameters:
        autoDataQuality - Specifies whether to automatically enable data quality evaluation for the S3 Hudi direct target. When set to true, data quality checks are performed automatically during the write operation.
        Returns:
        Returns a reference to this object so that method calls can be chained together.