Package software.amazon.awssdk.services.glue.model

Interface HudiTarget.Builder

    • Method Detail

      • paths

        HudiTarget.Builder paths​(Collection<String> paths)

        An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides. The Hudi folder may be located in a child folder of the root folder.

        The crawler will scan all folders underneath a path for a Hudi folder.

        Parameters:
        paths - An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides. The Hudi folder may be located in a child folder of the root folder.

        The crawler will scan all folders underneath a path for a Hudi folder.

        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • paths

        HudiTarget.Builder paths​(String... paths)

        An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides. The Hudi folder may be located in a child folder of the root folder.

        The crawler will scan all folders underneath a path for a Hudi folder.

        Parameters:
        paths - An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides. The Hudi folder may be located in a child folder of the root folder.

        The crawler will scan all folders underneath a path for a Hudi folder.

        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • connectionName

        HudiTarget.Builder connectionName​(String connectionName)

        The name of the connection to use to connect to the Hudi target. If your Hudi files are stored in buckets that require VPC authorization, you can set their connection properties here.

        Parameters:
        connectionName - The name of the connection to use to connect to the Hudi target. If your Hudi files are stored in buckets that require VPC authorization, you can set their connection properties here.
        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • exclusions

        HudiTarget.Builder exclusions​(String... exclusions)

        A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

        Parameters:
        exclusions - A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.
        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • maximumTraversalDepth

        HudiTarget.Builder maximumTraversalDepth​(Integer maximumTraversalDepth)

        The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Hudi metadata folder in your Amazon S3 path. Used to limit the crawler run time.

        Parameters:
        maximumTraversalDepth - The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Hudi metadata folder in your Amazon S3 path. Used to limit the crawler run time.
        Returns:
        Returns a reference to this object so that method calls can be chained together.