Interface WebCrawlerConfiguration.Builder
-
- All Superinterfaces:
Buildable,CopyableBuilder<WebCrawlerConfiguration.Builder,WebCrawlerConfiguration>,SdkBuilder<WebCrawlerConfiguration.Builder,WebCrawlerConfiguration>,SdkPojo
- Enclosing class:
- WebCrawlerConfiguration
public static interface WebCrawlerConfiguration.Builder extends SdkPojo, CopyableBuilder<WebCrawlerConfiguration.Builder,WebCrawlerConfiguration>
-
-
Method Summary
All Methods Instance Methods Abstract Methods Default Methods Modifier and Type Method Description default WebCrawlerConfiguration.BuildercrawlerLimits(Consumer<WebCrawlerLimits.Builder> crawlerLimits)The configuration of crawl limits for the web URLs.WebCrawlerConfiguration.BuildercrawlerLimits(WebCrawlerLimits crawlerLimits)The configuration of crawl limits for the web URLs.WebCrawlerConfiguration.BuilderexclusionFilters(String... exclusionFilters)A list of one or more exclusion regular expression patterns to exclude certain URLs.WebCrawlerConfiguration.BuilderexclusionFilters(Collection<String> exclusionFilters)A list of one or more exclusion regular expression patterns to exclude certain URLs.WebCrawlerConfiguration.BuilderinclusionFilters(String... inclusionFilters)A list of one or more inclusion regular expression patterns to include certain URLs.WebCrawlerConfiguration.BuilderinclusionFilters(Collection<String> inclusionFilters)A list of one or more inclusion regular expression patterns to include certain URLs.WebCrawlerConfiguration.Builderscope(String scope)The scope of what is crawled for your URLs.WebCrawlerConfiguration.Builderscope(WebScopeType scope)The scope of what is crawled for your URLs.-
Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copy
-
Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, build
-
Methods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFields
-
-
-
-
Method Detail
-
crawlerLimits
WebCrawlerConfiguration.Builder crawlerLimits(WebCrawlerLimits crawlerLimits)
The configuration of crawl limits for the web URLs.
- Parameters:
crawlerLimits- The configuration of crawl limits for the web URLs.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
crawlerLimits
default WebCrawlerConfiguration.Builder crawlerLimits(Consumer<WebCrawlerLimits.Builder> crawlerLimits)
The configuration of crawl limits for the web URLs.
This is a convenience method that creates an instance of theWebCrawlerLimits.Builderavoiding the need to create one manually viaWebCrawlerLimits.builder().When the
Consumercompletes,SdkBuilder.build()is called immediately and its result is passed tocrawlerLimits(WebCrawlerLimits).- Parameters:
crawlerLimits- a consumer that will call methods onWebCrawlerLimits.Builder- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
crawlerLimits(WebCrawlerLimits)
-
exclusionFilters
WebCrawlerConfiguration.Builder exclusionFilters(Collection<String> exclusionFilters)
A list of one or more exclusion regular expression patterns to exclude certain URLs. If you specify an inclusion and exclusion filter/pattern and both match a URL, the exclusion filter takes precedence and the web content of the URL isn’t crawled.
- Parameters:
exclusionFilters- A list of one or more exclusion regular expression patterns to exclude certain URLs. If you specify an inclusion and exclusion filter/pattern and both match a URL, the exclusion filter takes precedence and the web content of the URL isn’t crawled.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
exclusionFilters
WebCrawlerConfiguration.Builder exclusionFilters(String... exclusionFilters)
A list of one or more exclusion regular expression patterns to exclude certain URLs. If you specify an inclusion and exclusion filter/pattern and both match a URL, the exclusion filter takes precedence and the web content of the URL isn’t crawled.
- Parameters:
exclusionFilters- A list of one or more exclusion regular expression patterns to exclude certain URLs. If you specify an inclusion and exclusion filter/pattern and both match a URL, the exclusion filter takes precedence and the web content of the URL isn’t crawled.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
inclusionFilters
WebCrawlerConfiguration.Builder inclusionFilters(Collection<String> inclusionFilters)
A list of one or more inclusion regular expression patterns to include certain URLs. If you specify an inclusion and exclusion filter/pattern and both match a URL, the exclusion filter takes precedence and the web content of the URL isn’t crawled.
- Parameters:
inclusionFilters- A list of one or more inclusion regular expression patterns to include certain URLs. If you specify an inclusion and exclusion filter/pattern and both match a URL, the exclusion filter takes precedence and the web content of the URL isn’t crawled.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
inclusionFilters
WebCrawlerConfiguration.Builder inclusionFilters(String... inclusionFilters)
A list of one or more inclusion regular expression patterns to include certain URLs. If you specify an inclusion and exclusion filter/pattern and both match a URL, the exclusion filter takes precedence and the web content of the URL isn’t crawled.
- Parameters:
inclusionFilters- A list of one or more inclusion regular expression patterns to include certain URLs. If you specify an inclusion and exclusion filter/pattern and both match a URL, the exclusion filter takes precedence and the web content of the URL isn’t crawled.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
scope
WebCrawlerConfiguration.Builder scope(String scope)
The scope of what is crawled for your URLs.
You can choose to crawl only web pages that belong to the same host or primary domain. For example, only web pages that contain the seed URL "https://docs.aws.amazon.com/bedrock/latest/userguide/" and no other domains. You can choose to include sub domains in addition to the host or primary domain. For example, web pages that contain "aws.amazon.com" can also include sub domain "docs.aws.amazon.com".
- Parameters:
scope- The scope of what is crawled for your URLs.You can choose to crawl only web pages that belong to the same host or primary domain. For example, only web pages that contain the seed URL "https://docs.aws.amazon.com/bedrock/latest/userguide/" and no other domains. You can choose to include sub domains in addition to the host or primary domain. For example, web pages that contain "aws.amazon.com" can also include sub domain "docs.aws.amazon.com".
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
WebScopeType,WebScopeType
-
scope
WebCrawlerConfiguration.Builder scope(WebScopeType scope)
The scope of what is crawled for your URLs.
You can choose to crawl only web pages that belong to the same host or primary domain. For example, only web pages that contain the seed URL "https://docs.aws.amazon.com/bedrock/latest/userguide/" and no other domains. You can choose to include sub domains in addition to the host or primary domain. For example, web pages that contain "aws.amazon.com" can also include sub domain "docs.aws.amazon.com".
- Parameters:
scope- The scope of what is crawled for your URLs.You can choose to crawl only web pages that belong to the same host or primary domain. For example, only web pages that contain the seed URL "https://docs.aws.amazon.com/bedrock/latest/userguide/" and no other domains. You can choose to include sub domains in addition to the host or primary domain. For example, web pages that contain "aws.amazon.com" can also include sub domain "docs.aws.amazon.com".
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
WebScopeType,WebScopeType
-
-