Class Urls

    • Method Detail

      • seedUrlConfiguration

        public final SeedUrlConfiguration seedUrlConfiguration()

        Configuration of the seed or starting point URLs of the websites you want to crawl.

        You can choose to crawl only the website host names, or the website host names with subdomains, or the website host names with subdomains and other domains that the web pages link to.

        You can list up to 100 seed URLs.

        Returns:
        Configuration of the seed or starting point URLs of the websites you want to crawl.

        You can choose to crawl only the website host names, or the website host names with subdomains, or the website host names with subdomains and other domains that the web pages link to.

        You can list up to 100 seed URLs.

      • siteMapsConfiguration

        public final SiteMapsConfiguration siteMapsConfiguration()

        Configuration of the sitemap URLs of the websites you want to crawl.

        Only URLs belonging to the same website host names are crawled. You can list up to three sitemap URLs.

        Returns:
        Configuration of the sitemap URLs of the websites you want to crawl.

        Only URLs belonging to the same website host names are crawled. You can list up to three sitemap URLs.

      • serializableBuilderClass

        public static Class<? extends Urls.Builder> serializableBuilderClass()
      • hashCode

        public final int hashCode()
        Overrides:
        hashCode in class Object
      • equals

        public final boolean equals​(Object obj)
        Overrides:
        equals in class Object
      • toString

        public final String toString()
        Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.
        Overrides:
        toString in class Object
      • getValueForField

        public final <T> Optional<T> getValueForField​(String fieldName,
                                                      Class<T> clazz)