Interface WebCrawlerLimits.Builder

    • Method Detail

      • rateLimit

        WebCrawlerLimits.Builder rateLimit​(Integer rateLimit)

        The max rate at which pages are crawled, up to 300 per minute per host.

        Parameters:
        rateLimit - The max rate at which pages are crawled, up to 300 per minute per host.
        Returns:
        Returns a reference to this object so that method calls can be chained together.