Package ai.platon.pulsar.common.collect
See: Description
-
Class Summary Class Description CollectorHelper CombinedDataCollector PauseDataCollector A infinite multi source data collector, the collector always has a chance to collect the next items, and if no item actually collected, wait for a while DelayCacheCollector UrlTopic UrlGroupComparator AbstractExternalUrlLoader DelayExternalUrlLoader OneLoadExternalUrlLoader LoadingIterator ConcurrentLoadingIterable AbstractUrlCache ConcurrentUrlCache LoadingUrlCache UrlFeeder LocalFileUrlLoader TemporaryLocalFileUrlLoader DelayUrl The delay url. AbstractUrlPool The abstract fetch pool ConcurrentUrlPool The global cache LoadingUrlPool -
Interface Summary Interface Description CrawlableFatLinkCollector ExternalUrlLoader Loadable UrlCache The url cache holds UrlAwares. UrlPool The url pool