Package ai.platon.pulsar.common.collect
See: Description
-
Class Summary Class Description CollectorHelper CombinedDataCollector PauseDataCollector A infinite multi source data collector, the collector always has a chance to collect the next items, and if no item actually collected, wait for a while DelayCacheCollector UrlTopic UrlGroupComparator AbstractExternalUrlLoader DelayExternalUrlLoader OneLoadExternalUrlLoader AbstractFetchCache ConcurrentFetchCache LoadingFetchCache DelayUrl AbstractFetchCacheManager The abstract fetch catch manager ConcurrentFetchCacheManager The global cache LoadingFetchCacheManager LocalFileUrlLoader TemporaryLocalFileUrlLoader LoadingIterator ConcurrentLoadingIterable MultiSourceHyperlinkIterable -
Interface Summary Interface Description CrawlableFatLinkCollector ExternalUrlLoader FetchCache FetchCacheManager The fetch catch manager Loadable