-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.collect.UrlPool
public class ConcurrentUrlPool extends AbstractUrlPool
The concurrent url pool
-
-
Field Summary
Fields Modifier and Type Field Description private final UrlCacherealTimeCacheprivate final Queue<DelayUrl>delayCacheprivate final ConcurrentSkipListMap<Integer, UrlCache>orderedCachesprivate final List<UrlCache>unorderedCachesprivate final IntegertotalCountprivate final UrlCachelowestCacheprivate final UrlCachelower5Cacheprivate final UrlCachelower4Cacheprivate final UrlCachelower3Cacheprivate final UrlCachelower2Cacheprivate final UrlCachelowerCacheprivate final UrlCachenormalCacheprivate final UrlCachehigherCacheprivate final UrlCachehigher2Cacheprivate final UrlCachehigher3Cacheprivate final UrlCachehigher4Cacheprivate final UrlCachehigher5Cacheprivate final UrlCachehighestCacheprivate final ImmutableConfigconfprivate final IntegertotalItems
-
Constructor Summary
Constructors Constructor Description ConcurrentUrlPool(ImmutableConfig conf)
-
Method Summary
Modifier and Type Method Description UrlCachegetRealTimeCache()The real time url cache in which urls have the highest priority of all. Queue<DelayUrl>getDelayCache()An unbounded queue of Delayed urls, in which an element can only be taken when its delay has expired. ConcurrentSkipListMap<Integer, UrlCache>getOrderedCaches()The ordered url caches. List<UrlCache>getUnorderedCaches()The unordered url caches, tasks in unordered caches have the lowest priority. IntegergetTotalCount()UrlCachegetLowestCache()UrlCachegetLower5Cache()UrlCachegetLower4Cache()UrlCachegetLower3Cache()UrlCachegetLower2Cache()UrlCachegetLowerCache()UrlCachegetNormalCache()UrlCachegetHigherCache()UrlCachegetHigher2Cache()UrlCachegetHigher3Cache()UrlCachegetHigher4Cache()UrlCachegetHigher5Cache()UrlCachegetHighestCache()final ImmutableConfiggetConf()IntegergetTotalItems()Unitinitialize()Initialize the url pool -
-
Constructor Detail
-
ConcurrentUrlPool
ConcurrentUrlPool(ImmutableConfig conf)
-
-
Method Detail
-
getRealTimeCache
UrlCache getRealTimeCache()
The real time url cache in which urls have the highest priority of all.
-
getDelayCache
Queue<DelayUrl> getDelayCache()
An unbounded queue of Delayed urls, in which an element can only be taken when its delay has expired.
Delay cache has higher priority than all ordered caches and is usually used for retrying tasks.
-
getOrderedCaches
ConcurrentSkipListMap<Integer, UrlCache> getOrderedCaches()
The ordered url caches.
Ordered caches has higher priority than unordered caches.
-
getUnorderedCaches
List<UrlCache> getUnorderedCaches()
The unordered url caches, tasks in unordered caches have the lowest priority.
Unordered caches has the lowest priority of all
-
getTotalCount
Integer getTotalCount()
-
getLowestCache
UrlCache getLowestCache()
-
getLower5Cache
UrlCache getLower5Cache()
-
getLower4Cache
UrlCache getLower4Cache()
-
getLower3Cache
UrlCache getLower3Cache()
-
getLower2Cache
UrlCache getLower2Cache()
-
getLowerCache
UrlCache getLowerCache()
-
getNormalCache
UrlCache getNormalCache()
-
getHigherCache
UrlCache getHigherCache()
-
getHigher2Cache
UrlCache getHigher2Cache()
-
getHigher3Cache
UrlCache getHigher3Cache()
-
getHigher4Cache
UrlCache getHigher4Cache()
-
getHigher5Cache
UrlCache getHigher5Cache()
-
getHighestCache
UrlCache getHighestCache()
-
getConf
final ImmutableConfig getConf()
-
getTotalItems
Integer getTotalItems()
-
initialize
Unit initialize()
Initialize the url pool
-
-
-
-