-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.collect.UrlPool
public class ConcurrentUrlPool extends AbstractUrlPool
The global cache
-
-
Field Summary
Fields Modifier and Type Field Description private final UrlCacherealTimeCacheprivate final Queue<DelayUrl>delayCacheprivate final ConcurrentSkipListMap<Integer, UrlCache>orderedCachesprivate final List<UrlCache>unorderedCachesprivate final IntegertotalCountprivate final UrlCachelowestCacheprivate final UrlCachelower5Cacheprivate final UrlCachelower4Cacheprivate final UrlCachelower3Cacheprivate final UrlCachelower2Cacheprivate final UrlCachelowerCacheprivate final UrlCachenormalCacheprivate final UrlCachehigherCacheprivate final UrlCachehigher2Cacheprivate final UrlCachehigher3Cacheprivate final UrlCachehigher4Cacheprivate final UrlCachehigher5Cacheprivate final UrlCachehighestCacheprivate final ImmutableConfigconfprivate final IntegertotalItems
-
Constructor Summary
Constructors Constructor Description ConcurrentUrlPool(ImmutableConfig conf)
-
Method Summary
Modifier and Type Method Description UrlCachegetRealTimeCache()The real time url cache, real time urls have the highest priority Queue<DelayUrl>getDelayCache()The delayed url cache ConcurrentSkipListMap<Integer, UrlCache>getOrderedCaches()The ordered url caches List<UrlCache>getUnorderedCaches()The unordered fetch caches, tasks in unordered caches have the lowest priority IntegergetTotalCount()UrlCachegetLowestCache()UrlCachegetLower5Cache()UrlCachegetLower4Cache()UrlCachegetLower3Cache()UrlCachegetLower2Cache()UrlCachegetLowerCache()UrlCachegetNormalCache()UrlCachegetHigherCache()UrlCachegetHigher2Cache()UrlCachegetHigher3Cache()UrlCachegetHigher4Cache()UrlCachegetHigher5Cache()UrlCachegetHighestCache()final ImmutableConfiggetConf()IntegergetTotalItems()Unitinitialize()-
-
Constructor Detail
-
ConcurrentUrlPool
ConcurrentUrlPool(ImmutableConfig conf)
-
-
Method Detail
-
getRealTimeCache
UrlCache getRealTimeCache()
The real time url cache, real time urls have the highest priority
-
getDelayCache
Queue<DelayUrl> getDelayCache()
The delayed url cache
-
getOrderedCaches
ConcurrentSkipListMap<Integer, UrlCache> getOrderedCaches()
The ordered url caches
-
getUnorderedCaches
List<UrlCache> getUnorderedCaches()
The unordered fetch caches, tasks in unordered caches have the lowest priority
-
getTotalCount
Integer getTotalCount()
-
getLowestCache
UrlCache getLowestCache()
-
getLower5Cache
UrlCache getLower5Cache()
-
getLower4Cache
UrlCache getLower4Cache()
-
getLower3Cache
UrlCache getLower3Cache()
-
getLower2Cache
UrlCache getLower2Cache()
-
getLowerCache
UrlCache getLowerCache()
-
getNormalCache
UrlCache getNormalCache()
-
getHigherCache
UrlCache getHigherCache()
-
getHigher2Cache
UrlCache getHigher2Cache()
-
getHigher3Cache
UrlCache getHigher3Cache()
-
getHigher4Cache
UrlCache getHigher4Cache()
-
getHigher5Cache
UrlCache getHigher5Cache()
-
getHighestCache
UrlCache getHighestCache()
-
getConf
final ImmutableConfig getConf()
-
getTotalItems
Integer getTotalItems()
-
initialize
Unit initialize()
-
-
-
-