UrlCacheCollector

All Implemented Interfaces:

ai.platon.pulsar.common.collect.collector.DataCollector , ai.platon.pulsar.common.collect.collector.PriorityDataCollector , kotlin.Comparable
```
public class UrlCacheCollector
extends AbstractPriorityDataCollector<UrlAware>
                    
```

Nested Class Summary

Nested Classes
Modifier and Type	Class	Description

Field Summary

Fields
Modifier and Type	Field	Description
`private String`	`name`
`private final Integer`	`size`
`private final Integer`	`externalSize`
`private final Integer`	`estimatedExternalSize`
`private final Integer`	`estimatedSize`
`private final UrlCache`	`urlCache`
`private final Integer`	`capacity`
`private final Integer`	`priority`
`private final Integer`	`id`
`private final Set<String>`	`labels`
`private String`	`lang`
`private String`	`country`
`private String`	`district`
`private Integer`	`collectCount`
`private Integer`	`collectedCount`
`private final Instant`	`createTime`
`private Instant`	`firstCollectTime`
`private Instant`	`lastCollectedTime`
`private Instant`	`deadTime`
`private final Duration`	`collectTime`
`private final Boolean`	`isDead`

Constructor Summary

Constructors
Constructor	Description
`UrlCacheCollector(UrlCache urlCache)`

Enum Constant Summary

Enum Constants
Enum Constant	Description

Method Summary

Modifier and Type	Method	Description
`String`	`getName()`	The collector name
`Unit`	`setName(String name)`	The collector name
`Integer`	`getSize()`
`Integer`	`getExternalSize()`
`Integer`	`getEstimatedExternalSize()`
`Integer`	`getEstimatedSize()`
`final UrlCache`	`getUrlCache()`
`Boolean`	`hasMore()`	If the fetch cache is a LoadingurlCache, the items can be both in memory or in external source, so even if all queues are empty, hasMore can return true
`Integer`	`collectTo(List<UrlAware> sink)`	Collect an element to the sink
`List<String>`	`dump()`	Dump the collector
`Unit`	`clear()`	Clear the collector
`Unit`	`deepClear()`	Clear the collector both from the local cache and the external source

Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector
getCapacity, getPriority, toString
Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractDataCollector
collectTo, collectTo, collectTo, getCollectCount, getCollectTime, getCollectedCount, getCountry, getCreateTime, getDeadTime, getDistrict, getFirstCollectTime, getId, getLabels, getLang, getLastCollectedTime, setCollectCount, setCollectedCount, setCountry, setDeadTime, setDistrict, setFirstCollectTime, setLang, setLastCollectedTime
Methods inherited from class ai.platon.pulsar.common.collect.collector.DataCollector
isDead
Methods inherited from class ai.platon.pulsar.common.collect.collector.PriorityDataCollector
compareTo
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - UrlCacheCollector
```
UrlCacheCollector(UrlCache urlCache)
```
- Method Detail
  - getName
```
 String getName()
```
    The collector name
  - setName
```
 Unit setName(String name)
```
    The collector name
  - getSize
```
 Integer getSize()
```
  - getExternalSize
```
 Integer getExternalSize()
```
  - getEstimatedExternalSize
```
 Integer getEstimatedExternalSize()
```
  - getEstimatedSize
```
 Integer getEstimatedSize()
```
  - getUrlCache
```
 final UrlCache getUrlCache()
```
  - hasMore
```
@Synchronized() Boolean hasMore()
```
    If the fetch cache is a LoadingurlCache, the items can be both in memory or in external source, so even if all queues are empty, hasMore can return true
  - collectTo
```
@Synchronized() Integer collectTo(List<UrlAware> sink)
```
    Collect an element to the sink
  - dump
```
@Synchronized() List<String> dump()
```
    Dump the collector
  - clear
```
@Synchronized() Unit clear()
```
    Clear the collector
  - deepClear
```
@Synchronized() Unit deepClear()
```
    Clear the collector both from the local cache and the external source