-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.collect.collector.DataCollector,ai.platon.pulsar.common.collect.collector.PriorityDataCollector,kotlin.Comparable
public class PauseDataCollector<E extends Object> extends AbstractPriorityDataCollector<E>
A infinite multi source data collector, the collector always has a chance to collect the next items, and if no item actually collected, wait for a while
-
-
Field Summary
Fields Modifier and Type Field Description private Stringnameprivate final EnilElementprivate final Integernprivate final Durationpauseprivate final Function0<Unit>sleeperprivate final Integercapacityprivate final Integerpriorityprivate final Integeridprivate final Set<String>labelsprivate Stringlangprivate Stringcountryprivate Stringdistrictprivate final Integersizeprivate final IntegerexternalSizeprivate final IntegerestimatedExternalSizeprivate final IntegerestimatedSizeprivate IntegercollectCountprivate IntegercollectedCountprivate final InstantcreateTimeprivate InstantfirstCollectTimeprivate InstantlastCollectedTimeprivate InstantdeadTimeprivate final DurationcollectTimeprivate final BooleanisDead
-
Constructor Summary
Constructors Constructor Description PauseDataCollector(E nilElement, Integer n, Duration pause, Function0<Unit> sleeper, Priority13 priority)
-
Method Summary
Modifier and Type Method Description StringgetName()The collector name UnitsetName(String name)The collector name final EgetNilElement()final IntegergetN()final DurationgetPause()final Function0<Unit>getSleeper()IntegergetCapacity()The capacity IntegergetPriority()IntegergetId()The collector id Set<String>getLabels()The task labels StringgetLang()Required website language UnitsetLang(String lang)Required website language StringgetCountry()Required website country UnitsetCountry(String country)Required website country StringgetDistrict()Required website district UnitsetDistrict(String district)Required website district IntegergetSize()IntegergetExternalSize()IntegergetEstimatedExternalSize()IntegergetEstimatedSize()IntegergetCollectCount()The total count of collect attempt UnitsetCollectCount(Integer collectCount)The total count of collect attempt IntegergetCollectedCount()The total collected count UnitsetCollectedCount(Integer collectedCount)The total collected count InstantgetCreateTime()The create time of this collector InstantgetFirstCollectTime()The first collect time UnitsetFirstCollectTime(Instant firstCollectTime)The first collect time InstantgetLastCollectedTime()The last time to collect an item successfully UnitsetLastCollectedTime(Instant lastCollectedTime)The last time to collect an item successfully InstantgetDeadTime()The dead time of this collector, if the collector is dead, all items should be dropped UnitsetDeadTime(Instant deadTime)The dead time of this collector, if the collector is dead, all items should be dropped DurationgetCollectTime()BooleangetIsDead()BooleanhasMore()IntegercollectTo(List<E> sink)List<String>dump()-
Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector
clear, collectTo, collectTo, collectTo, compareTo -
Methods inherited from class ai.platon.pulsar.common.collect.PauseDataCollector
toString -
Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractDataCollector
deepClear -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Constructor Detail
-
PauseDataCollector
PauseDataCollector(E nilElement, Integer n, Duration pause, Function0<Unit> sleeper, Priority13 priority)
-
-
Method Detail
-
getNilElement
final E getNilElement()
-
getSleeper
final Function0<Unit> getSleeper()
-
getCapacity
Integer getCapacity()
The capacity
-
getPriority
Integer getPriority()
-
getCountry
String getCountry()
Required website country
-
setCountry
Unit setCountry(String country)
Required website country
-
getDistrict
String getDistrict()
Required website district
-
setDistrict
Unit setDistrict(String district)
Required website district
-
getExternalSize
Integer getExternalSize()
-
getEstimatedExternalSize
Integer getEstimatedExternalSize()
-
getEstimatedSize
Integer getEstimatedSize()
-
getCollectCount
Integer getCollectCount()
The total count of collect attempt
-
setCollectCount
Unit setCollectCount(Integer collectCount)
The total count of collect attempt
-
getCollectedCount
Integer getCollectedCount()
The total collected count
-
setCollectedCount
Unit setCollectedCount(Integer collectedCount)
The total collected count
-
getCreateTime
Instant getCreateTime()
The create time of this collector
-
getFirstCollectTime
Instant getFirstCollectTime()
The first collect time
-
setFirstCollectTime
Unit setFirstCollectTime(Instant firstCollectTime)
The first collect time
-
getLastCollectedTime
Instant getLastCollectedTime()
The last time to collect an item successfully
-
setLastCollectedTime
Unit setLastCollectedTime(Instant lastCollectedTime)
The last time to collect an item successfully
-
getDeadTime
Instant getDeadTime()
The dead time of this collector, if the collector is dead, all items should be dropped
-
setDeadTime
Unit setDeadTime(Instant deadTime)
The dead time of this collector, if the collector is dead, all items should be dropped
-
getCollectTime
Duration getCollectTime()
-
-
-
-