Package ai.platon.pulsar.common.urls
Class CrawlableFatLink
-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.urls.ComparableUrlAware,ai.platon.pulsar.common.urls.StatefulUrl,ai.platon.pulsar.common.urls.UrlAware,kotlin.Comparable
public class CrawlableFatLink extends StatefulFatLink
A crawlable fat link is a hyperlink which leads to multiple endpoints; the link is a multivalued function. It is used in web crawling to represent a page with multiple links.
-
-
Field Summary
-
Method Summary
Modifier and Type Method Description final IntegergetFinishedTailLinkCount()final UnitsetFinishedTailLinkCount(Integer finishedTailLinkCount)final BooleangetAborted()final UnitsetAborted(Boolean aborted)final IntegergetNumActive()final BooleanisAborted()final BooleanisFinished()final DurationgetIdleTime()final Unitabort()Abort the crawlable fat link final Booleanfinish(StatefulHyperlink url, Integer status)Finish a stateful hyperlink StringtoString()-
Methods inherited from class ai.platon.pulsar.common.urls.StatefulFatLink
getAuthToken, getCreatedAt, getModifiedAt, getRemoteAddr, getStatus, setAuthToken, setModifiedAt, setRemoteAddr, setStatus -
Methods inherited from class ai.platon.pulsar.common.urls.FatLink
getSize, getTailLinks, isEmpty, isNotEmpty, setTailLinks -
Methods inherited from class ai.platon.pulsar.common.urls.AbstractUrl
compareTo, equals, getArgs, getConfiguredUrl, getCountry, getDeadline, getDepth, getDistrict, getHref, getLabel, getLang, getNMaxRetry, getOrder, getPriority, getReferrer, getText, getToURL, getToURLOrNull, getUrl, hashCode, isNil, isPersistable, isStandard, serialize, setArgs, setCountry, setDepth, setDistrict, setHref, setLang, setNMaxRetry, setOrder, setPriority, setReferrer, setText, setUrl -
Methods inherited from class ai.platon.pulsar.common.urls.Hyperlink
data, isDefault, serializeTo, toDatum -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Method Detail
-
getFinishedTailLinkCount
final Integer getFinishedTailLinkCount()
-
setFinishedTailLinkCount
final Unit setFinishedTailLinkCount(Integer finishedTailLinkCount)
-
getAborted
final Boolean getAborted()
-
setAborted
final Unit setAborted(Boolean aborted)
-
getNumActive
final Integer getNumActive()
-
isFinished
final Boolean isFinished()
-
getIdleTime
final Duration getIdleTime()
-
finish
final Boolean finish(StatefulHyperlink url, Integer status)
Finish a stateful hyperlink
-
-
-
-