Package ai.platon.pulsar.persist
Persist level of the Pulsar System
See: Description
-
Class Summary Class Description WebPage Every WebPage is a seperate execution context Notice: Use a build-in java string or a Utf8 to serialize strings? ProtocolHeaders Created by vincent on 17-7-26. ProtocolStatus ProtocolStatus class. HyperlinkPersistable An hype link in a page. Metadata Created by vincent on 17-7-26. ParseStatus ParseStatus class. PageCounters Created by vincent on 17-4-9. Variables Created by vincent on 17-7-26. CrawlMarks Created by vincent on 17-7-26. FetchTimeInfo AutoDetectStorageProvider Created by vincent on 19-1-19. CrawlStatus PageDatum The page datum to update a WebPage WebDb -
Enum Summary Enum Description RetryScope RetryScope class. Self Counters accumulated by the page itself Ref Counters accumulated by the incoming pages -
Object Summary Object Description Companion Companion HadoopUtils Companion Companion