Package ai.platon.pulsar.common.collect
Class OneLoadExternalUrlLoader
-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.collect.ExternalUrlLoader
public abstract class OneLoadExternalUrlLoader extends AbstractExternalUrlLoader
-
-
Constructor Summary
Constructors Constructor Description OneLoadExternalUrlLoader()
-
Method Summary
Modifier and Type Method Description IntegercountRemaining()Count remaining size, this operation might be slow for a large url database, use estimateRemaining for fast counting. IntegercountRemaining(UrlTopic topic)Count remaining size with topic, this operation might be slow for a large url database, use estimateRemaining for fast counting. IntegerestimateRemaining()Estimate the size of remaining items, this operation should be very fast IntegerestimateRemaining(UrlTopic topic)Estimate the size of remaining items, this operation should be very fast <T extends Any> UnitloadTo(Collection<T> sink, Integer size, UrlTopic topic, Function1<UrlAware, T> transformer)Load items from the source to the sink safely Unitreset()Force the loading time to expire -
Methods inherited from class ai.platon.pulsar.common.collect.AbstractExternalUrlLoader
hasMore, hasMore, loadTo, loadToNow, saveAll -
Methods inherited from class ai.platon.pulsar.common.collect.ExternalUrlLoader
deleteAll, loadToNow, save -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Method Detail
-
countRemaining
Integer countRemaining()
Count remaining size, this operation might be slow for a large url database, use estimateRemaining for fast counting.
-
countRemaining
Integer countRemaining(UrlTopic topic)
Count remaining size with topic, this operation might be slow for a large url database, use estimateRemaining for fast counting.
-
estimateRemaining
Integer estimateRemaining()
Estimate the size of remaining items, this operation should be very fast
-
estimateRemaining
Integer estimateRemaining(UrlTopic topic)
Estimate the size of remaining items, this operation should be very fast
-
loadTo
<T extends Any> Unit loadTo(Collection<T> sink, Integer size, UrlTopic topic, Function1<UrlAware, T> transformer)
Load items from the source to the sink safely
-
-
-
-