Package ai.platon.pulsar.common.collect
Class LocalFileUrlLoader
-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.collect.ExternalUrlLoader
public class LocalFileUrlLoader extends OneLoadExternalUrlLoader
-
-
Constructor Summary
Constructors Constructor Description LocalFileUrlLoader(Path path)
-
Method Summary
Modifier and Type Method Description final PathgetPath()Unitsave(UrlAware url, UrlTopic topic)Save the url to the external repository Collection<UrlAware>loadToNow(Collection<UrlAware> sink, Integer size, UrlTopic topic)Load items from the source to the sink immediately <T extends Any> Collection<T>loadToNow(Collection<T> sink, Integer size, UrlTopic topic, Function1<UrlAware, T> transformer)Load items from the source to the sink immediately LongdeleteAll(UrlTopic topic)Delete all items with topic from the source -
Methods inherited from class ai.platon.pulsar.common.collect.OneLoadExternalUrlLoader
countRemaining, countRemaining, estimateRemaining, estimateRemaining, loadTo, reset -
Methods inherited from class ai.platon.pulsar.common.collect.AbstractExternalUrlLoader
hasMore, hasMore, loadTo, saveAll -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Constructor Detail
-
LocalFileUrlLoader
LocalFileUrlLoader(Path path)
-
-
Method Detail
-
loadToNow
Collection<UrlAware> loadToNow(Collection<UrlAware> sink, Integer size, UrlTopic topic)
Load items from the source to the sink immediately
-
loadToNow
<T extends Any> Collection<T> loadToNow(Collection<T> sink, Integer size, UrlTopic topic, Function1<UrlAware, T> transformer)
Load items from the source to the sink immediately
-
-
-
-