Constructor Detail

• UrlFeeder

  UrlFeeder(UrlPool urlPool, Integer lowerCacheSize, Boolean enableDefaults)

Method Detail

• getLoadingIterable

   final ConcurrentLoadingIterable<UrlAware> getLoadingIterable()

• getCacheSize

   final Integer getCacheSize()

• getOpenCollectors

   final Collection<PriorityDataCollector<UrlAware>> getOpenCollectors()

• getCollectors

   final List<PriorityDataCollector<UrlAware>> getCollectors()

• getAbstract

   final String getAbstract()

• getReport

   final String getReport()

• getUrlPool

   final UrlPool getUrlPool()

• getLowerCacheSize

   final Integer getLowerCacheSize()

• getEnableDefaults

   final Boolean getEnableDefaults()

• addFirst

   final Unit addFirst(UrlAware url)

  Add a hyperlink to the very beginning of the fetch queue, so it will be served immediately

• addLast

   final Unit addLast(UrlAware url)

• iterator

   Iterator<UrlAware> iterator()

• estimatedOrder

   final Integer estimatedOrder(Integer priority)

  Estimate the order to fetch for the next task to add with priority priority

• addDefaultCollectors

   final UrlFeeder addDefaultCollectors()

• addCollector

   final UrlFeeder addCollector(PriorityDataCollector<UrlAware> collector)

• addCollectors

   final UrlFeeder addCollectors(Iterable<PriorityDataCollector<UrlAware>> collectors)

• getCollectors

   final List<PriorityDataCollector<UrlAware>> getCollectors(String name)

• getCollectors

   final List<PriorityDataCollector<UrlAware>> getCollectors(Iterable<String> names)

• getCollectors

   final List<PriorityDataCollector<UrlAware>> getCollectors(Regex regex)

• getCollectorsLike

   final List<PriorityDataCollector<UrlAware>> getCollectorsLike(String name)

• remove

   final Boolean remove(DataCollector<UrlAware> collector)

• removeAll

   final Boolean removeAll(Collection<DataCollector<UrlAware>> collectors)

• clear

   final Unit clear()