Package com.digitalpebble.stormcrawler.opensearch.persistence
package com.digitalpebble.stormcrawler.opensearch.persistence
-
ClassesClassDescriptionSpout which pulls URL from an ES index.Uses collapsing spouts to get an initial set of URLs and keys to query for and gets emptyQueue notifications from the URLBuffer to query OpenSearch for a specific key.Simple bolt which stores the status of URLs into ElasticSearch.