Quora: What are the best web crawling services?
Many services seem to present a layer of API I’m not interested in (keyword search/trends/related tweets/whatever). I’m mainly looking for services that provide the greatest volume of aggregated web content as a feed, upon which I can do whatever analytics I need.
source:
$link[host]
Read Original Source