Scrapy to corpus!

When I wrote my previous blog on a very basic scrapy implementation, I had no clue where to apply it, but web crawlers. In fact, my implementation was not like the standard ones either. It scrapes the web and retrieves links from Google based on the...