Cache what you scrape: implementing a caching strategy for scraping projects

Scraping websites can be a lot of fun and quite easy to do once you’ve gotten the hang of extracting data from html trees. But as you scrape more data and more complicated websites for production use, you may find yourself exhausting your machine’s m...