Yeah. There was a period I took deep interest in web scraping. I learnt it, built a couple of scrapers from tutorials and afterwards built a web crawler and integrated it to a small search engine. Of course, the crawler was so slow because of my approach of only storing the link and extracted keywords to the database, just to avoid consuming much storage. I ended up not hosting it as desired because of this.
amirah
psych grad, content writer, learning to code :)
I've never built a web scraper before, but now I'm interested. This was a nice intro and cool project ๐