How To Rotate Proxies in PythonA proxy can hide your IP, but what happens when that gets banned? You would need a new IP. Or you could maintain a list of them and rotate proxies for each request. The final option would be to use Smart Rotating Proxies, more on that later. For now,...Jun 8, 2022 · 10 min readanderrv.hashnode.dev
Speed Up Web Scraping with Concurrency in PythonScraping websites for data is a typical use case for developers. Whether it's a side project or you're building a startup, there are many reasons to scrape the web. For example, if you want to start a price comparison website, you'll need to scrape p...2NMMay 17, 2022 · 14 min readanderrv.hashnode.dev
HTTP Requests in Java with ProxiesAccessing data over HTTP is more common every day. Be it APIs or webpages, intercommunication between applications is growing. And website scraping. There is no easy built-in solution to perform HTTP calls in Java. Many packages offer some related fu...Mar 29, 2022 · 5 min readanderrv.hashnode.dev
Web Scraping with Python 101The Internet is a vast data source if you know where to look - and how to extract it! Going page by page and copying the data manually is not an option anymore. And yet, many people still are doing that. It would be great if our favorite data source ...1PJan 19, 2022 · 16 min readanderrv.hashnode.dev
DOs and DON'Ts of Web ScrapingFor those of you new to web scraping, regular users, or just curious: these tips are golden. Scraping might seem an easy-entry activity, and it is. But it will take you down a rabbit hole. Before you realize it, you got blocked from a website, your c...Dec 21, 2021 · 11 min readanderrv.hashnode.dev
