Web developer who has been working for several startups for more than 10 years, having worked with a wide variety of sectors and technologies. Engineer turned entrepreneur.
Nothing here yet.
Jun 8, 2022 · 10 min read · A proxy can hide your IP, but what happens when that gets banned? You would need a new IP. Or you could maintain a list of them and rotate proxies for each request. The final option would be to use Smart Rotating Proxies, more on that later. For now,...
Join discussion
May 17, 2022 · 14 min read · Scraping websites for data is a typical use case for developers. Whether it's a side project or you're building a startup, there are many reasons to scrape the web. For example, if you want to start a price comparison website, you'll need to scrape p...
NMNkem and 1 more commented
Mar 29, 2022 · 5 min read · Accessing data over HTTP is more common every day. Be it APIs or webpages, intercommunication between applications is growing. And website scraping. There is no easy built-in solution to perform HTTP calls in Java. Many packages offer some related fu...
Join discussion
Jan 19, 2022 · 16 min read · The Internet is a vast data source if you know where to look - and how to extract it! Going page by page and copying the data manually is not an option anymore. And yet, many people still are doing that. It would be great if our favorite data source ...
PPeter commented
Dec 21, 2021 · 11 min read · For those of you new to web scraping, regular users, or just curious: these tips are golden. Scraping might seem an easy-entry activity, and it is. But it will take you down a rabbit hole. Before you realize it, you got blocked from a website, your c...
Join discussion
