Thank you Muhammad Awais . It saved my especially the rewrite thing that you did for sitemaps was great :)

Oh Man! I was using 80% of anti-patterns in my puppeteer scripts. Thanks for the information. Your article is full of useful information.

Hi! your blog is very useful. I build a similar LinkedIn scraper from scratch using puppeteer (headless browser). The problem I am facing is I get blocked after scraping some 200 profiles. I have slowed down the timeout to 30 seconds. But still facing the same problem. Can you help me with this? How to scrape LinkedIn without getting blocked?