Wow, great guide! I'd also add a section about APIs like https://webscraping.ai/ which can be used to render JS, rotate proxies and avoid scraping protections.
I didn't add that section on purpose. Since I co-Founded zenrows.com, which does exactly that, it didn't feel right to talk about it. It would look like spam.
I plan on explaining some day how to build those parts on your own.