---
title: "Comment by Peter Merritt on \"Web Scraping with Python 101\" | Hashnode"
description: "How do you deal with sites where JS rendering is required? I&#39;ve been using https://webscraping.ai but maybe there are better ways?"
url: "https://hashnode.com/posts/web-scraping-with-python-101/61e8043a0204273bdcb112c7/comment/627e0ee9cc45a3de295c6045"
---

[Discussion](https://hashnode.com/posts/web-scraping-with-python-101/61e8043a0204273bdcb112c7)

Comment [Web Scraping with Python 101](https://hashnode.com/posts/web-scraping-with-python-101/61e8043a0204273bdcb112c7)

[Peter Merritt](https://hashnode.com/@PeterMerritt)

[May 13, 2022](https://hashnode.com/posts/web-scraping-with-python-101/61e8043a0204273bdcb112c7/comment/627e0ee9cc45a3de295c6045)

How do you deal with sites where JS rendering is required? I've been using [https://webscraping.ai](https://webscraping.ai/) but maybe there are better ways?

[Ander Rodriguez](https://hashnode.com/@AnderRV)

[May 13, 2022](https://hashnode.com/posts/web-scraping-with-python-101/61e8043a0204273bdcb112c7/comment/627e0ee9cc45a3de295c6045#reply-627e32f85cbe9ede04a911b4)

Hi, there two main approaches:

1.  try to find the data you want without JS (internal XHR endpoints, metadata, different URLs...). It's not always possible.
    
2.  use headless browsers (Puppeteer, Selenium, Playwright). You can wait for certain data or selector. The downside is that they are much slower and harder to maintain.
