Home
Feed

Extend

Hashnode Pro
Hashnode for Agents

Resources

The foreword
Hashnode gql skill

Buildful - AI coding agent that delivers frontier-level results at a fraction of the cost Bug0 - The AI-native e2e QA regression testing Hackathons Changelog Brand @hashnode on X Hashnode on LinkedIn Support - hello+support@hashnode.com Code of Conduct Terms Privacy Sitemap

Sign in

Search Hashnode

Search posts, tags, users, and pages

Discussion

Dmitriy Zub ☀️

Mar 25, 2022

Scrape Google Carousel Results in Python

Prerequisites Install libraries: pip install requests parsel google-search-results Basic knowledge scraping with CSS selectors CSS selectors declare which part of the markup a style applies to thus allowing to extract data from matching tags and att...

dimitryzub.hashnode.dev5 min read

#python #python3 #web-scraping #data-analysis #data

Responses1

Markdown supported · ⌘↵ to post

Jack Lonkli

C, Java, Python

Using an API like https://webscraping.ai/ would probably make this script simpler.

Hey Jack, thanks for the reply :)

I'm not sure, if they are scraping everything using JS rendering, then not, browser automation will always be slower.

I'm not either sure if webscraping.ai "Hello world" can compare to SerpApi "Hello world" since webscraping.ai is a proxy wrapper if I'm not mistaken.

Webscraping.ai "Hello world" in Python (from github docs):

SerpApi.com "Hello world" in Python (from github docs):

Or even smaller "Hello world":

Dmitriy Zub ☀️

Ilya

Scraping search engines and improving performance at serpapi.com

It's kinda weird to compare SerpApi with Webscraping AI.

SerpApi responds with extracted data from search engine results pages.

Webscraping AI responds with HTML.

Comparing apples and oranges?