--- title: "#webscraping articles | Hashnode" description: "Explore 280 articles tagged #webscraping on Hashnode. Tutorials, guides, and how-tos from the community." url: "https://hashnode.com/tag/webscraping" --- Tag # #webscraping 280 posts · 9 followers [AgentStack Notes](https://hashnode.com/@agentstacknotes) · [3h ago](https://hashnode.com/posts/cost-per-1-000-requests-for-ai-agents-a-worksheet-for-scraperapi-scrapingbee-and-firecrawl/6af489098f36505906abd2d2) ### [Cost per 1,000 Requests for AI Agents: A Worksheet for ScraperAPI, ScrapingBee and Firecrawl](https://agentstack-notes.hashnode.dev/cost-per-1-000-requests-for-ai-agents-a-worksheet-for-scraperapi-scrapingbee-and-firecrawl?utm_source=hashnode&utm_medium=feed) Originally published at AgentStack Notes. Last fact-checked: November 10, 2026. Disclosure: This article was drafted with AI assistance and checked against each vendor's official pages. We may receiv 6 min read · [agentstack-notes.hashnode.dev](https://agentstack-notes.hashnode.dev/cost-per-1-000-requests-for-ai-agents-a-worksheet-for-scraperapi-scrapingbee-and-firecrawl?utm_source=hashnode&utm_medium=feed) [locaihost data](https://hashnode.com/@locaihostdata) · [11h ago](https://hashnode.com/posts/2-000-tripadvisor-reviews-in-62-seconds-for-one-cent-what-one-times-square-hotel-s-guests-actually-complain-about/6af41531f9bb51d7da4f2507) ### [2,000 TripAdvisor reviews in 62 seconds for one cent: what one Times Square hotel's guests actually complain about](https://locaihost.hashnode.dev/2-000-tripadvisor-reviews-in-62-seconds-for-one-cent-what-one-times-square-hotel-s-guests-actually-complain-about?utm_source=hashnode&utm_medium=feed) We pulled the latest 2,000 TripAdvisor reviews of the Hotel Edison Times Square in one run. Its all-time score is 3.9, but the last two years... 6 min read · [locaihost.hashnode.dev](https://locaihost.hashnode.dev/2-000-tripadvisor-reviews-in-62-seconds-for-one-cent-what-one-times-square-hotel-s-guests-actually-complain-about?utm_source=hashnode&utm_medium=feed) [Emir Mrkaljevic](https://hashnode.com/@emirmrkaljevic) · [1d ago](https://hashnode.com/posts/how-i-collect-remote-python-jobs-with-visa-filters-and-application-emails-from-six-job-boards/6af342448b301ef6e0588e7f) ### [How I collect remote Python jobs, with visa filters and application emails, from six job boards](https://emirmrkaljevic.hashnode.dev/how-i-collect-remote-python-jobs-with-visa-filters-and-application-emails-from-six-job-boards?utm_source=hashnode&utm_medium=feed) I want a daily list of remote Python jobs I can actually apply to. Not a dump of every "remote" post that is really US-only, and not a pile of internships I have already decided to skip. I also want, 4 min read · [emirmrkaljevic.hashnode.dev](https://emirmrkaljevic.hashnode.dev/how-i-collect-remote-python-jobs-with-visa-filters-and-application-emails-from-six-job-boards?utm_source=hashnode&utm_medium=feed) [Emir Mrkaljevic](https://hashnode.com/@emirmrkaljevic) · [1d ago](https://hashnode.com/posts/how-i-take-element-screenshots-in-dark-mode-for-a-batch-visual-check/6af31615d5bc518a89f155d2) ### [How I take element screenshots in dark mode for a batch visual check](https://emirmrkaljevic.hashnode.dev/how-i-take-element-screenshots-in-dark-mode-for-a-batch-visual-check?utm_source=hashnode&utm_medium=feed) I keep a short list of landing pages I care about and I want to see, in one pass, whether the hero heading still looks right in dark mode. Full-page shots are noisy for that. I only need the heading, 3 min read · [emirmrkaljevic.hashnode.dev](https://emirmrkaljevic.hashnode.dev/how-i-take-element-screenshots-in-dark-mode-for-a-batch-visual-check?utm_source=hashnode&utm_medium=feed) [Paxen Online](https://hashnode.com/@paxen) · [1d ago](https://hashnode.com/posts/building-an-instagram-data-tool-api-integration-public-profile-data-and-what-i-learned/6af23045d82ec16781860fb6) ### [Building an Instagram Data Tool: API Integration, Public Profile Data, and What I Learned](https://shadowly.hashnode.dev/building-an-instagram-data-tool-api-integration-public-profile-data-and-what-i-learned?utm_source=hashnode&utm_medium=feed) Learn how to build Instagram data applications using REST APIs. Explore public profile data, followers, comments, pagination, authentication. 6 min read · [shadowly.hashnode.dev](https://shadowly.hashnode.dev/building-an-instagram-data-tool-api-integration-public-profile-data-and-what-i-learned?utm_source=hashnode&utm_medium=feed) [Emir Mrkaljevic](https://hashnode.com/@emirmrkaljevic) · [2d ago](https://hashnode.com/posts/how-i-pull-remote-jobs-from-6-public-boards-into-one-csv-with-filters-that-cost-nothing-when-they-miss/6af21641295342938e554a5d) ### [How I pull remote jobs from 6 public boards into one CSV (with filters that cost nothing when they miss)](https://emirmrkaljevic.hashnode.dev/how-i-pull-remote-jobs-from-6-public-boards-into-one-csv-with-filters-that-cost-nothing-when-they-miss?utm_source=hashnode&utm_medium=feed) I wanted a morning CSV of new remote roles: title, company, salary, whether visa or relocation is mentioned, and a link. Six public boards already publish that data (Himalayas, Remote OK, We Work Remo 3 min read · [emirmrkaljevic.hashnode.dev](https://emirmrkaljevic.hashnode.dev/how-i-pull-remote-jobs-from-6-public-boards-into-one-csv-with-filters-that-cost-nothing-when-they-miss?utm_source=hashnode&utm_medium=feed) [AnyCrawler](https://hashnode.com/@anycrawler) · [4d ago](https://hashnode.com/posts/building-a-rag-pipeline-without-a-scraper-farm-free-fetch-to-markdown-for-agents/6aee897e8959be50809030ea) ### [Building a RAG Pipeline Without a Scraper Farm: Free Fetch-to-Markdown for Agents](https://anycrawler.hashnode.dev/building-a-rag-pipeline-without-a-scraper-farm-free-fetch-to-markdown-for-agents?utm_source=hashnode&utm_medium=feed) Build a RAG ingest path that fetches a public URL and returns clean Markdown—no scraper farm. Free endpoint included. 7 min read · [anycrawler.hashnode.dev](https://anycrawler.hashnode.dev/building-a-rag-pipeline-without-a-scraper-farm-free-fetch-to-markdown-for-agents?utm_source=hashnode&utm_medium=feed) [2](https://hashnode.com/posts/building-a-rag-pipeline-without-a-scraper-farm-free-fetch-to-markdown-for-agents/6aee897e8959be50809030ea) [Hermes Soulmate](https://hashnode.com/@hermessoulmate) · [5d ago](https://hashnode.com/posts/merging-overlapping-scrape-results-without-double-counting-1-869-rows-in-1-671-out/6aed40897820c1ff62ba9c12) ### [Merging overlapping scrape results without double counting: 1,869 rows in, 1,671 out](https://hermessoulmate.hashnode.dev/merging-overlapping-scrape-results-without-double-counting-1-869-rows-in-1-671-out?utm_source=hashnode&utm_medium=feed) Most of my scraping jobs don't produce one clean dataset. They produce several that overlap: the same search run with four keywords, the same category page scraped every night, two scrapers pointed at 9 min read · [hermessoulmate.hashnode.dev](https://hermessoulmate.hashnode.dev/merging-overlapping-scrape-results-without-double-counting-1-869-rows-in-1-671-out?utm_source=hashnode&utm_medium=feed) [Tidy Data](https://hashnode.com/@tidydata) · [6d ago](https://hashnode.com/posts/how-to-monitor-new-nordic-job-postings-automatically-nav-platsbanken-eures/6aeb8c566e93edf386d18af7) ### [How to monitor new Nordic job postings automatically (NAV, Platsbanken, EURES)](https://tidydata.hashnode.dev/how-to-monitor-new-nordic-job-postings-automatically-nav-platsbanken-eures?utm_source=hashnode&utm_medium=feed) If you are looking for work in Norway, Sweden, Finland or Denmark, or you recruit there, you probably check several job sites every day. Norway's public listings live on NAV Arbeidsplassen, Sweden's o 5 min read · [tidydata.hashnode.dev](https://tidydata.hashnode.dev/how-to-monitor-new-nordic-job-postings-automatically-nav-platsbanken-eures?utm_source=hashnode&utm_medium=feed) [ScrapeMole](https://hashnode.com/@scrapemole) · [Oct 28](https://hashnode.com/posts/hiring-intent-from-public-job-boards-1-307-jobs-from-greenhouse-lever-and-ashby-in-8-seconds-diy-vs-actor-measured/6ae1da0c053c0254b8c02471) ### [Hiring intent from public job boards: 1,307 jobs from Greenhouse, Lever and Ashby in 8 seconds (DIY vs Actor, measured)](https://scrapemole.hashnode.dev/hiring-intent-from-public-job-boards-1-307-jobs-from-greenhouse-lever-and-ashby-in-8-seconds-diy-vs-actor-measured?utm_source=hashnode&utm_medium=feed) Maker disclosure: I build ScrapeMole, including the ATS Jobs Scraper used below. The DIY script is free and works; this post shows exactly where each approach wins. Job postings are one of the few pu 4 min read · [scrapemole.hashnode.dev](https://scrapemole.hashnode.dev/hiring-intent-from-public-job-boards-1-307-jobs-from-greenhouse-lever-and-ashby-in-8-seconds-diy-vs-actor-measured?utm_source=hashnode&utm_medium=feed)