Tag

#webscraping

280 posts9 followers

Explore Hashnode

Alternatives

Cost per 1,000 Requests for AI Agents: A Worksheet for ScraperAPI, ScrapingBee and Firecrawl

Originally published at AgentStack Notes. Last fact-checked: November 10, 2026. Disclosure: This article was drafted with AI assistance and checked against each vendor's official pages. We may receiv

6 min readagentstack-notes.hashnode.dev

locaihost data11h ago

2,000 TripAdvisor reviews in 62 seconds for one cent: what one Times Square hotel's guests actually complain about

We pulled the latest 2,000 TripAdvisor reviews of the Hotel Edison Times Square in one run. Its all-time score is 3.9, but the last two years...

6 min readlocaihost.hashnode.dev

Emir Mrkaljevic1d ago

How I collect remote Python jobs, with visa filters and application emails, from six job boards

I want a daily list of remote Python jobs I can actually apply to. Not a dump of every "remote" post that is really US-only, and not a pile of internships I have already decided to skip. I also want,

4 min reademirmrkaljevic.hashnode.dev

Emir Mrkaljevic1d ago

How I take element screenshots in dark mode for a batch visual check

I keep a short list of landing pages I care about and I want to see, in one pass, whether the hero heading still looks right in dark mode. Full-page shots are noisy for that. I only need the heading,

3 min reademirmrkaljevic.hashnode.dev

Paxen Online1d ago

Building an Instagram Data Tool: API Integration, Public Profile Data, and What I Learned

Learn how to build Instagram data applications using REST APIs. Explore public profile data, followers, comments, pagination, authentication.

6 min readshadowly.hashnode.dev

Emir Mrkaljevic2d ago

How I pull remote jobs from 6 public boards into one CSV (with filters that cost nothing when they miss)

I wanted a morning CSV of new remote roles: title, company, salary, whether visa or relocation is mentioned, and a link. Six public boards already publish that data (Himalayas, Remote OK, We Work Remo

3 min reademirmrkaljevic.hashnode.dev

AnyCrawler4d ago

Building a RAG Pipeline Without a Scraper Farm: Free Fetch-to-Markdown for Agents

Build a RAG ingest path that fetches a public URL and returns clean Markdown—no scraper farm. Free endpoint included.

7 min readanycrawler.hashnode.dev

2

Hermes Soulmate5d ago

Merging overlapping scrape results without double counting: 1,869 rows in, 1,671 out

Most of my scraping jobs don't produce one clean dataset. They produce several that overlap: the same search run with four keywords, the same category page scraped every night, two scrapers pointed at

9 min readhermessoulmate.hashnode.dev

Tidy Data6d ago

How to monitor new Nordic job postings automatically (NAV, Platsbanken, EURES)

If you are looking for work in Norway, Sweden, Finland or Denmark, or you recruit there, you probably check several job sites every day. Norway's public listings live on NAV Arbeidsplassen, Sweden's o

5 min readtidydata.hashnode.dev

ScrapeMoleOct 28

Hiring intent from public job boards: 1,307 jobs from Greenhouse, Lever and Ashby in 8 seconds (DIY vs Actor, measured)

Maker disclosure: I build ScrapeMole, including the ATS Jobs Scraper used below. The DIY script is free and works; this post shows exactly where each approach wins. Job postings are one of the few pu

4 min readscrapemole.hashnode.dev

Search Hashnode