---
title: "#scraping articles | Hashnode"
description: "Explore 319 articles tagged #scraping on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/scraping"
---

Tag

# #scraping

319 posts · 60 followers

[Anakin Tech](https://hashnode.com/@anakinwriters) · [Oct 16](https://hashnode.com/posts/wire-vs-cloudcruise-pick-the-contract-before-picking-the-tool/6ad1f6cd7b53672011e3a32e)

### [Wire vs CloudCruise: pick the contract before picking the tool](https://anakinwriters.hashnode.dev/wire-vs-cloudcruise-pick-the-contract-before-picking-the-tool?utm_source=hashnode&utm_medium=feed)

A practical Wire vs CloudCruise comparison covering browser runtimes, network-layer calls, failure modes, credentials, cost, and maintenance tradeoffs.

7 min read · [anakinwriters.hashnode.dev](https://anakinwriters.hashnode.dev/wire-vs-cloudcruise-pick-the-contract-before-picking-the-tool?utm_source=hashnode&utm_medium=feed)

[2](https://hashnode.com/posts/wire-vs-cloudcruise-pick-the-contract-before-picking-the-tool/6ad1f6cd7b53672011e3a32e)

[douzatan](https://hashnode.com/@dzt21) · [Oct 14](https://hashnode.com/posts/scraping-vs-ui-automation-for-flight-prices/6acf89515c6c37c05d18873c)

### [Scraping vs UI Automation for Flight Prices: Why Mobile Fare Scrapers Break](https://aiools.hashnode.dev/scraping-vs-ui-automation-for-flight-prices?utm_source=hashnode&utm_medium=feed)

Evaluating scraping vs ui automation for flight prices comes down to a choice between reverse-engineering anti-bot telemetry on every route query and operating the rendered interface inside a real mob

12 min read · [aiools.hashnode.dev](https://aiools.hashnode.dev/scraping-vs-ui-automation-for-flight-prices?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/scraping-vs-ui-automation-for-flight-prices/6acf89515c6c37c05d18873c)

[Varun Kumawat](https://hashnode.com/@thisisvarun) · [Oct 5](https://hashnode.com/posts/how-i-automated-scraping-jobs-from-10-ats-platforms-on-two-500mb-databases/6ac37dbd278ec94067b69950)

### [How I Automated Scraping Jobs From 10+ ATS Platforms on Two 500MB Databases](https://devhubcommunity.hashnode.dev/how-i-automated-scraping-jobs-from-10-ats-platforms-on-two-500mb-databases?utm_source=hashnode&utm_medium=feed)

I wanted a job board that fills itself. I didn't want to enter postings by hand or pay for a job-data API. Most companies already publish their openings on an applicant tracking system (ATS) like Gree

20 min read · [devhubcommunity.hashnode.dev](https://devhubcommunity.hashnode.dev/how-i-automated-scraping-jobs-from-10-ats-platforms-on-two-500mb-databases?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/how-i-automated-scraping-jobs-from-10-ats-platforms-on-two-500mb-databases/6ac37dbd278ec94067b69950)

[ZyVOP](https://hashnode.com/@zyvop) · [Sep 25](https://hashnode.com/posts/build-a-web-scraping-api-with-fastapi-celery-redis-2026/6ab6a4aa51a337e585fc2bb1)

### [Build a Web Scraping API with FastAPI, Celery & Redis (2026)](https://blog.zyvop.com/build-a-web-scraping-api-with-fastapi-celery-redis-2026?utm_source=hashnode&utm_medium=feed)

Build a production-grade web scraping API with FastAPI, Celery, and Redis in Python. Schedule scrape jobs, return async results, add rate limiting, and deploy with Docker in 2026.

15 min read · [blog.zyvop.com](https://blog.zyvop.com/build-a-web-scraping-api-with-fastapi-celery-redis-2026?utm_source=hashnode&utm_medium=feed)

[2](https://hashnode.com/posts/build-a-web-scraping-api-with-fastapi-celery-redis-2026/6ab6a4aa51a337e585fc2bb1)

[ZyVOP](https://hashnode.com/@zyvop) · [Sep 25](https://hashnode.com/posts/scraping-social-media-data-with-python-x-twitter-reddit-instagram-2026/6ab6a573da9982e033d60782)

### [Scraping Social Media Data with Python: X (Twitter), Reddit & Instagram (2026)](https://blog.zyvop.com/scraping-social-media-data-with-python-x-twitter-reddit-instagram-2026?utm_source=hashnode&utm_medium=feed)

Learn how to scrape X (Twitter), Reddit, and Instagram with Python in 2026. Working code for tweets, subreddit posts, profiles, and sentiment analysis — with anti-bot handling.

16 min read · [blog.zyvop.com](https://blog.zyvop.com/scraping-social-media-data-with-python-x-twitter-reddit-instagram-2026?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/scraping-social-media-data-with-python-x-twitter-reddit-instagram-2026/6ab6a573da9982e033d60782)

[ZyVOP](https://hashnode.com/@zyvop) · [Sep 12](https://hashnode.com/posts/python-scraping-patterns-15-real-problems-15-working-solutions/6aa55e15557cc4caff994df7)

### [Python Scraping Patterns: 15 Real Problems, 15 Working Solutions](https://blog.zyvop.com/python-scraping-patterns-15-real-problems-15-working-solutions?utm_source=hashnode&utm_medium=feed)

15 real Python scraping problems and their working solutions — lazy loading, infinite scroll, login walls, JavaScript data, CAPTCHAs, rate limits, and more. Copy-paste ready code.

20 min read · [blog.zyvop.com](https://blog.zyvop.com/python-scraping-patterns-15-real-problems-15-working-solutions?utm_source=hashnode&utm_medium=feed)

[Shaheer Sarfaraz](https://hashnode.com/@DaKheera47) · [Jul 20](https://hashnode.com/posts/i-was-looking-for-the-network-tab/6a5d73e8d3a78fb5ab0cae95)

### [I Was Looking for the Network Tab](https://dakheera47.hashnode.dev/i-was-looking-for-the-network-tab?utm_source=hashnode&utm_medium=feed)

I started with an APK and ended up using JADX, LLMs and Frida to trace, decrypt and convert an Android app’s data into a usable offline format

13 min read · [dakheera47.hashnode.dev](https://dakheera47.hashnode.dev/i-was-looking-for-the-network-tab?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/i-was-looking-for-the-network-tab/6a5d73e8d3a78fb5ab0cae95)

[HANZALA SALEEM](https://hashnode.com/@hanzala-saleem) · [Jul 12](https://hashnode.com/posts/api-monitoring-vs-scraping-why-the-loop-wins/6a533dbf2563b2b380415e82)

### [API Monitoring vs Scraping: Why the Loop Wins](https://verid.hashnode.dev/api-monitoring-vs-scraping-why-the-loop-wins?utm_source=hashnode&utm_medium=feed)

API monitoring beats scraping because it closes the loop: fetch, extract, diff, predicate, and deliver. See how Verid runs the whole thing.

16 min read · [verid.hashnode.dev](https://verid.hashnode.dev/api-monitoring-vs-scraping-why-the-loop-wins?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/api-monitoring-vs-scraping-why-the-loop-wins/6a533dbf2563b2b380415e82)

[Nityanand Thakur](https://hashnode.com/@lsnnt) · [Jun 4](https://hashnode.com/posts/building-a-massive-q-a-dataset-from-sarthaks-com/6a21811f4812d84ddc9e5c94)

### [Building a Massive Q&A Dataset from Sarthaks.com](https://blog.lsnnt.dev/building-a-massive-q-a-dataset-from-sarthaks-com?utm_source=hashnode&utm_medium=feed)

A web scraping guide for begginers

3 min read · [blog.lsnnt.dev](https://blog.lsnnt.dev/building-a-massive-q-a-dataset-from-sarthaks-com?utm_source=hashnode&utm_medium=feed)

[2](https://hashnode.com/posts/building-a-massive-q-a-dataset-from-sarthaks-com/6a21811f4812d84ddc9e5c94)

[AlterLab](https://hashnode.com/@alterlab) · [May 10](https://hashnode.com/posts/rag-pipelines-why-markdown-extraction-beats-html-for-token-efficiency/6a00bb12455c25b5f737c056)

### [RAG Pipelines: Why Markdown Extraction Beats HTML for Token Efficiency](https://alterlab.hashnode.dev/rag-pipelines-why-markdown-extraction-beats-html-for-token-efficiency?utm_source=hashnode&utm_medium=feed)

Feeding raw HTML into a Retrieval-Augmented Generation (RAG) pipeline is computationally expensive and highly inefficient. Large Language Models (LLMs) operate on tokens, and HTML DOM structures are notoriously token-heavy. When you pipe raw HTML int...

6 min read · [alterlab.hashnode.dev](https://alterlab.hashnode.dev/rag-pipelines-why-markdown-extraction-beats-html-for-token-efficiency?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/rag-pipelines-why-markdown-extraction-beats-html-for-token-efficiency/6a00bb12455c25b5f737c056)
