Mar 6 · 5 min read · Build a B2B Software Review Scraper for G2 and Capterra in 2026 As a developer, you’ve likely faced the frustration of manually gathering market insights for B2B software—hours spent sifting through platforms like G2, Capterra, Trustpilot, and TrustR...
Join discussionMar 6 · 4 min read · Here is a problem most people outside sustainability departments do not know about: Every year, thousands of companies publish ESG reports. These reports contain critical data — greenhouse gas emissions, energy consumption, diversity metrics, CDP dis...
Join discussionMar 6 · 4 min read · A year ago, I had zero scrapers on Apify. Today, I have 30 published actors, with 9 of them ranking in the top 3 of their niche. Here is what that journey looked like — and why I think building data tools is one of the most underrated side businesses...
Join discussionMar 4 · 7 min read · As developers, we’re constantly juggling multiple things at once — shipping features, keeping production stable, collecting data, automating repetitive work, and making sure the infrastructure holds u
Join discussion
Feb 19 · 4 min read · We’ve built a developer-facing scraping API at Anakin. You send a URL (or a batch of URLs) with a few execution parameters. The system returns normalized output — raw HTML, cleaned Markdown, or struct
Join discussion
Feb 12 · 2 min read · Playwright Scraping: Modern Web Automation The Feature That Broke Production (Feature Flags Could Have Saved Us) We deployed a bug to all users at once. Feature flags would have contained the damage. Table of Contents Modern Development 2026 Core Co...
Join discussionFeb 12 · 2 min read · Cheerio Web Scraping: jQuery for Server-Side The Feature That Broke Production (Feature Flags Could Have Saved Us) We deployed a bug to all users at once. Feature flags would have contained the damage. Table of Contents Modern Development 2026 Core ...
Join discussionJan 30 · 4 min read · Before you reach for heavy tools like Playwright or expensive proxies, you can do a LOT to avoid detection using just pure Scrapy. This guide covers every possible technique to make your standard Scrapy spider look more human. 1. The Golden Rule: Don...
Join discussionJan 29 · 4 min read · Using AI tools like GitHub Copilot, ChatGPT, Gemini Code Assist can significantly speed up your Scrapy workflow. However, the quality of the output depends heavily on the quality of your prompt. Here are detailed prompts for various Scrapy use cases....
Join discussionJan 29 · 3 min read · In this article, we will dive deeper into how to effectively select data, debug complex issues, and manage logs to speed up your Scrapy development. 1. Mastering Selectors Finding the right selector is the core of web scraping. Scrapy supports both C...
Join discussion
