SSSandheep Sinhiddenarchitectures.hashnode.dev·Jun 10 · 6 min readThe Day Finding the API Wasn't the SolutionWhen I first opened the Chinese portal, I expected a fairly standard workflow. Most government portals follow a familiar pattern: Search ↓ API Request ↓ Results ↓ Detail API Find the search API. Find 02O
SSSandheep Sindataextractionfailure.hashnode.dev·Apr 17 · 4 min readI Tried to Automate Data Extraction — The Website Fought Back Alternative Title: Web Scraping Isn’t Always Possible: Lessons from a React-Based Application🚀 Introduction Recently, I worked on a real-world problem where I needed to extract a large dataset (~80,000 records) from a web application. At first, it looked like a straightforward web scraping t02S