Your Scraper Died at Row 12,000. The Rerun Pattern.
My scraper died at row 12,000 of 50,000, three hours in. The crash itself was cheap. A process gets OOM-killed, a quota trips, a machine reboots, it happens. The expensive part came next: I re-ran it.
spinov001.hashnode.dev16 min read