3 traps that broke my first Instagram scraper — and how I fixed them for good

your pagination labeling is solid, but consider tagging each field with source and status like verified or missing so you can understand where agreement matters. three sources can fail the same way if they hit the same block

keep treating short pages as ambiguous rather than a hard end signal, and default to incomplete. respecting retry headers and rate limits is just good practice and cuts load on both sides