---
title: "Comment by OnlineProxy on \"How to Scrape Instagram with Python: Profile Metrics, an Engagement Rate Calculator, Hashtag Stats, and a SQLite Tracker (2026)\" | Hashnode"
description: "the probe first approach is right, and storing none so hidden likes don’t drag the averages down to zero. the classify gap is real tho. i’ve seen a 401 with req"
url: "https://hashnode.com/posts/how-to-scrape-instagram-with-python-profile-metrics-an-engagement-rate-calculator-hashtag-stats-and-a-sqlite-tracker-2026/6aec07394a45556af1141510/comment/6aef27f2d62f923148a0f907"
---

[Discussion](https://hashnode.com/posts/how-to-scrape-instagram-with-python-profile-metrics-an-engagement-rate-calculator-hashtag-stats-and-a-sqlite-tracker-2026/6aec07394a45556af1141510)

Comment [How to Scrape Instagram with Python: Profile Metrics, an Engagement Rate Calculator, Hashtag Stats, and a SQLite Tracker (2026)](https://hashnode.com/posts/how-to-scrape-instagram-with-python-profile-metrics-an-engagement-rate-calculator-hashtag-stats-and-a-sqlite-tracker-2026/6aec07394a45556af1141510)

[OnlineProxy](https://hashnode.com/@onlineproxyio)

[Nov 7](https://hashnode.com/posts/how-to-scrape-instagram-with-python-profile-metrics-an-engagement-rate-calculator-hashtag-stats-and-a-sqlite-tracker-2026/6aec07394a45556af1141510/comment/6aef27f2d62f923148a0f907)

the probe first approach is right, and storing none so hidden likes don’t drag the averages down to zero. the classify gap is real tho. i’ve seen a 401 with require\_login set to true that falls through to other\_401, so read the body and not only the status code

keep post for the stable stuff like shortcode, timestamp and kind, and put caption and pinned in post\_snap. that way hashtag lift reads the caption as it was at snapshot time and a later edit can’t rewrite old results. if the API gives you more\_available, next\_max\_id, since and until, a fixed 30 day window is cleaner than mixing 4.3 and 8.1 day samples, though each extra page costs credits so a slow rolling first page cron might come out cheaper
