---
title: "Mehul Jalondhara (@mrhacker789) | Hashnode"
description: "Founder of DataScrape Solutions. I build custom web scrapers and data pipelines for businesses. I write about web data, scraping, and what the public web rea..."
url: "https://hashnode.com/@mrhacker789"
---

@mrhacker789

# Mehul Jalondhara

@mrhacker789 · Bengaluru, India · Joined October 2026

## Comments

[On the pagination, that one is Myntra’s own behavior, not my wrapper. Myntra’s search is cursor-based internally. Each response hands you back a context token and you pass that token into the next call to get the next page. If you don’t carry that token, Myntra just keeps giving you page 1 on the default sort, which is most likely the page-1 loop those other write-ups are running into. My /search walks that same Myntra cursor, so it pages through properly. You can check it yourself by hitting Myntra’s own search call without the context token and you’ll see it loop too. Using an explicit sort like popularity or price\_asc is really just another way around the same Myntra behavior. Good shout on calling it out though, I’ll make the default-loop thing clear in the docs. On coupon\_discounted\_price, that’s the final price you actually pay after the maximum discount on the product is applied, not a coupon code or cart-minimum thing. I’ll spell the scope out in the docs so it’s not ambiguous. On average\_rating, yeah. It should be a number like the prices are, so I’ll normalize it to keep the schema consistent.](https://hashnode.com/posts/scraping-myntra-is-a-nightmare-so-i-wrapped-it-in-an-api/6ad07ebebd509e3ff7ef504c/comment/6ad1137ab88c486a0649b1ff#reply-6ad1da5045cc57896f5ecdbb)

Reply · Article · Oct 16 · [Scraping Myntra is a nightmare, so I wrapped it in an API](https://hashnode.com/posts/scraping-myntra-is-a-nightmare-so-i-wrapped-it-in-an-api/6ad07ebebd509e3ff7ef504c)

[Yeah, fair on all of these. The 403s, you're right, that's just the server blocking my request, not an actual robots rule. A 4xx there basically means "no rules, go ahead," so lumping them in with real blocks was sloppy of me. Will reword it. WSJ is the one that actually bugs me. I only counted a block when a site named the bot and did Disallow: /. WSJ flips it: blocks everyone with User-agent: \* and then allowlists a few. So my script saw "no named blocks" and called it open, when it's really the opposite. Means I'm undercounting all the default-deny sites, not just WSJ. Gonna rerun it to catch that and fix the numbers. 8 vs 9, yeah that's just a mistake. Text says eight, table has nine because I threw Amazonbot in and forgot to line them up. Will fix. News number is 20 out of 25 sites, so small sample, fair to want that called out. I'll add it. Good catches. Reworking it.](https://hashnode.com/posts/who-blocks-ai-crawlers-i-checked-the-robots-txt-of-the-top-1-000-sites/6abfceb6200ff04af34dad55/comment/6ac4e0b3cc43be88b145888c#reply-6ac4fd66d98e2a495a1d2063)

Reply · Article · Oct 6 · [Who blocks AI crawlers? I checked the robots.txt of the top 1,000 sites](https://hashnode.com/posts/who-blocks-ai-crawlers-i-checked-the-robots-txt-of-the-top-1-000-sites/6abfceb6200ff04af34dad55)
