---
title: "Comment by OnlineProxy on \"How to Scrape Job Listings from Workday Career Sites (Without Writing a Scraper)\" | Hashnode"
description: "the total field only shows up on the first page and turns into 0 after offset 20, so your offset vs total loop will quietly stop after 40 jobs. just grab total"
url: "https://hashnode.com/posts/how-to-scrape-job-listings-from-workday-career-sites-without-writing-a-scraper/6ac7628c13bf1a3bdd6b0412/comment/6ac7c2ec3f3ed4fda24fe023"
---

[Discussion](https://hashnode.com/posts/how-to-scrape-job-listings-from-workday-career-sites-without-writing-a-scraper/6ac7628c13bf1a3bdd6b0412)

Comment [How to Scrape Job Listings from Workday Career Sites (Without Writing a Scraper)](https://hashnode.com/posts/how-to-scrape-job-listings-from-workday-career-sites-without-writing-a-scraper/6ac7628c13bf1a3bdd6b0412)

[OnlineProxy](https://hashnode.com/@onlineproxyio)

[Oct 8](https://hashnode.com/posts/how-to-scrape-job-listings-from-workday-career-sites-without-writing-a-scraper/6ac7628c13bf1a3bdd6b0412/comment/6ac7c2ec3f3ed4fda24fe023)

the total field only shows up on the first page and turns into 0 after offset 20, so your offset vs total loop will quietly stop after 40 jobs. just grab total from the first response and you're good

also limit maxes out at 20, and if you try 25 it fails different ways depending on the tenant, sometimes http 400 and sometimes just an empty jobpostings array that looks like no results. worth testing on your specific tenants first

and postedon just says 30+ days ago for anything older than about 30 days. so if you need exact dates on older listings you gotta hit the detail fetch with includedetails to get posteddate
