Hi Ido,
I have gone through your Data scraping post and it was knowledgeable. Thank you for that.
Need your expert suggestion, We are a young team and working on a JOb portal platform in Bootstrap 4 & NodeJS & MongoDB. We are using python too for few services.
We want to scrap the company career pages and present on our platform like indeed & other platform does. For that first, we are generating the sitemap and crawl the career pages.
Oour approach is, generate the sitemap for website => crawl the links => scrap the jobs
are we doing it right? Any suggestions to our approach?