CommentJan 2, 2021
Hi Ido, I have gone through your Data scraping post and it was knowledgeable. Thank you for that. Need your expert suggestion, We are a young team and working on a JOb portal platform in Bootstrap 4 & NodeJS & MongoDB. We are using python too for few services. We want to scrap the company career pages and present on our platform like indeed & other platform does. For that first, we are generating the sitemap and crawl the career pages. Oour approach is, generate the sitemap for website => crawl the links => scrap the jobs are we doing it right? Any suggestions to our approach?