Feed
Discussion
Introduction to Webcrawling (with Javascript and Node.js)
https://unsplash.com/photos/lOsbnJKTaI8 From the point I started to learn about web development I was enthusiastic about web crawling or web scraping. Most of the time it is called "web crawling", "web scraping" or "web spider". Going through the we...
Responses
Markdown supported · ⌘↵ to post
Siddarthan Sarumathi Pandian
Full Stack Dev at Agentdesks | Ex Hashnode | Ex Shippable | Ex Altair Engineering
I think web crawling can also be used a defense mechanism. For instance, companies like AWS and Mailchimp run crawlers over sites like Medium and GitHub to make sure that important account credentials are not accidentally leaked.