Hack Unitedblog.hackunited.org·Jul 21, 2024Navigating the Navigation Bar: Web Scraping with Python (It's Easier Than You Think!)Ever wondered what's lurking beneath the surface of a website? No, I'm not talking about creepy crawlies (although some website code can be pretty scary). I'm talking about the structure itself, and how you can use Python to peek under the hood. In t...DiscussWeb Development
Lê Đức Minhmr8opt.hashnode.dev·Jul 15, 2024Scraping the Web Like a Boss with ScrapeGraphAIHarness the Power of AI to Automate Your Data Collection Introduction My previous postings focused heavily on leveraging external tools to increase the quality of the end output while applying the Augmented Language Models framework. However, I reali...DiscussAI
Arpan Mahatraarpanmahatra.hashnode.dev·Jul 11, 2024BeautifulSoup vs Scrapy vs SeleniumAs a data analyst, the first step we always go through is data collection. When we are doing company project, we receive most data from organizational databases. However, when we do non-organizational projects, we consider web-scraping as a sole meth...Discussweb scraping
Prashant Jhaprashantjha14.hashnode.dev·Jul 10, 2024How I Created a Discord Bot for ICAI Batch NotificationsMy brother is studying for CA, and it is compulsory to take two study batches (Orientation and Information Technology) by ICAI. However, most of the time, the batches are full, and it can be tedious to check for availability continuously. So, I made ...DiscussTechForGood
Buzzpybuzzpy.hashnode.dev·Jul 4, 2024How to scrape Weather.com for Weather Information using BeautifulSoupAre you planning to go out for this summer? Picking a date for the perfect summer day out would be difficult but running a simple data analysis of the weather of upcoming dates may save you the hustle. In this tutorial, we will scrape and extract dat...Discuss·105 readsPython
Niladri Dasniladridas.hashnode.dev·Jun 30, 2024How to Create Datasets: A Data Science GuideAs a data scientist, one of the most crucial steps in any project is generating a high-quality dataset. A dataset is the foundation of any machine learning model, and its quality can make or break the accuracy of the model. In this blog post, we'll e...Discuss·88 readsProbability Theory
Nnakwe Anslemdevanslem.hashnode.dev·Jun 29, 2024Web Scraping Using PuppeteerBackstory My journey into web scraping began with a project to create a website containing information about primary and secondary schools in Nigeria. Building the website itself wasn't a challenge—I had already developed several sites using modern t...Discussweb scraping
BrowserScanbrowserscan.hashnode.dev·Jun 13, 2024What Is a Bot and How Does It Work?Bots, or internet robots, are software applications designed to perform tasks automatically, often replacing human effort. They follow instructions from their creators to handle tasks ranging from data scraping and customer service to managing routin...Discussbots
BrowserScanbrowserscan.hashnode.dev·Jun 11, 2024The Beginner's Guide to Proxies: Mobile ProxiesWith the rise of online threats such as hacking and data breaches, securing both personal and business information has become crucial. In response, many are turning to proxy services, yet the concept of a "mobile proxy" remains unfamiliar to a broad ...Discussmobile proxy
BrowserScanbrowserscan.hashnode.dev·Jun 4, 2024The Beginner's Guide to Proxies: Rotating ProxiesWeb scraping is a powerful tool for gathering data, but it often faces challenges such as being blocked by websites. Rotating proxies are a practical solution to overcome these obstacles. They operate by providing a dynamic pool of IP addresses, whic...Discussproxy