Lewis Kerrswiftproxy.hashnode.dev·Jan 25, 2025Mastering Proxy Integration with Python Requests and PlaywrightIn Python development, sometimes we need to send network requests through a proxy server to hide the real IP, bypass access restrictions, or increase access speed. This article will introduce how to use the requests library and playwright library in ...playwright
Lewis Kerrswiftproxy.hashnode.dev·Jan 24, 2025How to Use Rotating Proxies for Web Requests in PythonWhen making network requests in Python, using rotating proxies is a very useful technique, especially when you need to avoid IP blocking, bypass geographical restrictions, or perform large-scale data collection. This article will introduce how to use...Rotating Proxies
Lewis Kerrswiftproxy.hashnode.dev·Jan 17, 2025How to Efficiently Scrape Yelp Data Using Python and ProxiesAs an online business evaluation platform, Yelp gathers a large number of users' evaluations, ratings, addresses, business hours and other detailed information on various businesses. This data is extremely valuable for market analysis, business resea...proxy
Lewis Kerrswiftproxy.hashnode.dev·Jan 16, 2025A Beginner's Guide to Web Scraping with Selenium and Proxies for Enhanced PrivacySelenium is a powerful tool that allows users to scrape data by simulating user operations in the browser, such as clicking, filling out forms, submitting, etc. When performing web crawlers, using a proxy can hide your real IP address and prevent the...Python
Lilian Cariourasengansec.hashnode.dev·Jan 6, 2025Solidity StorageIntroduction Think of Ethereum contract storage like a giant library with infinite shelves, where each shelf (slot) is exactly 32 bytes wide. Many developers new to Solidity imagine storage working like a continuous bookshelf where books (data) are p...storage-optimization
Vineeta Jainninjavin.hashnode.dev·Jan 3, 2025Mastering CORS Handling with devServer.proxyA few days ago, I encountered a challenge that many frontend developers face—dealing with CORS (Cross-Origin Resource Sharing) errors. My application, running locally, needed to fetch data from a remote API, but the infamous browser error popped up: ...coding
Carlos Armando Marcano Vargascarlosmv.hashnode.dev·Dec 26, 2024How to Build a Reverse Proxy with Rust and RamaIn this article, we are going to build a Reverse Proxy using Rama Framework. More specifically, a TLS termination proxy from this example. I’m writing this article for learning purposes, this is not meant to be a production-ready proxy. I’m a learner...84 readsReverse Proxy
Just Another Devjustanotherdev.hashnode.dev·Dec 16, 2024Proxy, reverse proxy and API gatewayWhat are the differences between all of them? How do they all relate? There is one overlapping concept that goes into all of those: connecting systems. The main function of all of these is to connect two or more systems that want to communicate. And ...backend
Lewis Kerrswiftproxy.hashnode.dev·Dec 10, 2024Efficient Techniques for URL Scraping and Data Extraction with PythonThe Internet is an ocean of data. How to efficiently crawl and extract valuable information from it has become an important topic in many fields. Python, with its powerful library support and flexible programming features, has become the preferred to...Python
Lewis Kerrswiftproxy.hashnode.dev·Dec 9, 2024Using Python 3 to Obtain and Fix Proxies from a URLIn the process of web crawling and data collection, proxy servers play a vital role. They can help us bypass IP restrictions, hide our true identity, and improve the efficiency of crawling. This article will detail how to obtain and parse proxy infor...Python 3