Lokesh Kumar Jhajhalokesh.hashnode.dev·Jan 12, 2025Building an Efficient and Scalable Web Crawler: A Beginner's GuideBuilding a crawler which comes with its own set of challenges, such as handling dynamic content, infinite scrolling, and varying URL structures across different platforms. In this blog post, I’ll walk you through how I built a scalable web crawler th...web crawler
Parth Chauhanparthdev.hashnode.dev·Nov 23, 2024Understanding RabbitMQ: A Powerful Message Broker for Scalable ApplicationsIn today's world of distributed applications, seamless communication between different services is critical for achieving scalability, reliability, and fault tolerance. One of the most effective ways to handle this communication is through message qu...1 likerabbitmq
Usman Soliucode-along.hashnode.dev·Oct 13, 2024Why Job Queues In Your System Architecture?As a backend engineer, you’ve likely faced tasks that take a long time to complete, causing delays in system response or even timeouts. These tasks don't always require immediate execution, but handling them within the same request can slow everythin...2 likes·77 reads Bee-Queue
Shivang Yadavblogs.shivangyadav.me·Oct 12, 2024Scaling Backend Servers with Messaging Queues: A Deep Dive Using BullMQScaling backend infrastructure is one of the most critical steps in handling growing traffic and ensuring smooth operation under heavy loads. As systems grow, a single server processing all the tasks synchronously can become a bottleneck. This is whe...1 like·43 readsbackend
Nitish Kumarnov1ce.hashnode.dev·Oct 4, 2024Understanding BullMQ: A Simple Yet Powerful Message QueueIntroduction In the world of system design, the choice of a message queue can significantly impact the performance and reliability of applications. One such robust option is BullMQ, a powerful and flexible message queue built on Redis. This blog post...TIL
Muhammad Sufiyaninnosufiyan.hashnode.dev·Jun 29, 2024Connection ConfigurationIn BullMQ, the connection object is used to define how BullMQ connects to a Redis server. Redis is an in-memory data structure store that is often used as a database, cache, and message broker. BullMQ uses Redis to store and manage its job queues. He...SMIT - Batch 10bullmq
Muhammad Sufiyaninnosufiyan.hashnode.dev·Jun 29, 2024BullMQBullMQ is a job queue library for Node.js, not a messaging queue service in the traditional sense like RabbitMQ or Apache Kafka. While it shares some similarities with messaging queue systems, BullMQ focuses specifically on managing and processing jo...107 readsSMIT - Batch 10bullmq
Muhammad Sufiyaninnosufiyan.hashnode.dev·Jun 17, 2024Scalable System and Its BenefitsScalability refers to a system's ability to handle increased load by adding resources, such as more servers or increasing computational power, without compromising performance. Scalable systems are designed to grow and manage increased demand efficie...33 readsSMIT - Batch 10Scalable web applications
Atul Kumarblogs.aboutatul.in·Jun 8, 2024My Journey with BullMQ: Sending Bulk EmailsYesterday, I was working on my personal project, a web app that needed to send bulk emails to users. Everything was going smoothly until I hit a roadblock. My app was starting to slow down because it was trying to handle too many email-sending tasks ...2 likes·213 readsbullmq
Gaurav Kumargauravbytes.hashnode.dev·May 20, 2024Reliable Background Task Execution using BullMQ and Node.jsIn modern Node.js applications, ensuring smooth background processing is crucial for maintaining responsiveness and scalability. Message queues offer an effective solution, decoupling message production from consumption and enabling asynchronous task...1 like·781 readsQueues
