Nik Lsuprsend.tech·Apr 11, 2024FeaturedRedis <-> RQScheduler <-> Celery for Dynamic Task Scheduling and Concurrent Execution in Django BackendIn our previous setup, the initial problem seemed straightforward: implementing a scheduling mechanism for database queries using goroutines. This approach worked well with minimal resources and SQLite in a Go service. However, when integrating this ...Discuss·13 likes·244 readsPython
Nik Lsuprsend.tech·Mar 24, 2024Optimizing Task Scheduling and Concurrent Operations Through Redis & Postgres in Python BackendThe problem initially appeared straightforward, but it quickly became apparent that we had underestimated its complexity. In our prior setup, we relied on goroutines to schedule database queries, enabling us to operate efficiently with minimal resour...DiscussSaaS
Emiliogetemilio.hashnode.dev·Feb 20, 2024How to cleanly stop Celery tasks on conditions or exceptionsIf you just want to see my solution without previous context scroll down! Context I’ve been struggling quite a bit with exiting Celery tasks cleanly while developing Emilio. We use Django as the backend and Celery to run tasks on workers. I had cases...DiscussPython
Bjoern StielProcelery.school·Jan 16, 2024Happy User, Happy Life: Real-Time Celery Progress Bars With FastAPI and HTMXImagine this: You are interacting with a web app where you upload an Excel workbook. When the upload is finished, the app lets you browse the workbook content, its version history and shows you the diffs between versions. Deep down in the engine room...Discuss·1.0K readsFastAPI
Arjun AdhikariforPython is Lovepythonislove.com·Jan 14, 2024Profiling and Optimizing Django ApplicationsIn the world of web development, performance is key. A lagging or slow website can significantly impact user experience, leading to dissatisfaction and loss of traffic. In Django applications, performance issues often arise from inefficient code or u...Discuss·44 readsDjangoDjango
Victor Olusolavictorolusola.hashnode.dev·Jan 1, 2024Implementing Celery with Django using RabbitMQIn web development, Django operates synchronous request-response cycle. However, certain tasks such as sending emails, processing large dataset, or handling time-consuming operations, can introduce delays that impact user experience. Let me demystify...Theola Onuh and 1 other are discussing this2 people are discussing thisDiscuss·6 likes·212 readsbackground worker
Lawal Afeezafeez1131.hashnode.dev·Jan 1, 2024How to Run Celery Tasks on Windows using WSL: A Step-by-Step Guide (2023/2024)Introduction Over the past few days, I faced several challenges attempting to run Celery on Windows. 😓 For those not so familiar, it's worth noting that Celery 4.0+ no longer officially supports the Windows OS. I found myself at a situation where va...Discuss·1 like·103 readsDjango
Bjoern StielProcelery.school·Dec 29, 2023Celery Tasks: A Guide to SQLAlchemy Session HandlingBefore I wrote this article, I hadn't realised that SQLAlchemy is a highly controversial subject. Heated discussions on Reddit and X. Love it or hate it. The full drama. The polarising nature of the internet aside, what is true about SQLAlchemy is, t...Discuss·1 like·1.2K readscelery
Bjoern StielProcelery.school·Dec 20, 2023Celery on Windows: What's the latest?Celery dropped support for Windows a long time ago, somewhere around version 4. Celery 3 was the last version to support Windows, and back in 2018, when I published the first version of this article, it was a somewhat acceptable workaround. Not these...Humphrey Kinoti and 2 others are discussing this3 people are discussing thisDiscuss·13 likes·3.0K readscelery
Bjoern StielProcelery.school·Dec 19, 2023A Quick Guide to Celery Task RoutingBy default, Celery routes all tasks to a single queue and all workers consume from this default queue. You can change this behaviour by telling Celery which tasks to send to which queues. This is known as task routing. This is useful if you have slow...Discuss·2.0K readscelery
