KMKashif Mohammadinblog.lucrolearning.com·Aug 12 · 10 min readBuilding a Task Queue From ScratchI wanted one thing: a Node.js service and a Python service pulling work from the same queue. Not two queues sitting next to each other, one queue, genuinely shared, so either language could pick up an10
KMKashif Mohammadinblog.lucrolearning.com·Aug 3 · 11 min readInside the Pipeline: Clustering, Summarizing, and Mapping Themes at ScaleIn Part 7 we followed a batch of raw text responses through fetching, pruning, deduplication, preprocessing, and embedding, and ended up with one clean dataset: every response paired with its vector, 11X
KMKashif Mohammadinblog.lucrolearning.com·Aug 2 · 11 min readInside the Pipeline: Fetching, Cleaning, and Embedding Survey Data at ScaleIn Part 6 we closed the loop on the execution platform: a worker process boots in isolation, reports progress through a callback, listens for SIGTERM, and cleans up after itself no matter how it exits00
KMKashif Mohammadinblog.lucrolearning.com·Aug 2 · 5 min readMaking Workers Production ReadyThe Worker Has Been Loaded… Now What? In the previous article we followed a job from the Queue Manager into a newly created worker process. By this point our worker has: Started a new Python process 00
KMKashif Mohammadinblog.lucrolearning.com·Jul 18 · 6 min read"Inside the Worker: Building a Resilient AI Execution Platform" This is Part 5 of the Beyond FastAPI series In the previous article, The Listener Loop: Turning Jobs into Work, we built the scheduling layer responsible for monitoring the queue, enforcing concurrenc00
