Building a Drift Detector, Breaking It on Purpose, and What That Taught MeA few months ago I built a system that watches a live stream of prices and tries to notice when "normal" changes. Not just "the price went up", anyone can see that on a chart, but the harder question:Aug 18 · 8 min readdataengineering101.hashnode.dev
Building an Adaptive Anomaly Detection Pipeline for Financial Streams This is not a finished project post. It is a working notes post of what I am building, why I am building it, what is working, what is not yet, and where it is going. I am writing this now, mid-build, Jun 22 · 7 min readdataengineering101.hashnode.dev
Build, Break, Ship: What I Learned Building a Real‑Time PipelineI built this pipeline because I wanted to stop talking about streaming systems and start having built one properly. Not a tutorial follow-along. Not a single Kafka consumer writing to a CSV. An actualMay 13 · 9 min readdataengineering101.hashnode.dev
Redis: A Comprehensive Technical Deep DiveWhat Redis Is Redis (Remote Dictionary Server) is an open-source, in-memory data structure store that functions as a database, cache, message broker, and streaming engine. Unlike traditional disk-based databases, Redis keeps its entire dataset in RAM...Dec 15, 2025 · 10 min readdataengineering101.hashnode.dev
Distributed File Systems (DFS): Architecture, Use Cases & EvolutionIntroduction Traditional file systems on a single machine just can't keep up with the scale and performance needs of modern data infrastructure. That’s where Distributed File Systems (DFS) come into play. In this blog, I’ll take you through what a DF...Nov 30, 2025 · 5 min readspark-or-snowflake.hashnode.dev
