SKsabiha khanumindataengineering101.hashnode.dev·Jun 22 · 7 min readBuilding an Adaptive Anomaly Detection Pipeline for Financial Streams This is not a finished project post. It is a working notes post of what I am building, why I am building it, what is working, what is not yet, and where it is going. I am writing this now, mid-build, 00
SKsabiha khanumindataengineering101.hashnode.dev·May 13 · 9 min readBuild, Break, Ship: What I Learned Building a Real‑Time PipelineI built this pipeline because I wanted to stop talking about streaming systems and start having built one properly. Not a tutorial follow-along. Not a single Kafka consumer writing to a CSV. An actual00
SKsabiha khanumindataengineering101.hashnode.dev·Dec 15, 2025 · 10 min readRedis: A Comprehensive Technical Deep DiveWhat Redis Is Redis (Remote Dictionary Server) is an open-source, in-memory data structure store that functions as a database, cache, message broker, and streaming engine. Unlike traditional disk-based databases, Redis keeps its entire dataset in RAM...00
SKsabiha khanuminspark-or-snowflake.hashnode.dev·Nov 30, 2025 · 5 min readDistributed File Systems (DFS): Architecture, Use Cases & EvolutionIntroduction Traditional file systems on a single machine just can't keep up with the scale and performance needs of modern data infrastructure. That’s where Distributed File Systems (DFS) come into play. In this blog, I’ll take you through what a DF...00
SKsabiha khanumindataengineering101.hashnode.dev·Jun 30, 2025 · 7 min readHow to Handle Tough Data Engineering Interview Questions: Tips from Real ExperiencesI’ve seen the field evolve dramatically—from the days of traditional ETL batch jobs on relational databases to today’s bustling ecosystem of cloud-native data platforms, real-time streaming, and machine learning integration at scale. This journey com...00