MSMuhammad Safiullah Khaninsafi-io.hashnode.dev·May 23 · 5 min readEnd-to-End Secrets Management for the Modern Data PlatformIntroduction Over the past few months, I have been heavily involved in building modern data platforms. From orchestrating pipelines and managing distributed services to deploying containers and handli00
MSMuhammad Safiullah Khaninsafi-io.hashnode.dev·Apr 12 · 5 min readEncapsulating External Dependencies with Dagster ResourcesWhy Encapsulation Matters in Data Pipelines In real-world pipelines, external systems (databases, APIs, queues) are stateful, unreliable, and slow. Directly calls to them inside ops/assets creates: T00
MSMuhammad Safiullah Khaninsafi-io.hashnode.dev·Apr 6 · 5 min readMastering Dagster SensorsIntroduction What are Dagster Sensors? Dagster Sensors are components that monitor external systems (like storage, APIs, or databases) and trigger pipeline runs when specific conditions are met. They 00
MSMuhammad Safiullah Khaninsafi-io.hashnode.dev·Jan 15 · 4 min readHow Docker Breaks UFW and Alters iptablesLet me set the context for this article: I was deploying some applications on my VPS, and while I had configured UFW (Uncomplicated Firewall), the ports published by Docker were still exposed directly to the internet. In this article, we’ll explore t...00
MSMuhammad Safiullah Khaninsafi-io.hashnode.dev·Jan 9 · 4 min readObject Calisthenics ConceptsObject Calisthenics is a set of 9 coding rules meant to improve object-oriented design, code readability, and maintainability. It’s not a framework or a library.Think of it as discipline for writing clean OOP code, similar to how physical calisthenic...00