FFFred Fenginfredfeng.hashnode.dev·1d ago · 6 min readCronflower: Run a DAG workflow across your cluster, instead of chaining cron jobscronflower is an open-source, distributed scheduler for the JVM with a web console. cronflow is its optional DAG add-on: declare the steps and how they depend on each other as a graph, and the same cl00
CACiphemic academiainciphemicacademia.hashnode.dev·Sep 16 · 7 min readData Engineer Career Path: Beyond the Clean CSV Import (2026)A Clean CSV Import Is Not a Data Engineering Portfolio Almost every beginner data project starts the same way: import a clean CSV, run a few transformations, load it into a table, done. It's a reasona00
VNVishnu Nukalainvishnunukala.hashnode.dev·Sep 6 · 7 min readWhat If Your Food Delivery App Could Just... Understand You?A few weeks ago I was doing what most of us do at 9 PM — scrolling through a food delivery app, trying to decide what to order. Filters. Ratings. Endless scrolling through the same restaurants. At som00
SHSanskriti Harmukhinvultr.hashnode.dev·Sep 3 · 8 min readInstalling Apache Airflow on Ubuntu 24.04Apache Airflow is an open-source workflow management platform that manages data pipelines and automates workflows such as Extract, Transform, and Load (ETL) processes. It uses Python-based Directed Ac00
LCLaura Cristina Chicovis da Cruzinbix-tech.hashnode.dev·Sep 3 · 8 min readHow to integrate Apache Airflow with OpenLineage for end-to-end traceabilityBy the end of this walkthrough, every DAG run in your Airflow instance emits structured lineage events that name the exact tables each task read and wrote, and you can open a graph and answer "which u00
SSunnyinsunny-snskarora.hashnode.dev·Aug 30 · 6 min read🕳️ HomeLab Chronicles: Episode 9 - Tunnel VisionHey all 👋 State of the lab: two nodes, Flux in charge, Airflow alive, backups nightly, RBAC banished to therapy. The UI works from anywhere in the house. But "in the house" is a service radius measur00
SSunnyinsunny-snskarora.hashnode.dev·Aug 30 · 7 min read🤫 HomeLab Chronicles: Episode 8 - The Silent TreatmentHey all 👋 Quick recap: power cut (Ep5), GitOps (Ep6), locked myself out of my own control plane (Ep7), rebuilt in twenty minutes because GitOps (Ep6, smugly). Now: getting Airflow back up. Which shou00
SSunnyinsunny-snskarora.hashnode.dev·Aug 28 · 18 min read🌪️ HomeLab Chronicles: Episode 4 - TurbulenceHey all 👋Sit tight! Because this is a little lengthy one. Last episode I closed by announcing that I would be adding two more nodes and bringing in Cilium. Confident. Specific. A real roadmap. The De00
PVPranjal Vermainblog.pvcodes.in·Aug 23 · 6 min readApache Iceberg: The Backbone of the Modern Open LakehouseThe lakehouse pitch is seductive: keep your data as open Parquet on cheap object storage, then let any engine - Spark for heavy ETL, Trino for dashboards, Athena for ad-hoc poking - query the same tab00
ARArpit Rathoreinarpitrathore.com·Aug 15 · 16 min readLanding My First Apache Airflow ContributionThis is the story of my first open source contribution to Apache Airflow. It took five and a half months and thirteen commits to go from an open pull request to a merged one. Along the way the PR was 00
