VNVishnu Nukalainvishnunukala.hashnode.dev·5d ago · 7 min readWhat If Your Food Delivery App Could Just... Understand You?A few weeks ago I was doing what most of us do at 9 PM — scrolling through a food delivery app, trying to decide what to order. Filters. Ratings. Endless scrolling through the same restaurants. At som00
SHSanskriti Harmukhinvultr.hashnode.dev·Sep 3 · 8 min readInstalling Apache Airflow on Ubuntu 24.04Apache Airflow is an open-source workflow management platform that manages data pipelines and automates workflows such as Extract, Transform, and Load (ETL) processes. It uses Python-based Directed Ac00
LCLaura Cristina Chicovis da Cruzinbix-tech.hashnode.dev·Sep 3 · 8 min readHow to integrate Apache Airflow with OpenLineage for end-to-end traceabilityBy the end of this walkthrough, every DAG run in your Airflow instance emits structured lineage events that name the exact tables each task read and wrote, and you can open a graph and answer "which u00
SSunnyinsunny-snskarora.hashnode.dev·Aug 30 · 6 min read🕳️ HomeLab Chronicles: Episode 9 - Tunnel VisionHey all 👋 State of the lab: two nodes, Flux in charge, Airflow alive, backups nightly, RBAC banished to therapy. The UI works from anywhere in the house. But "in the house" is a service radius measur00
SSunnyinsunny-snskarora.hashnode.dev·Aug 30 · 7 min read🤫 HomeLab Chronicles: Episode 8 - The Silent TreatmentHey all 👋 Quick recap: power cut (Ep5), GitOps (Ep6), locked myself out of my own control plane (Ep7), rebuilt in twenty minutes because GitOps (Ep6, smugly). Now: getting Airflow back up. Which shou00
SSunnyinsunny-snskarora.hashnode.dev·Aug 28 · 18 min read🌪️ HomeLab Chronicles: Episode 4 - TurbulenceHey all 👋Sit tight! Because this is a little lengthy one. Last episode I closed by announcing that I would be adding two more nodes and bringing in Cilium. Confident. Specific. A real roadmap. The De00
PVPranjal Vermainblog.pvcodes.in·Aug 23 · 6 min readApache Iceberg: The Backbone of the Modern Open LakehouseThe lakehouse pitch is seductive: keep your data as open Parquet on cheap object storage, then let any engine - Spark for heavy ETL, Trino for dashboards, Athena for ad-hoc poking - query the same tab00
ARArpit Rathoreinarpitrathore.com·Aug 15 · 16 min readLanding My First Apache Airflow ContributionThis is the story of my first open source contribution to Apache Airflow. It took five and a half months and thirteen commits to go from an open pull request to a merged one. Along the way the PR was 00
SSapotaCorpinsapotacorpvn.hashnode.dev·Jul 12 · 7 min readIngesting every partner's file format without rewriting code each timeA credit bureau we worked with had built its ingestion the way most platforms start: one fixed file template, loaded in batches, parsed by code written specifically for that shape. It worked right up 00
RKRithwik Kumar Nagulapatiinrithwikn.hashnode.dev·Jul 5 · 7 min readHow I Cut Infrastructure Costs by Building an Auto-Shutdown Mechanism for a Long-Running Java Batch Pipeline on an Ephemeral ClusterIt started with a cost conversation So my manager pulled me aside one day. Pretty direct conversation, infrastructure costs for our batch pipeline were too high, and he needed me to do something about00
