KCKunde Chittaranjaninaws-glue-explained.hashnode.dev·Sep 19, 2025 · 4 min readOrchestrating and Securing Data Pipelines with AWS GlueFocus: Glue Workflows, triggers, integration with other AWS services, and governance. Outline: Intro: Why orchestration and governance matter in data pipelines. Workflows and Triggers: Event-based, on-completion, and scheduled triggers Parallel &...00
KCKunde Chittaranjanininside-dbt-deep-dive-and-design.hashnode.dev·Aug 20, 2025 · 7 min readMastering dbt: A Deep Dive into Advanced Concepts and Architecture1. Introduction — From Transformation to Analytics Engineering In modern data ecosystems, the traditional ETL paradigm has evolved into ELT: extract and load raw data first, then transform it within the warehouse. dbt (Data Build Tool) sits precisely...00
KCKunde Chittaranjaninaws-glue-explained.hashnode.dev·Aug 10, 2025 · 6 min readBuilding Efficient ETL Pipelines in AWS GlueFocus: Glue ETL job design, DynamicFrames, transformations, and performance optimization. Outline: Intro: Glue as a Spark-based distributed ETL engine. DynamicFrame vs DataFrame: Schema flexibility and conversion. ETL Flow: Reading → Transforming ...00
KCKunde Chittaranjaninaws-glue-explained.hashnode.dev·Jul 5, 2025 · 6 min readAWS Glue Architecture UnpackedFocus: Core components, how Glue works under the hood, and its role in the modern data ecosystem. Outline: Introduction: The problem Glue solves — serverless ETL at scale. Core Components: Glue Data Catalog — central metadata store Crawlers — aut...00