How I reduced $10000 Monthly AWS Glue Bill to $400 using Airflow
During my time as a Devops Engineer at Vance, we were running around 80 ETL pipelines on AWS Glue, but as our workloads scaled, so did our costs — hitting a staggering $10,000 per month. This wasn’t sustainable. After analyzing our pipeline, we reali...
skysingh04.hashnode.dev11 min read