Airflow in ECS with Redis - Part 1: Overview

How to set up a containerised Airflow installation in AWS ECS using Redis as its queue orchestrator. A bit of background A few years ago I joined a Data team where we processed a lot of analytics information coming from online search engines. This ET...