Cloud Composer — GCE Persistent Disk Volume for KubernetesPodOperator
The Kubernetes executor was introduced in Apache Airflow 1.10.0. The Kubernetes executor creates a new pod for every task instance. Sometimes task requires to read configuration files or write output data to files.
This post explains how to add a GCE...
devlit.hashnode.dev4 min read