Weather and S3 Data Integration Pipeline with Apache Airflow on AWS
This project demonstrates an ETL pipeline built with Apache Airflow on an AWS EC2 instance. The pipeline pulls data from the OpenWeather API and Amazon S3, performs transformations, loads the data into an RDS PostgreSQL database, joins the datasets, ...
umair-blogs.hashnode.dev2 min read