UUmairinumair-blogs.hashnode.dev·Feb 8, 2025 · 1 min readSnowflake-Loading-DataBusiness Overview Snowflake's Data Cloud is based on a cutting-edge data platform delivered as a service(SaaS). Snowflake provides data storage, processing, and analytic solutions that arequicker, easier to use, and more versatile than traditional op...00
UUmairinumair-blogs.hashnode.dev·Feb 8, 2025 · 2 min readReal Estate Data Pipeline with AWS, Airflow, Snowflake & Power BIThis project implements a scalable data pipeline to extract, transform, and load real estate data from Redfin into Snowflake using AWS services. The data is later visualized in Power BI to provide insights into real estate trends. Overview The pipeli...00
UUmairinumair-blogs.hashnode.dev·Feb 8, 2025 · 5 min readReal-Time-Data-Pipeline-with-AWS-NiFi-and-SnowflakeProject: Slowly Changing Dimensions in Snowflake Using Streams and Tasks Introduction This project implements a real-time data pipeline for continuous data ingestion and transformation into a Snowflake data warehouse. It leverages various cloud techn...00
UUmairinumair-blogs.hashnode.dev·Feb 8, 2025 · 1 min readReal-Time Stock Market Data Pipeline with Kafka and AWSProject Overview This project demonstrates a real-time data pipeline for stock market data. It integrates Apache Kafka for data streaming and multiple AWS services for data storage and querying. Key Features: Real-time data ingestion using Kafka Pro...00
UUmairinumair-blogs.hashnode.dev·Feb 8, 2025 · 2 min readWeather and S3 Data Integration Pipeline with Apache Airflow on AWSThis project demonstrates an ETL pipeline built with Apache Airflow on an AWS EC2 instance. The pipeline pulls data from the OpenWeather API and Amazon S3, performs transformations, loads the data into an RDS PostgreSQL database, joins the datasets, ...00
